-- Logs begin at Thu 2022-07-21 02:58:12 UTC, end at Thu 2022-07-21 04:03:05 UTC. -- Jul 21 03:29:18.562412 dv-cinder-850318-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 21 03:29:18.569632 dv-cinder-850318-2-smb devstack@keystone.service[80322]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 21 03:29:18.573675 dv-cinder-850318-2-smb devstack@keystone.service[80322]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 21 03:29:18 2022] *** Jul 21 03:29:18.573675 dv-cinder-850318-2-smb devstack@keystone.service[80322]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 21 03:29:18.573675 dv-cinder-850318-2-smb devstack@keystone.service[80322]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 21 03:29:18.573675 dv-cinder-850318-2-smb devstack@keystone.service[80322]: nodename: dv-cinder-850318-2-smb Jul 21 03:29:18.573675 dv-cinder-850318-2-smb devstack@keystone.service[80322]: machine: x86_64 Jul 21 03:29:18.573675 dv-cinder-850318-2-smb devstack@keystone.service[80322]: clock source: unix Jul 21 03:29:18.573675 dv-cinder-850318-2-smb devstack@keystone.service[80322]: pcre jit disabled Jul 21 03:29:18.573675 dv-cinder-850318-2-smb devstack@keystone.service[80322]: detected number of CPU cores: 4 Jul 21 03:29:18.573675 dv-cinder-850318-2-smb devstack@keystone.service[80322]: current working directory: / Jul 21 03:29:18.573675 dv-cinder-850318-2-smb devstack@keystone.service[80322]: detected binary path: /usr/bin/uwsgi-core Jul 21 03:29:18.573675 dv-cinder-850318-2-smb devstack@keystone.service[80322]: your processes number limit is 47680 Jul 21 03:29:18.573675 dv-cinder-850318-2-smb devstack@keystone.service[80322]: your memory page size is 4096 bytes Jul 21 03:29:18.573675 dv-cinder-850318-2-smb devstack@keystone.service[80322]: detected max file descriptor number: 2048 Jul 21 03:29:18.573675 dv-cinder-850318-2-smb devstack@keystone.service[80322]: lock engine: pthread robust mutexes Jul 21 03:29:18.573675 dv-cinder-850318-2-smb devstack@keystone.service[80322]: thunder lock: enabled Jul 21 03:29:18.573675 dv-cinder-850318-2-smb devstack@keystone.service[80322]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 21 03:29:18.573675 dv-cinder-850318-2-smb devstack@keystone.service[80322]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 21 03:29:18.621068 dv-cinder-850318-2-smb devstack@keystone.service[80322]: Python main interpreter initialized at 0x556aa7f299c0 Jul 21 03:29:18.621068 dv-cinder-850318-2-smb devstack@keystone.service[80322]: python threads support enabled Jul 21 03:29:18.621068 dv-cinder-850318-2-smb devstack@keystone.service[80322]: your server socket listen backlog is limited to 100 connections Jul 21 03:29:18.621068 dv-cinder-850318-2-smb devstack@keystone.service[80322]: your mercy for graceful operations on workers is 90 seconds Jul 21 03:29:18.621449 dv-cinder-850318-2-smb devstack@keystone.service[80322]: mapped 403077 bytes (393 KB) for 2 cores Jul 21 03:29:18.621531 dv-cinder-850318-2-smb devstack@keystone.service[80322]: *** Operational MODE: preforking *** Jul 21 03:29:18.621759 dv-cinder-850318-2-smb devstack@keystone.service[80322]: *** uWSGI is running in multiple interpreter mode *** Jul 21 03:29:18.621759 dv-cinder-850318-2-smb devstack@keystone.service[80322]: spawned uWSGI master process (pid: 80322) Jul 21 03:29:18.621968 dv-cinder-850318-2-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 21 03:29:18.626501 dv-cinder-850318-2-smb devstack@keystone.service[80322]: spawned uWSGI worker 1 (pid: 80331, cores: 1) Jul 21 03:29:18.626501 dv-cinder-850318-2-smb devstack@keystone.service[80322]: spawned uWSGI worker 2 (pid: 80332, cores: 1) Jul 21 03:29:18.626501 dv-cinder-850318-2-smb devstack@keystone.service[80322]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 21 03:29:24.022946 dv-cinder-850318-2-smb devstack@keystone.service[80331]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 03:29:24.022946 dv-cinder-850318-2-smb devstack@keystone.service[80331]: from cryptography.utils import int_from_bytes Jul 21 03:29:24.023692 dv-cinder-850318-2-smb devstack@keystone.service[80332]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 03:29:24.023692 dv-cinder-850318-2-smb devstack@keystone.service[80332]: from cryptography.utils import int_from_bytes Jul 21 03:29:24.024107 dv-cinder-850318-2-smb devstack@keystone.service[80331]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 03:29:24.024107 dv-cinder-850318-2-smb devstack@keystone.service[80331]: from cryptography.utils import int_from_bytes Jul 21 03:29:24.024215 dv-cinder-850318-2-smb devstack@keystone.service[80332]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 03:29:24.024215 dv-cinder-850318-2-smb devstack@keystone.service[80332]: from cryptography.utils import int_from_bytes Jul 21 03:29:24.072474 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 03:29:24.072617 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 03:29:24.072699 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 03:29:24.072784 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 03:29:24.072857 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] command line args: [] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 03:29:24.072978 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] command line args: [] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 03:29:24.073109 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 03:29:24.073259 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 03:29:24.073346 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ================================================================================ {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 03:29:24.073444 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ================================================================================ {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 03:29:24.073533 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] admin_token = **** {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.073703 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] admin_token = **** {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.073789 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] config_dir = [] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.073929 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.074008 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] config_dir = [] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.074112 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] config_source = [] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.074190 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.074304 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] config_source = [] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.074383 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] debug = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.074530 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] debug = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.074622 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.074862 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.075021 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.075144 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.075258 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.075378 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.075506 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.075621 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.075733 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.075845 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.075957 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] list_limit = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.076068 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] list_limit = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.076187 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] log_config_append = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.076306 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] log_config_append = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.076421 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.076533 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.076645 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] log_dir = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.076755 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] log_dir = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.076878 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] log_file = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.076998 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] log_file = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.077117 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.077230 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.077342 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.077443 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.077549 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.077663 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.077779 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.077878 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.078004 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.078127 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.078251 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.078338 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.078412 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.078575 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.078653 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.078777 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.078859 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.078930 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.079002 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.079073 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.079193 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.079276 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.079349 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.079468 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.079552 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.079665 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.079786 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.079927 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.080040 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.080225 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.080553 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.080741 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.080828 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] publish_errors = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.080946 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] publish_errors = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.081058 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.081182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.081296 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.081414 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.081531 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.081650 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.081762 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.081895 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.082020 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.082134 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.082252 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] standard_threads = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.082433 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] standard_threads = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.082585 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.082706 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.082820 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.082932 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.083048 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.083170 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] use_journal = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.083290 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.083402 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] use_json = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.083514 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] use_journal = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.083625 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] use_stderr = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.083737 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] use_json = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.083861 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] use_syslog = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.083975 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] use_stderr = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.083975 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] use_syslog = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.084192 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.084310 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 03:29:24.084424 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.084548 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.084662 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.084774 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.084894 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.085008 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.085120 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.085240 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.085354 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.085472 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.085586 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.085704 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.085816 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.085973 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.086090 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.086246 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.086361 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.086539 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.087141 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.087314 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.087441 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.087600 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.087724 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.087887 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.088004 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.088268 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.088400 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.088560 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.088676 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.088943 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.089066 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.089257 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.089372 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.089600 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.089716 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.089875 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.089992 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.090144 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.090262 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.090414 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.090588 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.090833 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.090951 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.091114 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.091232 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.091395 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.091519 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.091674 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.091791 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.091933 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.092052 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.092197 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.092314 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.092457 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.092582 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.092800 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.092924 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.093044 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.093157 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.093270 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.093393 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.093508 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.093619 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.093753 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.093871 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.094025 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.094152 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.094301 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.094424 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.094590 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.094707 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.094884 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.095011 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.095149 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.095265 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.095448 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.095564 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.095718 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.095911 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.096027 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.096139 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.096257 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.096378 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.096492 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.096613 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.096727 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.096838 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.096950 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.097061 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.097179 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.097305 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.097420 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.097533 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.097644 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.097757 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.097868 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.097989 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.098103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.098215 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.098326 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.098440 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.098578 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.098705 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.098819 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.098931 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.099042 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.099155 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.099296 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.099414 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.099513 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.099607 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.099701 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.099795 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.099889 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.100002 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.100100 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.100229 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.100344 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.100464 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.100587 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.100703 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.100825 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.100940 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.101063 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.101197 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.101320 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.101434 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.101556 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.101681 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.101797 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.101918 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.102034 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.102147 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.102266 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.103037 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.103156 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.103271 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.103384 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.103497 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.103620 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.103743 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.103848 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.103967 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.104081 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.104184 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.104304 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.104420 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.104529 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.104643 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.104843 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.104961 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.105084 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.105200 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.105314 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.105428 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.105541 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.105655 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.105776 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.105898 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.106015 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.106128 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.106242 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.106355 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.106507 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.106627 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.106741 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.106854 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.106968 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.107081 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.107202 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.107317 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.107431 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.107550 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.107673 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.107778 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.107981 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.108103 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.108217 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.108337 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.108452 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.108565 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.108687 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.108847 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.108982 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.109098 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.109211 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.109328 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.109442 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.109555 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.109677 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.109793 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.109912 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.110036 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.110157 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.110272 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.110394 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.110560 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.110677 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.110791 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.110903 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.111018 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.111144 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.111260 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.111381 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.111495 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.111615 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.111738 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.111854 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] auth.external = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.111854 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.112074 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.112074 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] auth.external = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.112289 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.112412 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.112558 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.112558 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] auth.password = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.112788 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.112903 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] auth.token = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.113017 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.113144 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.113261 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] auth.password = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.113383 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.113499 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] auth.token = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.113613 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.113728 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.113849 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.113964 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.114086 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.114204 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.114318 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.114432 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.114561 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.114676 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.114805 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] credential.caching = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.114922 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.115037 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.115151 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.115273 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.115389 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] credential.caching = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.115511 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.115627 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.115742 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.115856 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.115977 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.116092 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.116215 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.116331 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.116445 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.116559 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.116673 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.116788 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.116910 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.117027 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.117140 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.117255 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.117370 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.117490 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.117614 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.117730 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.117844 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.117967 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.118083 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.118197 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.118322 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.118440 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.118614 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] federation.caching = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.118730 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.118844 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.118958 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.119084 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.119200 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] federation.caching = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.119318 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.119434 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.119548 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.119662 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.119788 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.119904 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.120019 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.120133 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.120246 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.120360 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.120484 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.120600 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.120730 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.120846 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.120962 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.121076 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.121198 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.121314 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.121428 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.caching = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.121544 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.121658 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.121771 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.121962 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.122080 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.caching = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.122194 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.122308 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.122422 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.122558 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.122676 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.122791 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.122906 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.123019 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.123133 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.123256 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.123372 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.123486 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.123600 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.123714 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.123828 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.123951 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.124067 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.124188 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.124303 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.124417 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.124531 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.124654 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.124770 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.124891 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.125006 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.125120 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.125241 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.125369 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.125486 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.125601 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.125716 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.125830 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.125950 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.126074 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.126191 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.126305 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.126419 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.126562 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.126677 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.126677 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.126911 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.127025 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.127139 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.127252 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.127366 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.127488 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.127605 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.127718 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.127834 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.127948 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.128061 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.128184 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.128299 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.128413 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.128527 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.128641 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.128755 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.128878 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.128994 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.129108 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.129222 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.129340 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.129455 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.129577 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.129701 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.129818 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.129933 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.130047 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.130161 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.130284 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.130400 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.130540 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.130658 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.130772 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.130886 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.130886 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.131112 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.131227 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.131227 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.131448 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.131562 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.131684 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.131801 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.131915 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.132030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.132145 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.132259 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.132381 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.132569 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.132686 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.132800 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.132913 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.133026 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.133150 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.133265 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.133378 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.133492 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.133619 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.133744 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.133859 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.133973 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.134087 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.134201 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.134315 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.134438 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.134600 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.134715 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.134828 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.134828 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.135040 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.135167 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.135283 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.135396 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.135516 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.135631 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.135745 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.135866 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.135981 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.136095 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.136209 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.136323 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.136436 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.136557 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.136672 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.136785 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.136898 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.137011 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.137125 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.137247 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.137363 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.137476 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.137589 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.137702 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.137815 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.137937 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.138052 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.138165 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.138279 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.138392 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.138520 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.138649 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.138767 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.138882 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.138996 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.139110 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.139224 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.139352 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.139470 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.139584 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.139698 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.139812 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.139926 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.140047 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.140164 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.140278 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.140392 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.140506 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.140628 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.140752 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.140868 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.140983 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.141098 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.141212 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.141333 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.141458 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.141575 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.141689 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.141802 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.141916 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.142030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.142153 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] resource.caching = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.142269 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.142383 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.142511 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.142627 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.142741 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] resource.caching = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.142867 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.142984 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.143098 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.143212 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.143326 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.143440 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.143564 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.143681 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.143795 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.143910 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.144024 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.144138 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.144327 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.144445 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.144559 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] role.caching = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.144674 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.144788 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] role.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.144788 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.145011 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.145011 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] role.caching = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.145228 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.145342 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] role.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.145456 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.145571 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.145694 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.145811 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.145925 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.146039 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.146412 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.146592 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.146710 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.146824 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.146937 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.146937 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.147155 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.147278 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.147394 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.147506 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.147619 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.147733 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.147847 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.147968 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.148083 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.148197 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.148310 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.148310 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.148522 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.148644 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.148760 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.148874 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.148988 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.148988 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.149695 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.149818 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.149934 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.150046 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.150160 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.150273 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.150386 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.150524 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.150647 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.150762 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.150876 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.150989 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.151102 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.151223 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.151338 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.151451 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.151564 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.151677 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.151798 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.151914 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.152033 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.152148 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.152261 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.152373 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.152499 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.152616 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.152730 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.152843 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.152956 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.153069 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.153190 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.153306 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] token.caching = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.153419 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.153531 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.153644 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.153756 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.153879 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.153994 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.154108 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] token.caching = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.154221 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.154334 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.154446 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.154606 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.154722 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.154835 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.154948 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.155062 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.155174 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.155296 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.155412 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.155525 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.155638 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.155751 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.155864 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.155986 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.156101 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.156215 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.156327 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.156441 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.156554 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.156675 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.156790 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.156904 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.157017 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.157130 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.157243 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.157365 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.157480 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] database.connection = **** {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.157603 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.157727 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.157842 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.157955 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.158068 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.158181 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.158305 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.connection = **** {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.158429 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.158574 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.158691 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.158806 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.158927 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.159043 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.159166 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.159283 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.159397 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.159512 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.159629 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.159745 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.159868 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.159984 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.160099 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.160213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.160328 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.160442 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.160564 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.160564 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.160780 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.160894 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.161009 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.161123 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.161245 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.161363 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.161478 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.161592 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.161707 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.161822 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80331) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 03:29:24.161946 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.161946 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.161946 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.161946 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 03:29:24.161946 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80332) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 03:29:24.191028 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.191257 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.191484 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.191713 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.191949 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.192175 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.199844 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.200505 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.228502 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.228725 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.229220 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.229455 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.370517 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.370758 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.419786 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.420020 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.420235 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.420470 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.484510 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.484733 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.484825 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.484958 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.485044 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.485179 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.485262 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.485394 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.485476 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.485609 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.485692 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.485824 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.510961 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.511190 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.511292 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.511416 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.511501 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.511640 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.511725 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.511861 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.511946 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.512080 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.512163 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.512297 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.512379 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.512515 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.523690 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.523917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.536867 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.537103 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.537324 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.537410 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.537544 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.537628 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.537762 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.537856 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.537979 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.538064 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.538193 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80332) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.538275 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.538431 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.538671 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80331) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 03:29:24.555247 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.555486 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 03:29:24.555598 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.555807 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 03:29:24.555903 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.556011 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 03:29:24.556141 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.556278 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.556361 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 03:29:24.556539 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.556622 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.556794 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.556876 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.557050 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.557134 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.557319 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.568064 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.568332 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.568415 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.568602 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.568683 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.568865 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.568949 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.569143 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.577475 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 03:29:24.577722 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 03:29:24.580765 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 03:29:24.580982 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 03:29:24.581114 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.581259 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.581427 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.581654 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.581739 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.581934 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.582017 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.582213 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.582305 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.582542 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.582629 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.582755 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.582837 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.583025 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.583119 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.583292 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.583374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.583558 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.583638 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.583817 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.610320 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.610577 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.611967 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 03:29:24.612191 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 03:29:24.612302 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.612470 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.617452 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 03:29:24.617662 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 03:29:24.617748 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.617974 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.618074 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.618255 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.625290 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 03:29:24.625465 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 03:29:24.625552 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.625748 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.630089 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 03:29:24.630311 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 03:29:24.630397 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.630619 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.630718 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.630901 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.630974 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.631181 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.631253 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.631460 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.631540 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.631727 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.631797 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.631990 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.632059 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.632253 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.653905 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.654183 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.654551 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.654839 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.658819 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 03:29:24.659457 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 03:29:24.662420 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.662737 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.663115 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.663411 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.667715 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 03:29:24.668433 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 03:29:24.671324 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 03:29:24.672406 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 03:29:24.675076 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.675373 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.675663 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.675850 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.675957 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.676149 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.676235 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.676442 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.676524 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.676736 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.677014 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.677293 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.695276 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 03:29:24.695651 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.695920 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.696613 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 03:29:24.696740 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.696994 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.697268 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.697536 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.704768 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.705420 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.706443 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.706736 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.707137 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.707413 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.709837 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 03:29:24.712351 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.712351 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.713030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 03:29:24.713114 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.713209 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.713288 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.713363 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.713363 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.713363 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.724719 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 03:29:24.725000 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.725279 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.725568 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.725695 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 03:29:24.725845 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.725977 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.726129 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.726257 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.726407 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.726573 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.726854 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.727153 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.727460 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.745818 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 03:29:24.746643 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 03:29:24.749054 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 03:29:24.749890 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 03:29:24.752345 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.753192 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.753924 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.754834 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.755564 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 03:29:24.755846 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.756132 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.756468 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 03:29:24.756748 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.757031 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.764023 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.764933 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.765622 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 03:29:24.766569 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 03:29:24.768832 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.769118 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.769398 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.769681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.769763 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.770042 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.770327 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.770641 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.779736 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 03:29:24.780023 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.780301 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.780630 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 03:29:24.780921 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.781202 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.788126 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80331) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 03:29:24.788405 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.788681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.788950 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.789032 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80332) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 03:29:24.789218 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.789302 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.789484 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.789569 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.789770 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.789855 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.790043 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.790141 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.790314 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.790398 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.790599 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.790736 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.790872 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.790956 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.791129 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.791211 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.791385 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.791469 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.791644 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80331) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.791727 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.791939 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.792203 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.792468 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80332) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 03:29:24.829566 dv-cinder-850318-2-smb devstack@keystone.service[80331]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556aa7f299c0 pid: 80331 (default app) Jul 21 03:29:24.830438 dv-cinder-850318-2-smb devstack@keystone.service[80332]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556aa7f299c0 pid: 80332 (default app) Jul 21 03:29:24.832828 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72745f36-dd63-4176-9e0d-d3bbad31caf0 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:24.833121 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72745f36-dd63-4176-9e0d-d3bbad31caf0 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:24.833407 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72745f36-dd63-4176-9e0d-d3bbad31caf0 None None] PATH_INFO: `/v3` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:24.838407 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 791 bytes} [Thu Jul 21 03:29:24 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:29:32.420879 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88cc4c-40ed-44fe-a4f8-994e090498f7 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:32.421436 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88cc4c-40ed-44fe-a4f8-994e090498f7 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:32.421436 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88cc4c-40ed-44fe-a4f8-994e090498f7 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:32.425704 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:29:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:29:32.430773 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27adeef5-a022-4ca5-b386-098681d91b1e None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:32.431194 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27adeef5-a022-4ca5-b386-098681d91b1e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:32.431336 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27adeef5-a022-4ca5-b386-098681d91b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:32.499306 dv-cinder-850318-2-smb devstack@keystone.service[80331]: INFO dbcounter [None req-27adeef5-a022-4ca5-b386-098681d91b1e None None] Registered counter for database keystone Jul 21 03:29:32.520029 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG oslo_db.sqlalchemy.engines [None req-27adeef5-a022-4ca5-b386-098681d91b1e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80331) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 03:29:32.526967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writer thread running {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 03:29:32.701681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG passlib.handlers.bcrypt [None req-27adeef5-a022-4ca5-b386-098681d91b1e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80331) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 21 03:29:32.702027 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG passlib.handlers.bcrypt [None req-27adeef5-a022-4ca5-b386-098681d91b1e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80331) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 21 03:29:32.756361 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-27adeef5-a022-4ca5-b386-098681d91b1e None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:29:32.757978 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-27adeef5-a022-4ca5-b386-098681d91b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:29:32.879519 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:29:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 450 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 21 03:29:33.087331 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88cc4c-40ed-44fe-a4f8-994e090498f7 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:33.156645 dv-cinder-850318-2-smb devstack@keystone.service[80332]: INFO dbcounter [None req-fd88cc4c-40ed-44fe-a4f8-994e090498f7 None None] Registered counter for database keystone Jul 21 03:29:33.175810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG oslo_db.sqlalchemy.engines [None req-fd88cc4c-40ed-44fe-a4f8-994e090498f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80332) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 03:29:33.181919 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writer thread running {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 03:29:33.298099 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88cc4c-40ed-44fe-a4f8-994e090498f7 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:33.302388 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96ee9a9-240e-4807-8202-89b8840eeca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:33.303086 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ee9a9-240e-4807-8202-89b8840eeca6 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:33.303378 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ee9a9-240e-4807-8202-89b8840eeca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:33.303658 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ee9a9-240e-4807-8202-89b8840eeca6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:33.311782 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ee9a9-240e-4807-8202-89b8840eeca6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:33.364171 dv-cinder-850318-2-smb devstack@keystone.service[80332]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d96ee9a9-240e-4807-8202-89b8840eeca6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 21 03:29:33.364471 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96ee9a9-240e-4807-8202-89b8840eeca6 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:33.373964 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1324 bytes} [Thu Jul 21 03:29:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 03:29:33.379926 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27adeef5-a022-4ca5-b386-098681d91b1e None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:33.394074 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27adeef5-a022-4ca5-b386-098681d91b1e None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:33.398669 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b10afe-a17d-414d-a8d5-0b02ad1780ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:33.400277 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b10afe-a17d-414d-a8d5-0b02ad1780ff admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:33.400566 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b10afe-a17d-414d-a8d5-0b02ad1780ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:33.400846 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b10afe-a17d-414d-a8d5-0b02ad1780ff admin admin] PATH_INFO: `/v3/projects/c64654fdd0e44100a98ee66278a10b0e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:33.404939 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b10afe-a17d-414d-a8d5-0b02ad1780ff admin admin] RBAC: Authorizing `identity:get_project(project_id=c64654fdd0e44100a98ee66278a10b0e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:33.456885 dv-cinder-850318-2-smb devstack@keystone.service[80331]: WARNING keystone.common.rbac_enforcer.enforcer [None req-01b10afe-a17d-414d-a8d5-0b02ad1780ff admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 21 03:29:33.457423 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b10afe-a17d-414d-a8d5-0b02ad1780ff admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:33.462341 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 3/5] 10.222.0.20 () {56 vars in 1207 bytes} [Thu Jul 21 03:29:33 2022] GET /identity/v3/projects/c64654fdd0e44100a98ee66278a10b0e => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:29:35.434404 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433f6dd-6ffd-4a49-80e2-1c2f19124ead None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:35.434979 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433f6dd-6ffd-4a49-80e2-1c2f19124ead None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:35.434979 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433f6dd-6ffd-4a49-80e2-1c2f19124ead None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:35.439071 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 3/6] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:29:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:29:35.444266 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43717bd7-f733-4515-861c-1eff28168c6e None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:35.444687 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43717bd7-f733-4515-861c-1eff28168c6e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:35.444839 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43717bd7-f733-4515-861c-1eff28168c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:35.463754 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-43717bd7-f733-4515-861c-1eff28168c6e None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:29:35.465259 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-43717bd7-f733-4515-861c-1eff28168c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:29:35.473051 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:29:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 21 03:29:35.495218 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9433f6dd-6ffd-4a49-80e2-1c2f19124ead None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:35.506954 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9433f6dd-6ffd-4a49-80e2-1c2f19124ead None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:35.511070 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24754d22-4328-492c-89a1-1978befcd71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:35.511687 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24754d22-4328-492c-89a1-1978befcd71c admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:35.511971 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24754d22-4328-492c-89a1-1978befcd71c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:35.512246 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24754d22-4328-492c-89a1-1978befcd71c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:35.519740 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24754d22-4328-492c-89a1-1978befcd71c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:35.521776 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24754d22-4328-492c-89a1-1978befcd71c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:35.530940 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1324 bytes} [Thu Jul 21 03:29:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 03:29:35.535912 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43717bd7-f733-4515-861c-1eff28168c6e None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:35.545232 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43717bd7-f733-4515-861c-1eff28168c6e None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:35.549527 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a6509-d858-4e1d-8906-df703d4ca7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:35.550404 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a6509-d858-4e1d-8906-df703d4ca7e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:35.550721 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a6509-d858-4e1d-8906-df703d4ca7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:35.551000 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a6509-d858-4e1d-8906-df703d4ca7e3 admin admin] PATH_INFO: `/v3/users/eec6b06f7801471e932e859de1190593` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:35.552376 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a6509-d858-4e1d-8906-df703d4ca7e3 admin admin] RBAC: Authorizing `identity:get_user(user_id=eec6b06f7801471e932e859de1190593)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:35.554205 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a6509-d858-4e1d-8906-df703d4ca7e3 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:35.555792 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 5/9] 10.222.0.20 () {56 vars in 1198 bytes} [Thu Jul 21 03:29:35 2022] GET /identity/v3/users/eec6b06f7801471e932e859de1190593 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:29:37.605229 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07f78e-5c46-4a0a-851c-200b534faf71 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:37.605766 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07f78e-5c46-4a0a-851c-200b534faf71 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:37.605766 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07f78e-5c46-4a0a-851c-200b534faf71 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:37.607191 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:29:37.612355 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438b7c4-35e0-4f37-a0d7-bfa4137131f2 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:37.612756 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438b7c4-35e0-4f37-a0d7-bfa4137131f2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:37.612918 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438b7c4-35e0-4f37-a0d7-bfa4137131f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:37.626062 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675e4fa-fe97-443c-975a-5140fc1f6f98 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:37.626360 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675e4fa-fe97-443c-975a-5140fc1f6f98 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:37.626683 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675e4fa-fe97-443c-975a-5140fc1f6f98 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:37.627997 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 6/11] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 03:29:37.629381 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-3438b7c4-35e0-4f37-a0d7-bfa4137131f2 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:29:37.630582 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3438b7c4-35e0-4f37-a0d7-bfa4137131f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:29:37.633016 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f161b7a-e247-4447-9069-44403a8fe567 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:37.633313 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f161b7a-e247-4447-9069-44403a8fe567 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:37.633599 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f161b7a-e247-4447-9069-44403a8fe567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:37.673691 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG passlib.handlers.bcrypt [None req-0f161b7a-e247-4447-9069-44403a8fe567 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80332) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 21 03:29:37.674112 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG passlib.handlers.bcrypt [None req-0f161b7a-e247-4447-9069-44403a8fe567 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80332) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 21 03:29:37.715937 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 6/12] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:29:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 03:29:37.720005 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-0f161b7a-e247-4447-9069-44403a8fe567 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:29:37.721612 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0f161b7a-e247-4447-9069-44403a8fe567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:29:37.738690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438b7c4-35e0-4f37-a0d7-bfa4137131f2 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:37.761489 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:37.821070 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 7/13] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:29:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 03:29:37.839552 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438b7c4-35e0-4f37-a0d7-bfa4137131f2 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:37.843080 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f161b7a-e247-4447-9069-44403a8fe567 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:37.873235 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86b019-17b7-4a79-b524-783f435e9081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:37.873971 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86b019-17b7-4a79-b524-783f435e9081 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:37.874257 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86b019-17b7-4a79-b524-783f435e9081 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:37.874579 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d86b019-17b7-4a79-b524-783f435e9081 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:37.885491 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d86b019-17b7-4a79-b524-783f435e9081 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:29:37.896858 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-5d86b019-17b7-4a79-b524-783f435e9081 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:29:37.896858 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:29:37.896858 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:29:37.896858 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:29:37.896858 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:29:37.896858 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:29:37.896858 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:29:37.896858 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:29:37.896858 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:29:37.896858 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:29:37.896858 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:29:37.896858 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:29:37.896858 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:29:37.896858 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:29:37.896858 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:29:37.896858 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:29:37.897797 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:29:37.897797 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:29:37.897797 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:29:37.897797 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:29:37.897797 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:29:37.897797 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:29:37.897797 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:29:37.897797 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:29:37.897797 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:29:37.897797 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:29:37.897797 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:29:37.897797 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:29:37.897797 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:29:37.897797 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:29:37.897797 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:29:37.897797 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:29:37.898646 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:29:37.898646 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:29:37.898646 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:29:37.898646 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:29:37.898646 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:29:37.898646 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:29:37.898646 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:29:37.898646 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:29:37.898646 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:29:37.898646 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:29:37.898646 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:29:37.898646 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:29:37.898646 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 7/14] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 03:29:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:29:37.904239 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86b019-17b7-4a79-b524-783f435e9081 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:37.944508 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f161b7a-e247-4447-9069-44403a8fe567 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:37.947245 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:37.982871 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ad581-ba66-4029-8b26-711a207c3f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:37.983427 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:37.983769 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ad581-ba66-4029-8b26-711a207c3f21 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:37.984067 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ad581-ba66-4029-8b26-711a207c3f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:37.984382 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ad581-ba66-4029-8b26-711a207c3f21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:38.003635 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d86b019-17b7-4a79-b524-783f435e9081 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:38.038127 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6a51f-2748-458d-8078-925981d55afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:38.038811 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6a51f-2748-458d-8078-925981d55afb None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:38.039095 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6a51f-2748-458d-8078-925981d55afb None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:38.039370 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6a51f-2748-458d-8078-925981d55afb None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:38.040144 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be6a51f-2748-458d-8078-925981d55afb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:29:38.040453 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be6a51f-2748-458d-8078-925981d55afb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:38.041870 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be6a51f-2748-458d-8078-925981d55afb None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:38.050755 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ad581-ba66-4029-8b26-711a207c3f21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:38.052262 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ad581-ba66-4029-8b26-711a207c3f21 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:38.053275 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 8/15] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:29:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:29:38.058964 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6a51f-2748-458d-8078-925981d55afb None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:38.152146 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 8/16] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:29:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 03:29:38.156504 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6a51f-2748-458d-8078-925981d55afb None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:38.157832 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ad581-ba66-4029-8b26-711a207c3f21 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:38.161203 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:38.190871 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d06be6-7fbe-40e2-9c13-7331b9b6a160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:38.191747 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d06be6-7fbe-40e2-9c13-7331b9b6a160 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:38.192030 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d06be6-7fbe-40e2-9c13-7331b9b6a160 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:38.192305 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d06be6-7fbe-40e2-9c13-7331b9b6a160 None admin] PATH_INFO: `/v3/users/eec6b06f7801471e932e859de1190593` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:38.193511 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d06be6-7fbe-40e2-9c13-7331b9b6a160 None admin] RBAC: Authorizing `identity:get_user(user_id=eec6b06f7801471e932e859de1190593)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:38.195027 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d06be6-7fbe-40e2-9c13-7331b9b6a160 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:38.197185 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 9/17] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:29:38 2022] GET /identity/v3/users/eec6b06f7801471e932e859de1190593 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:29:38.202291 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d06be6-7fbe-40e2-9c13-7331b9b6a160 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:38.216688 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:38.257991 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ad581-ba66-4029-8b26-711a207c3f21 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:38.291667 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2356561f-a16d-4230-af8f-5fe198d377d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:38.292464 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356561f-a16d-4230-af8f-5fe198d377d2 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:38.292759 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356561f-a16d-4230-af8f-5fe198d377d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:38.293036 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356561f-a16d-4230-af8f-5fe198d377d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:38.300881 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d06be6-7fbe-40e2-9c13-7331b9b6a160 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:38.312169 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2356561f-a16d-4230-af8f-5fe198d377d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:38.313643 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2356561f-a16d-4230-af8f-5fe198d377d2 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:38.333675 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b38341a-4391-4552-a34e-0c499117586d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:38.334180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-2356561f-a16d-4230-af8f-5fe198d377d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:29:38.334180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:29:38.334180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:29:38.334180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:29:38.334180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:29:38.334180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:29:38.334180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:29:38.334180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:29:38.334180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:29:38.334180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:29:38.334180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:29:38.334180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:29:38.334180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:29:38.334180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:29:38.334180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:29:38.335124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:29:38.335124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:29:38.335124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:29:38.335124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:29:38.335124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:29:38.335124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:29:38.335124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:29:38.335124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:29:38.335124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:29:38.335124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:29:38.335124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:29:38.335124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:29:38.335124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:29:38.335124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:29:38.335124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:29:38.335124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:29:38.335124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:29:38.335974 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:29:38.335974 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:29:38.335974 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:29:38.335974 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:29:38.336187 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38341a-4391-4552-a34e-0c499117586d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:38.336187 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38341a-4391-4552-a34e-0c499117586d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:38.336187 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38341a-4391-4552-a34e-0c499117586d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:38.336357 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 9/18] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:29:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:29:38.336482 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b38341a-4391-4552-a34e-0c499117586d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:38.338395 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b38341a-4391-4552-a34e-0c499117586d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:38.340021 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 10/19] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:29:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:29:38.341573 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2356561f-a16d-4230-af8f-5fe198d377d2 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:38.345445 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b38341a-4391-4552-a34e-0c499117586d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:38.395886 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:38.423055 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:38.439285 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2356561f-a16d-4230-af8f-5fe198d377d2 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:38.443982 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b38341a-4391-4552-a34e-0c499117586d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:38.472206 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563dcfe-b3ce-43e2-a749-222d37db02c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:38.472870 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563dcfe-b3ce-43e2-a749-222d37db02c7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:38.473159 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563dcfe-b3ce-43e2-a749-222d37db02c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:38.473442 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563dcfe-b3ce-43e2-a749-222d37db02c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:38.474175 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7563dcfe-b3ce-43e2-a749-222d37db02c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:29:38.474516 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7563dcfe-b3ce-43e2-a749-222d37db02c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:38.475912 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7563dcfe-b3ce-43e2-a749-222d37db02c7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:38.477462 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb017233-aa36-47fb-9c22-398cf0fda04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:38.478112 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb017233-aa36-47fb-9c22-398cf0fda04b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:38.478395 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb017233-aa36-47fb-9c22-398cf0fda04b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:38.478704 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb017233-aa36-47fb-9c22-398cf0fda04b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:38.479532 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb017233-aa36-47fb-9c22-398cf0fda04b None admin] RBAC: Adding query filter params (role.id=27e53d6c56f24c25a8c8057bfd36bcf1, scope.domain.id=default, user.id=eec6b06f7801471e932e859de1190593) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:29:38.479847 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb017233-aa36-47fb-9c22-398cf0fda04b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:38.481253 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb017233-aa36-47fb-9c22-398cf0fda04b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:38.487839 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 11/20] 10.222.0.20 () {56 vars in 1322 bytes} [Thu Jul 21 03:29:38 2022] GET /identity/v3/role_assignments?user.id=eec6b06f7801471e932e859de1190593&scope.domain.id=default&role.id=27e53d6c56f24c25a8c8057bfd36bcf1 => generated 233 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:29:38.493828 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 10/21] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:29:40.651816 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fe1c4-2b8a-4717-89e1-a0593f6dceae None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:40.652832 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fe1c4-2b8a-4717-89e1-a0593f6dceae None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:40.653332 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fe1c4-2b8a-4717-89e1-a0593f6dceae None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:40.655013 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 12/22] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:29:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:29:40.660412 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6540d2-85b9-4db9-a548-03fbb3b8e8ab None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:40.661226 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6540d2-85b9-4db9-a548-03fbb3b8e8ab None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:40.661697 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6540d2-85b9-4db9-a548-03fbb3b8e8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:40.687510 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-4d6540d2-85b9-4db9-a548-03fbb3b8e8ab None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:29:40.689073 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4d6540d2-85b9-4db9-a548-03fbb3b8e8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:29:40.789043 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 11/23] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:29:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:29:40.827952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232fe1c4-2b8a-4717-89e1-a0593f6dceae None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:40.949753 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232fe1c4-2b8a-4717-89e1-a0593f6dceae None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:40.993683 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f1a20-85e3-4217-86c8-da5e4f41505a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:40.994571 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f1a20-85e3-4217-86c8-da5e4f41505a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:40.994861 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f1a20-85e3-4217-86c8-da5e4f41505a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:40.995139 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f1a20-85e3-4217-86c8-da5e4f41505a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:41.011317 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f1a20-85e3-4217-86c8-da5e4f41505a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:29:41.019035 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-103f1a20-85e3-4217-86c8-da5e4f41505a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:29:41.019035 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:29:41.019035 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:29:41.019035 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:29:41.019035 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:29:41.019035 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:29:41.019035 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:29:41.019035 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:29:41.019035 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:29:41.019035 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:29:41.019035 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:29:41.019035 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:29:41.019035 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:29:41.019035 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:29:41.019035 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:29:41.019035 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:29:41.019878 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:29:41.019878 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:29:41.019878 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:29:41.019878 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:29:41.019878 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:29:41.019878 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:29:41.019878 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:29:41.019878 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:29:41.019878 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:29:41.019878 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:29:41.019878 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:29:41.019878 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:29:41.019878 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:29:41.019878 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:29:41.019878 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:29:41.019878 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:29:41.020641 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:29:41.020641 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:29:41.020641 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:29:41.020641 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:29:41.020641 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:29:41.020641 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:29:41.020641 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:29:41.020641 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:29:41.020641 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:29:41.020641 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:29:41.020641 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:29:41.020641 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:29:41.020641 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 13/24] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 03:29:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:29:41.026670 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6540d2-85b9-4db9-a548-03fbb3b8e8ab None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:41.082028 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:41.152114 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6540d2-85b9-4db9-a548-03fbb3b8e8ab None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:41.200414 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29cd30f-3501-4265-a683-eef40b4e8ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:41.201016 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cd30f-3501-4265-a683-eef40b4e8ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:41.201302 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cd30f-3501-4265-a683-eef40b4e8ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:41.201578 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cd30f-3501-4265-a683-eef40b4e8ed9 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:41.202335 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29cd30f-3501-4265-a683-eef40b4e8ed9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:29:41.202666 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29cd30f-3501-4265-a683-eef40b4e8ed9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:41.204061 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29cd30f-3501-4265-a683-eef40b4e8ed9 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:41.220680 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 12/25] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:29:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:29:41.226406 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f1a20-85e3-4217-86c8-da5e4f41505a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:41.232408 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:41.325671 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcfdc9-a79f-4799-b2fb-bcce133190e5 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:41.326046 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcfdc9-a79f-4799-b2fb-bcce133190e5 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:41.326282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcfdc9-a79f-4799-b2fb-bcce133190e5 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:41.327610 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 13/26] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 03:29:41.332686 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a534f5e-3ccc-4940-b095-93f5ca732e08 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:41.333183 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a534f5e-3ccc-4940-b095-93f5ca732e08 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:41.333669 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a534f5e-3ccc-4940-b095-93f5ca732e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:41.359371 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f1a20-85e3-4217-86c8-da5e4f41505a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:41.379458 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-6a534f5e-3ccc-4940-b095-93f5ca732e08 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:29:41.380959 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6a534f5e-3ccc-4940-b095-93f5ca732e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:29:41.400600 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8aaf2-1fe4-4273-973c-70bbf60bffc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:41.401699 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8aaf2-1fe4-4273-973c-70bbf60bffc7 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:41.401997 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8aaf2-1fe4-4273-973c-70bbf60bffc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:41.402328 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8aaf2-1fe4-4273-973c-70bbf60bffc7 None admin] PATH_INFO: `/v3/users/eec6b06f7801471e932e859de1190593` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:41.403689 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a8aaf2-1fe4-4273-973c-70bbf60bffc7 None admin] RBAC: Authorizing `identity:get_user(user_id=eec6b06f7801471e932e859de1190593)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:41.405235 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a8aaf2-1fe4-4273-973c-70bbf60bffc7 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:41.406989 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 14/27] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:29:41 2022] GET /identity/v3/users/eec6b06f7801471e932e859de1190593 => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:29:41.413063 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8aaf2-1fe4-4273-973c-70bbf60bffc7 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:41.497052 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:41.531269 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8aaf2-1fe4-4273-973c-70bbf60bffc7 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:41.552768 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 14/28] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:29:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 03:29:41.554392 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628695f-974d-49f0-a7c8-163d102ee337 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:41.554917 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628695f-974d-49f0-a7c8-163d102ee337 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:41.555427 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1628695f-974d-49f0-a7c8-163d102ee337 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:41.556888 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 15/29] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:29:41.562335 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487eff72-4eb0-4fd1-a8f1-715fceb878db None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:41.562880 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487eff72-4eb0-4fd1-a8f1-715fceb878db None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:41.563361 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487eff72-4eb0-4fd1-a8f1-715fceb878db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:41.570647 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8142570-2eaf-4565-b541-b92b87d1166a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:41.571493 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8142570-2eaf-4565-b541-b92b87d1166a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:41.571782 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8142570-2eaf-4565-b541-b92b87d1166a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:41.572060 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8142570-2eaf-4565-b541-b92b87d1166a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:41.574841 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8142570-2eaf-4565-b541-b92b87d1166a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:41.576331 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8142570-2eaf-4565-b541-b92b87d1166a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:41.579033 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 15/30] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:29:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:29:41.591459 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8142570-2eaf-4565-b541-b92b87d1166a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:41.603524 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-487eff72-4eb0-4fd1-a8f1-715fceb878db None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:29:41.607223 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-487eff72-4eb0-4fd1-a8f1-715fceb878db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:29:41.658515 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:41.712149 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 16/31] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:29:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 03:29:41.713216 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487eff72-4eb0-4fd1-a8f1-715fceb878db None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:41.768816 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8142570-2eaf-4565-b541-b92b87d1166a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:41.805779 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc58f42-1c56-4ff0-a790-1209bab6a723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:41.806697 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc58f42-1c56-4ff0-a790-1209bab6a723 None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:41.807026 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc58f42-1c56-4ff0-a790-1209bab6a723 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:41.807315 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc58f42-1c56-4ff0-a790-1209bab6a723 None admin] PATH_INFO: `/v3/domains/default/users/eec6b06f7801471e932e859de1190593/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:41.809431 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc58f42-1c56-4ff0-a790-1209bab6a723 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=eec6b06f7801471e932e859de1190593, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:41.811049 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc58f42-1c56-4ff0-a790-1209bab6a723 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:41.824933 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:41.846881 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487eff72-4eb0-4fd1-a8f1-715fceb878db None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:41.881465 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffaafd9-4083-4842-b67f-04a1da0808e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:41.882136 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffaafd9-4083-4842-b67f-04a1da0808e8 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:41.882425 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffaafd9-4083-4842-b67f-04a1da0808e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:41.882737 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffaafd9-4083-4842-b67f-04a1da0808e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:41.883998 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffaafd9-4083-4842-b67f-04a1da0808e8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:41.885371 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffaafd9-4083-4842-b67f-04a1da0808e8 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:41.949331 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 16/32] 10.222.0.20 () {58 vars in 1361 bytes} [Thu Jul 21 03:29:41 2022] PUT /identity/v3/domains/default/users/eec6b06f7801471e932e859de1190593/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:29:41.951524 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a51d3-1ef6-40a5-abf0-3381a77777b2 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:41.951827 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a51d3-1ef6-40a5-abf0-3381a77777b2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:41.952116 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a51d3-1ef6-40a5-abf0-3381a77777b2 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:41.961159 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 17/33] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:29:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:29:41.962719 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a51d3-1ef6-40a5-abf0-3381a77777b2 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:42.039353 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 17/34] 10.222.0.20 () {60 vars in 1131 bytes} [Thu Jul 21 03:29:41 2022] POST /identity/v3/roles => generated 219 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:29:42.040917 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6cc45-851a-44c5-a4f8-c8cdfc8ba643 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:42.041219 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6cc45-851a-44c5-a4f8-c8cdfc8ba643 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:42.041509 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6cc45-851a-44c5-a4f8-c8cdfc8ba643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:42.061062 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-00b6cc45-851a-44c5-a4f8-c8cdfc8ba643 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:29:42.062929 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-00b6cc45-851a-44c5-a4f8-c8cdfc8ba643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:29:42.093426 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:42.154343 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a51d3-1ef6-40a5-abf0-3381a77777b2 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:42.198365 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d1195-8c64-4a1c-a3e0-f3dad0c9dc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:42.199426 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d1195-8c64-4a1c-a3e0-f3dad0c9dc00 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:42.199426 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d1195-8c64-4a1c-a3e0-f3dad0c9dc00 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:42.199669 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6d1195-8c64-4a1c-a3e0-f3dad0c9dc00 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:42.200421 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d1195-8c64-4a1c-a3e0-f3dad0c9dc00 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:42.201376 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 18/35] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:29:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:29:42.202099 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6d1195-8c64-4a1c-a3e0-f3dad0c9dc00 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:42.203149 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18700b93-104f-4f39-8fd0-4cc192e009be None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:42.203637 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18700b93-104f-4f39-8fd0-4cc192e009be None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:42.204104 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18700b93-104f-4f39-8fd0-4cc192e009be None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:42.205614 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 19/36] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:29:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:29:42.211318 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ee957-fc96-4b20-ba6e-c54c40582e2b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:42.211939 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ee957-fc96-4b20-ba6e-c54c40582e2b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:42.212411 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ee957-fc96-4b20-ba6e-c54c40582e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:42.224441 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 18/37] 10.222.0.20 () {60 vars in 1131 bytes} [Thu Jul 21 03:29:41 2022] POST /identity/v3/roles => generated 225 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:29:42.237380 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-6c0ee957-fc96-4b20-ba6e-c54c40582e2b None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:29:42.238772 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6c0ee957-fc96-4b20-ba6e-c54c40582e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:29:42.246761 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d1195-8c64-4a1c-a3e0-f3dad0c9dc00 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:42.375729 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:42.393660 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 20/38] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:29:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 03:29:42.422120 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ee957-fc96-4b20-ba6e-c54c40582e2b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:42.436242 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6d1195-8c64-4a1c-a3e0-f3dad0c9dc00 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:42.480814 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d21badf-723c-4ba2-a103-ca71ae1d77e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:42.481643 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21badf-723c-4ba2-a103-ca71ae1d77e5 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:42.481928 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21badf-723c-4ba2-a103-ca71ae1d77e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:42.482204 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d21badf-723c-4ba2-a103-ca71ae1d77e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:42.495585 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d21badf-723c-4ba2-a103-ca71ae1d77e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:42.497328 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d21badf-723c-4ba2-a103-ca71ae1d77e5 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:42.519996 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-9d21badf-723c-4ba2-a103-ca71ae1d77e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:29:42.519996 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:29:42.519996 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:29:42.519996 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:29:42.519996 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:29:42.519996 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:29:42.519996 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:29:42.519996 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:29:42.519996 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:29:42.519996 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:29:42.519996 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:29:42.519996 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:29:42.519996 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:29:42.519996 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:29:42.519996 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:29:42.520877 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:29:42.520877 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:29:42.520877 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:29:42.520877 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:29:42.520877 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:29:42.520877 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:29:42.520877 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:29:42.520877 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:29:42.520877 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:29:42.520877 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:29:42.520877 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:29:42.520877 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:29:42.520877 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:29:42.520877 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:29:42.520877 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:29:42.520877 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:29:42.520877 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:29:42.522510 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:29:42.522510 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:29:42.522510 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:29:42.522510 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:29:42.522510 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 19/39] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:29:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:29:42.528304 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d21badf-723c-4ba2-a103-ca71ae1d77e5 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:42.533118 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:42.549654 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ee957-fc96-4b20-ba6e-c54c40582e2b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:42.589076 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52afa043-e9f4-4435-a804-a75a6df003cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:42.590268 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52afa043-e9f4-4435-a804-a75a6df003cf None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:42.590803 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52afa043-e9f4-4435-a804-a75a6df003cf None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:42.591297 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52afa043-e9f4-4435-a804-a75a6df003cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:42.593037 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52afa043-e9f4-4435-a804-a75a6df003cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:42.594877 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52afa043-e9f4-4435-a804-a75a6df003cf None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:42.601620 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 21/40] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:29:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:29:42.603708 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52afa043-e9f4-4435-a804-a75a6df003cf None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:42.657640 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d21badf-723c-4ba2-a103-ca71ae1d77e5 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:42.694844 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:42.705623 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b0e5e-fe84-4a8d-aa65-5c5b7af0336c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:42.706687 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b0e5e-fe84-4a8d-aa65-5c5b7af0336c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:42.706795 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b0e5e-fe84-4a8d-aa65-5c5b7af0336c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:42.707027 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b0e5e-fe84-4a8d-aa65-5c5b7af0336c None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:42.709257 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b0e5e-fe84-4a8d-aa65-5c5b7af0336c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:29:42.709654 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b0e5e-fe84-4a8d-aa65-5c5b7af0336c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:42.711081 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b0e5e-fe84-4a8d-aa65-5c5b7af0336c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:42.733906 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 20/41] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:29:42.735591 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631712a-945d-45b9-9d59-f6d01be2e1e6 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:42.736092 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631712a-945d-45b9-9d59-f6d01be2e1e6 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:42.736602 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631712a-945d-45b9-9d59-f6d01be2e1e6 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:42.738046 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 21/42] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:29:42.739580 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4631712a-945d-45b9-9d59-f6d01be2e1e6 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:42.744935 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52afa043-e9f4-4435-a804-a75a6df003cf None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:42.781802 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323b6d9-b6e7-4c7c-9412-2a5a897ed640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:42.782527 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323b6d9-b6e7-4c7c-9412-2a5a897ed640 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:42.782821 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323b6d9-b6e7-4c7c-9412-2a5a897ed640 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:42.783105 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323b6d9-b6e7-4c7c-9412-2a5a897ed640 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:42.783912 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323b6d9-b6e7-4c7c-9412-2a5a897ed640 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:42.785412 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323b6d9-b6e7-4c7c-9412-2a5a897ed640 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:42.817885 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 22/43] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jul 21 03:29:42 2022] POST /identity/v3/projects => generated 312 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:29:42.819629 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfedf0b0-ed97-4e12-9c0b-620efba9d4a5 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:42.820134 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfedf0b0-ed97-4e12-9c0b-620efba9d4a5 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:42.820653 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfedf0b0-ed97-4e12-9c0b-620efba9d4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:42.845949 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-dfedf0b0-ed97-4e12-9c0b-620efba9d4a5 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:29:42.847873 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-dfedf0b0-ed97-4e12-9c0b-620efba9d4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:29:42.861068 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:42.942218 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 23/44] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:29:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:29:42.965153 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfedf0b0-ed97-4e12-9c0b-620efba9d4a5 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:42.975942 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4631712a-945d-45b9-9d59-f6d01be2e1e6 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:43.014808 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e68b775-2411-474d-877f-bb744c6827e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:43.015850 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68b775-2411-474d-877f-bb744c6827e4 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:43.016297 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68b775-2411-474d-877f-bb744c6827e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:43.016726 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68b775-2411-474d-877f-bb744c6827e4 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:43.017588 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e68b775-2411-474d-877f-bb744c6827e4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:43.019229 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e68b775-2411-474d-877f-bb744c6827e4 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:43.049766 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 22/45] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jul 21 03:29:42 2022] POST /identity/v3/projects => generated 301 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:29:43.081941 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfedf0b0-ed97-4e12-9c0b-620efba9d4a5 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:43.129948 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831a8d9-946c-45af-810c-f82ee5fa8b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:43.130995 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831a8d9-946c-45af-810c-f82ee5fa8b0e None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:43.131538 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831a8d9-946c-45af-810c-f82ee5fa8b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:43.131965 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831a8d9-946c-45af-810c-f82ee5fa8b0e None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:43.132967 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f831a8d9-946c-45af-810c-f82ee5fa8b0e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:43.134638 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f831a8d9-946c-45af-810c-f82ee5fa8b0e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:43.145823 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:43.154735 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 24/46] 10.222.0.20 () {60 vars in 1131 bytes} [Thu Jul 21 03:29:42 2022] POST /identity/v3/roles => generated 223 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:29:44.239760 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4526c5-1aaf-4bda-8904-ccf9786b3b6e None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:44.240280 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4526c5-1aaf-4bda-8904-ccf9786b3b6e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:44.240387 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4526c5-1aaf-4bda-8904-ccf9786b3b6e None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:44.241733 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 23/47] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:29:44.247494 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6cc8c4-81d2-4e31-afe4-cf1b6f4eac65 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:44.247877 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6cc8c4-81d2-4e31-afe4-cf1b6f4eac65 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:44.248065 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6cc8c4-81d2-4e31-afe4-cf1b6f4eac65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:44.264357 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-2a6cc8c4-81d2-4e31-afe4-cf1b6f4eac65 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:29:44.265543 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2a6cc8c4-81d2-4e31-afe4-cf1b6f4eac65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:29:44.330333 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 25/48] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:29:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:29:44.354170 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4526c5-1aaf-4bda-8904-ccf9786b3b6e None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:44.379762 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:44.456803 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4526c5-1aaf-4bda-8904-ccf9786b3b6e None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:44.490476 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb9df8-5eef-40b7-bfaf-8538025d2d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:44.491215 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb9df8-5eef-40b7-bfaf-8538025d2d2e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:44.491505 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb9df8-5eef-40b7-bfaf-8538025d2d2e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:44.491784 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb9df8-5eef-40b7-bfaf-8538025d2d2e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:44.501701 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb9df8-5eef-40b7-bfaf-8538025d2d2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:29:44.509331 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-70eb9df8-5eef-40b7-bfaf-8538025d2d2e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:29:44.509331 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:29:44.509331 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:29:44.509331 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:29:44.509331 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:29:44.509331 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:29:44.509331 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:29:44.509331 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:29:44.509331 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:29:44.509331 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:29:44.509331 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:29:44.509331 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:29:44.509331 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:29:44.509331 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:29:44.509331 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:29:44.509331 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:29:44.510313 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:29:44.510313 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:29:44.510313 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:29:44.510313 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:29:44.510313 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:29:44.510313 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:29:44.510313 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:29:44.510313 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:29:44.510313 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:29:44.510313 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:29:44.510313 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:29:44.510313 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:29:44.510313 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:29:44.510313 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:29:44.510313 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:29:44.510313 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:29:44.511131 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:29:44.511131 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:29:44.511131 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:29:44.511131 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:29:44.511131 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:29:44.511131 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:29:44.511131 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:29:44.511131 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:29:44.511131 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:29:44.511131 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:29:44.511131 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:29:44.511131 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:29:44.511131 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 24/49] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 03:29:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:29:44.516490 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6cc8c4-81d2-4e31-afe4-cf1b6f4eac65 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:44.613171 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6cc8c4-81d2-4e31-afe4-cf1b6f4eac65 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:44.638759 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:44.647023 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40636dde-a578-4316-83c0-c7ff0efc366c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:44.647702 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40636dde-a578-4316-83c0-c7ff0efc366c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:44.647991 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40636dde-a578-4316-83c0-c7ff0efc366c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:44.648270 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40636dde-a578-4316-83c0-c7ff0efc366c None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:44.649509 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40636dde-a578-4316-83c0-c7ff0efc366c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:29:44.649817 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40636dde-a578-4316-83c0-c7ff0efc366c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:44.651265 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40636dde-a578-4316-83c0-c7ff0efc366c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:44.659468 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 26/50] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:29:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:29:44.665624 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb9df8-5eef-40b7-bfaf-8538025d2d2e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:44.752978 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:44.768875 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb9df8-5eef-40b7-bfaf-8538025d2d2e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:44.801630 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424efc98-ea8f-4433-9f08-819cf56103d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:44.802522 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424efc98-ea8f-4433-9f08-819cf56103d9 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:44.802811 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424efc98-ea8f-4433-9f08-819cf56103d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:44.803087 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424efc98-ea8f-4433-9f08-819cf56103d9 None admin] PATH_INFO: `/v3/users/eec6b06f7801471e932e859de1190593` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:44.804260 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424efc98-ea8f-4433-9f08-819cf56103d9 None admin] RBAC: Authorizing `identity:get_user(user_id=eec6b06f7801471e932e859de1190593)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:44.805752 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424efc98-ea8f-4433-9f08-819cf56103d9 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:44.807619 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 25/51] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:29:44 2022] GET /identity/v3/users/eec6b06f7801471e932e859de1190593 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:29:44.812790 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40636dde-a578-4316-83c0-c7ff0efc366c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:44.981343 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63afc185-c319-4aa5-abe4-b271596ebda8 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:44.981633 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63afc185-c319-4aa5-abe4-b271596ebda8 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:44.981911 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63afc185-c319-4aa5-abe4-b271596ebda8 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:44.983342 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 26/52] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 03:29:44.988503 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ef75a-1a17-4796-a4b6-8921b6d7f2e7 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:44.988800 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ef75a-1a17-4796-a4b6-8921b6d7f2e7 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:44.989085 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ef75a-1a17-4796-a4b6-8921b6d7f2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:45.005590 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-2c4ef75a-1a17-4796-a4b6-8921b6d7f2e7 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:29:45.007051 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2c4ef75a-1a17-4796-a4b6-8921b6d7f2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:29:45.017117 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40636dde-a578-4316-83c0-c7ff0efc366c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:45.050443 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d0b6c-561c-4c7a-b9fd-15387154fb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:45.051252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d0b6c-561c-4c7a-b9fd-15387154fb82 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:45.051541 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d0b6c-561c-4c7a-b9fd-15387154fb82 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:45.051821 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d0b6c-561c-4c7a-b9fd-15387154fb82 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:45.052997 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d0b6c-561c-4c7a-b9fd-15387154fb82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:45.054442 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d0b6c-561c-4c7a-b9fd-15387154fb82 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:45.056118 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 27/53] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:29:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:29:45.061879 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d0b6c-561c-4c7a-b9fd-15387154fb82 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:45.073277 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 27/54] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:29:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 03:29:45.096280 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ef75a-1a17-4796-a4b6-8921b6d7f2e7 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:45.119108 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:45.160197 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d0b6c-561c-4c7a-b9fd-15387154fb82 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:45.175849 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:45.193090 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522e731-83a5-4a65-a223-a91d14d78341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:45.193751 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522e731-83a5-4a65-a223-a91d14d78341 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:45.193945 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ef75a-1a17-4796-a4b6-8921b6d7f2e7 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:45.194035 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522e731-83a5-4a65-a223-a91d14d78341 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:45.194310 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522e731-83a5-4a65-a223-a91d14d78341 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:45.195186 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c522e731-83a5-4a65-a223-a91d14d78341 None admin] RBAC: Adding query filter params (role.id=27e53d6c56f24c25a8c8057bfd36bcf1, scope.domain.id=default, user.id=eec6b06f7801471e932e859de1190593) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:29:45.195506 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c522e731-83a5-4a65-a223-a91d14d78341 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:45.197567 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c522e731-83a5-4a65-a223-a91d14d78341 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:45.206547 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 28/55] 10.222.0.20 () {56 vars in 1322 bytes} [Thu Jul 21 03:29:45 2022] GET /identity/v3/role_assignments?user.id=eec6b06f7801471e932e859de1190593&scope.domain.id=default&role.id=27e53d6c56f24c25a8c8057bfd36bcf1 => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:29:45.228764 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20872af5-759d-44af-bd47-93d8d7722f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:45.229594 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20872af5-759d-44af-bd47-93d8d7722f86 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:45.229883 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20872af5-759d-44af-bd47-93d8d7722f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:45.230164 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20872af5-759d-44af-bd47-93d8d7722f86 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:45.231473 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20872af5-759d-44af-bd47-93d8d7722f86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:45.233009 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20872af5-759d-44af-bd47-93d8d7722f86 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:45.234796 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 28/56] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:29:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:29:45.240705 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522e731-83a5-4a65-a223-a91d14d78341 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:45.347656 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522e731-83a5-4a65-a223-a91d14d78341 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:45.373756 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:45.386064 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d8913-760f-4e8c-8078-1e144e338e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:45.386799 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d8913-760f-4e8c-8078-1e144e338e39 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:45.387092 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d8913-760f-4e8c-8078-1e144e338e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:45.387373 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d8913-760f-4e8c-8078-1e144e338e39 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:45.388096 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35d8913-760f-4e8c-8078-1e144e338e39 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:45.389547 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35d8913-760f-4e8c-8078-1e144e338e39 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:45.415583 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 29/57] 10.222.0.20 () {60 vars in 1140 bytes} [Thu Jul 21 03:29:45 2022] POST /identity/v3/projects => generated 298 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:29:47.448632 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e579ad-fdea-439d-8c6f-d058a75b404f None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:47.449147 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e579ad-fdea-439d-8c6f-d058a75b404f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:47.449228 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e579ad-fdea-439d-8c6f-d058a75b404f None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:47.450606 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 29/58] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:29:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:29:47.455607 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cab7f-da28-4875-a784-5ab58b607e29 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:47.456011 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cab7f-da28-4875-a784-5ab58b607e29 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:47.456184 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cab7f-da28-4875-a784-5ab58b607e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:47.473539 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-432cab7f-da28-4875-a784-5ab58b607e29 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:29:47.474760 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-432cab7f-da28-4875-a784-5ab58b607e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:29:47.538426 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 30/59] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:29:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:29:47.562730 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e579ad-fdea-439d-8c6f-d058a75b404f None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:47.660568 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e579ad-fdea-439d-8c6f-d058a75b404f None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:47.693433 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b51d1-5398-411b-b10c-4f9db12d7ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:47.694224 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b51d1-5398-411b-b10c-4f9db12d7ab4 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:47.694546 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b51d1-5398-411b-b10c-4f9db12d7ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:47.694832 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b51d1-5398-411b-b10c-4f9db12d7ab4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:47.696540 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b51d1-5398-411b-b10c-4f9db12d7ab4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:47.697991 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b51d1-5398-411b-b10c-4f9db12d7ab4 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:47.699687 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 30/60] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:29:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:29:47.705090 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432cab7f-da28-4875-a784-5ab58b607e29 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:47.800649 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432cab7f-da28-4875-a784-5ab58b607e29 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:47.802903 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:47.833870 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9956dd-d268-4745-b681-35528ddb782d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:47.834568 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9956dd-d268-4745-b681-35528ddb782d None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:47.834860 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9956dd-d268-4745-b681-35528ddb782d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:47.835143 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9956dd-d268-4745-b681-35528ddb782d None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:47.835855 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9956dd-d268-4745-b681-35528ddb782d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:47.837923 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9956dd-d268-4745-b681-35528ddb782d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:47.862266 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 31/61] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jul 21 03:29:47 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:29:51.101637 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37835d39-da0d-4abe-aed1-a47111977120 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:51.102595 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37835d39-da0d-4abe-aed1-a47111977120 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:51.103030 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37835d39-da0d-4abe-aed1-a47111977120 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:51.104567 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 31/62] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:29:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:29:51.110092 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0ea75-e521-448a-b5f0-6b424a488294 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:51.110874 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0ea75-e521-448a-b5f0-6b424a488294 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:51.111323 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc0ea75-e521-448a-b5f0-6b424a488294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:51.131430 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-ebc0ea75-e521-448a-b5f0-6b424a488294 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:29:51.132845 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ebc0ea75-e521-448a-b5f0-6b424a488294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:29:51.150605 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded301d0-0976-4786-ae27-86a8ae48747d None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:51.151103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded301d0-0976-4786-ae27-86a8ae48747d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:51.151552 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded301d0-0976-4786-ae27-86a8ae48747d None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:51.153073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 32/63] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:29:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:29:51.158667 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518b679-1aac-4d19-b362-8e13902c4809 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:51.159134 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518b679-1aac-4d19-b362-8e13902c4809 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:51.159565 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518b679-1aac-4d19-b362-8e13902c4809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:51.184393 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-1518b679-1aac-4d19-b362-8e13902c4809 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:29:51.186046 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1518b679-1aac-4d19-b362-8e13902c4809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:29:51.226873 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:51.250375 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 32/64] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:29:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:29:51.252121 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec03a9-67b0-4a22-85d5-af431a2b7689 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:51.252513 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec03a9-67b0-4a22-85d5-af431a2b7689 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:51.252890 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec03a9-67b0-4a22-85d5-af431a2b7689 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:51.255414 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 33/65] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:29:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:29:51.261722 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1d1bb-0bc9-4825-9810-98f75d6801c1 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:51.262142 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1d1bb-0bc9-4825-9810-98f75d6801c1 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:51.262564 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de1d1bb-0bc9-4825-9810-98f75d6801c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:51.289779 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-7de1d1bb-0bc9-4825-9810-98f75d6801c1 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:29:51.291810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7de1d1bb-0bc9-4825-9810-98f75d6801c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:29:51.298976 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 33/66] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:29:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 03:29:51.299977 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1518b679-1aac-4d19-b362-8e13902c4809 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:51.377040 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 34/67] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:29:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:29:51.379259 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1d1bb-0bc9-4825-9810-98f75d6801c1 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:51.414403 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:51.437544 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1518b679-1aac-4d19-b362-8e13902c4809 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:51.486409 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53d1e01-5bc7-4805-a65b-ba7875156dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:51.488044 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d1e01-5bc7-4805-a65b-ba7875156dcc None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:51.488902 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d1e01-5bc7-4805-a65b-ba7875156dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:51.489649 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d1e01-5bc7-4805-a65b-ba7875156dcc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:51.504648 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53d1e01-5bc7-4805-a65b-ba7875156dcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:29:51.512478 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-e53d1e01-5bc7-4805-a65b-ba7875156dcc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 03:29:51.512478 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:29:51.512478 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:29:51.512478 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:29:51.512478 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:29:51.512478 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:29:51.512478 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:29:51.512478 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:29:51.512478 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:29:51.512478 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:29:51.512478 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:29:51.512478 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:29:51.512478 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:29:51.512478 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:29:51.512478 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:29:51.512478 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:29:51.513367 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:29:51.513367 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:29:51.513367 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:29:51.513367 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:29:51.513367 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:29:51.513367 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:29:51.513367 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:29:51.513367 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:29:51.513367 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:29:51.513367 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:29:51.513367 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:29:51.513367 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:29:51.513367 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:29:51.513367 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:29:51.513367 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:29:51.513367 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:29:51.514134 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:29:51.514134 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:29:51.514134 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:29:51.514134 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:29:51.514134 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:29:51.514134 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:29:51.514134 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:29:51.514134 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:29:51.514134 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:29:51.514134 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:29:51.514134 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 03:29:51.514134 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:29:51.514759 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de1d1bb-0bc9-4825-9810-98f75d6801c1 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:51.517390 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 34/68] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:29:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:29:51.518437 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53d1e01-5bc7-4805-a65b-ba7875156dcc None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:51.531234 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:51.558743 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bebefe8-d0d3-4615-9d26-f6be70568cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:51.559953 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bebefe8-d0d3-4615-9d26-f6be70568cda None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:51.560397 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bebefe8-d0d3-4615-9d26-f6be70568cda None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:51.560830 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bebefe8-d0d3-4615-9d26-f6be70568cda None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:51.575419 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bebefe8-d0d3-4615-9d26-f6be70568cda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:29:51.584397 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-3bebefe8-d0d3-4615-9d26-f6be70568cda None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:29:51.584397 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:29:51.584397 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:29:51.584397 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:29:51.584397 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:29:51.584397 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:29:51.584397 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:29:51.584397 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:29:51.584397 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:29:51.584397 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:29:51.584397 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:29:51.584397 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:29:51.584397 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:29:51.584397 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:29:51.584397 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:29:51.584397 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:29:51.585247 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:29:51.585247 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:29:51.585247 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:29:51.585247 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:29:51.585247 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:29:51.585247 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:29:51.585247 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:29:51.585247 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:29:51.585247 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:29:51.585247 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:29:51.585247 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:29:51.585247 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:29:51.585247 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:29:51.585247 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:29:51.585247 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:29:51.585247 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:29:51.586000 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:29:51.586000 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:29:51.586000 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:29:51.586000 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:29:51.586000 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:29:51.586000 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:29:51.586000 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:29:51.586000 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:29:51.586000 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:29:51.586000 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:29:51.586000 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:29:51.586000 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:29:51.586000 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 35/69] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 03:29:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:29:51.587158 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9426d5-f59a-46d1-ada1-a076877f7748 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:51.587264 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9426d5-f59a-46d1-ada1-a076877f7748 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:51.587510 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9426d5-f59a-46d1-ada1-a076877f7748 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:51.591718 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 36/70] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:29:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:29:51.591718 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9426d5-f59a-46d1-ada1-a076877f7748 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:51.622050 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53d1e01-5bc7-4805-a65b-ba7875156dcc None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:51.654943 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee1b04-4111-4bc2-a2e2-dd8b732f74c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:51.655692 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee1b04-4111-4bc2-a2e2-dd8b732f74c8 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:51.655975 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee1b04-4111-4bc2-a2e2-dd8b732f74c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:51.656254 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee1b04-4111-4bc2-a2e2-dd8b732f74c8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:51.666620 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dee1b04-4111-4bc2-a2e2-dd8b732f74c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:29:51.672147 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:51.674503 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-1dee1b04-4111-4bc2-a2e2-dd8b732f74c8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 03:29:51.674503 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:29:51.674503 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:29:51.674503 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:29:51.674503 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:29:51.674503 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:29:51.674503 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:29:51.674503 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:29:51.674503 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:29:51.674503 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:29:51.674503 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:29:51.674503 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:29:51.674503 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:29:51.674503 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:29:51.674503 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:29:51.674503 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:29:51.675465 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:29:51.675465 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:29:51.675465 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:29:51.675465 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:29:51.675465 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:29:51.675465 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:29:51.675465 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:29:51.675465 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:29:51.675465 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:29:51.675465 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:29:51.675465 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:29:51.675465 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:29:51.675465 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:29:51.675465 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:29:51.675465 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:29:51.675465 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:29:51.682030 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:29:51.682030 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:29:51.682030 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:29:51.682030 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:29:51.682030 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:29:51.682030 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:29:51.682030 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:29:51.682030 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:29:51.682030 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:29:51.682030 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:29:51.682030 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 03:29:51.682030 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:29:51.682030 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 35/71] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jul 21 03:29:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:29:51.682030 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f842f9-8679-4262-a5b0-1ec11f9a08b3 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:51.682836 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f842f9-8679-4262-a5b0-1ec11f9a08b3 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:51.682836 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f842f9-8679-4262-a5b0-1ec11f9a08b3 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:51.682836 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 36/72] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:29:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:29:51.682836 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f842f9-8679-4262-a5b0-1ec11f9a08b3 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:51.695971 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9426d5-f59a-46d1-ada1-a076877f7748 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:51.729949 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ba71b-901c-4f7a-b02c-c353ec4ae449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:51.730660 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ba71b-901c-4f7a-b02c-c353ec4ae449 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:51.730947 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ba71b-901c-4f7a-b02c-c353ec4ae449 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:51.731225 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ba71b-901c-4f7a-b02c-c353ec4ae449 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:51.731970 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ba71b-901c-4f7a-b02c-c353ec4ae449 None admin] RBAC: Adding query filter params (name=member) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:29:51.732280 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ba71b-901c-4f7a-b02c-c353ec4ae449 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:51.733674 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ba71b-901c-4f7a-b02c-c353ec4ae449 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:51.741927 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 37/73] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 03:29:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:29:51.743734 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47302430-6b9e-4cba-915a-517266751ac2 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:51.744091 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47302430-6b9e-4cba-915a-517266751ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:51.744301 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47302430-6b9e-4cba-915a-517266751ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:51.751859 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:51.762645 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-47302430-6b9e-4cba-915a-517266751ac2 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:29:51.763838 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-47302430-6b9e-4cba-915a-517266751ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:29:51.787357 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f842f9-8679-4262-a5b0-1ec11f9a08b3 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:51.820973 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab859c46-3ea9-4075-ac89-2a6326df8e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:51.821644 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab859c46-3ea9-4075-ac89-2a6326df8e28 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:51.821927 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab859c46-3ea9-4075-ac89-2a6326df8e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:51.822208 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab859c46-3ea9-4075-ac89-2a6326df8e28 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:51.822999 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab859c46-3ea9-4075-ac89-2a6326df8e28 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:29:51.823313 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab859c46-3ea9-4075-ac89-2a6326df8e28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:51.824709 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab859c46-3ea9-4075-ac89-2a6326df8e28 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:51.828707 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 38/74] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:29:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:29:51.829532 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47302430-6b9e-4cba-915a-517266751ac2 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:51.835103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 37/75] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:29:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:29:51.846249 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef362a-c97d-4135-9da1-820663c459e2 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:51.846249 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef362a-c97d-4135-9da1-820663c459e2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:51.846249 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef362a-c97d-4135-9da1-820663c459e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:51.862267 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-b1ef362a-c97d-4135-9da1-820663c459e2 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:29:51.863491 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b1ef362a-c97d-4135-9da1-820663c459e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:29:51.904332 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:51.929444 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 38/76] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:29:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:29:51.931468 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef362a-c97d-4135-9da1-820663c459e2 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:51.934500 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47302430-6b9e-4cba-915a-517266751ac2 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:51.970732 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43210ba-c5fd-4213-97ee-19cbd8a7692f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:51.971403 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43210ba-c5fd-4213-97ee-19cbd8a7692f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:51.971691 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43210ba-c5fd-4213-97ee-19cbd8a7692f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:51.971973 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43210ba-c5fd-4213-97ee-19cbd8a7692f None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:51.972717 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43210ba-c5fd-4213-97ee-19cbd8a7692f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:29:51.973025 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43210ba-c5fd-4213-97ee-19cbd8a7692f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:51.974405 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43210ba-c5fd-4213-97ee-19cbd8a7692f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:51.982748 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 39/77] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:29:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:29:51.982748 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43210ba-c5fd-4213-97ee-19cbd8a7692f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:51.989525 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:52.030033 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef362a-c97d-4135-9da1-820663c459e2 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:52.063441 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206bd9a-ab84-44e7-abdb-8e2eb9dbe539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:52.064314 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206bd9a-ab84-44e7-abdb-8e2eb9dbe539 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:52.064601 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206bd9a-ab84-44e7-abdb-8e2eb9dbe539 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:52.064888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f206bd9a-ab84-44e7-abdb-8e2eb9dbe539 None admin] PATH_INFO: `/v3/users/b4287006dc2145adb045a433972123e5` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:52.077535 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f206bd9a-ab84-44e7-abdb-8e2eb9dbe539 None admin] RBAC: Authorizing `identity:get_user(user_id=b4287006dc2145adb045a433972123e5)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:52.079027 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f206bd9a-ab84-44e7-abdb-8e2eb9dbe539 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:52.080670 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 39/78] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:29:51 2022] GET /identity/v3/users/b4287006dc2145adb045a433972123e5 => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:29:52.081422 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206bd9a-ab84-44e7-abdb-8e2eb9dbe539 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:52.082075 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43210ba-c5fd-4213-97ee-19cbd8a7692f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:52.117059 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5abd42-4f3b-49f5-b02f-2cdbe6d88d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:52.117940 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5abd42-4f3b-49f5-b02f-2cdbe6d88d02 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:52.118230 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5abd42-4f3b-49f5-b02f-2cdbe6d88d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:52.118547 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5abd42-4f3b-49f5-b02f-2cdbe6d88d02 None admin] PATH_INFO: `/v3/users/eec6b06f7801471e932e859de1190593` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:52.119987 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5abd42-4f3b-49f5-b02f-2cdbe6d88d02 None admin] RBAC: Authorizing `identity:get_user(user_id=eec6b06f7801471e932e859de1190593)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:52.121427 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5abd42-4f3b-49f5-b02f-2cdbe6d88d02 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:52.123114 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 40/79] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:29:51 2022] GET /identity/v3/users/eec6b06f7801471e932e859de1190593 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:29:52.123868 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5abd42-4f3b-49f5-b02f-2cdbe6d88d02 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:52.126477 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:52.183821 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f206bd9a-ab84-44e7-abdb-8e2eb9dbe539 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:52.200855 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:52.218358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9f3a6-ea51-404d-be9c-703594299ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:52.219210 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9f3a6-ea51-404d-be9c-703594299ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:52.219502 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9f3a6-ea51-404d-be9c-703594299ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:52.219783 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb9f3a6-ea51-404d-be9c-703594299ce4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:52.220967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb9f3a6-ea51-404d-be9c-703594299ce4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:52.222428 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb9f3a6-ea51-404d-be9c-703594299ce4 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:52.223056 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5abd42-4f3b-49f5-b02f-2cdbe6d88d02 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:52.224096 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 40/80] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:29:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:29:52.224850 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9f3a6-ea51-404d-be9c-703594299ce4 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:52.256051 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13c00a-7ce3-470c-a4cc-33dd4f11ecc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:52.256846 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13c00a-7ce3-470c-a4cc-33dd4f11ecc2 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:52.257142 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13c00a-7ce3-470c-a4cc-33dd4f11ecc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:52.257421 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef13c00a-7ce3-470c-a4cc-33dd4f11ecc2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:52.269365 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef13c00a-7ce3-470c-a4cc-33dd4f11ecc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:29:52.278185 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-ef13c00a-7ce3-470c-a4cc-33dd4f11ecc2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 03:29:52.278185 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:29:52.278185 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:29:52.278185 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:29:52.278185 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:29:52.278185 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:29:52.278185 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:29:52.278185 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:29:52.278185 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:29:52.278185 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:29:52.278185 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:29:52.278185 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:29:52.278185 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:29:52.278185 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:29:52.278185 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:29:52.278185 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:29:52.279060 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:29:52.279060 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:29:52.279060 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:29:52.279060 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:29:52.279060 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:29:52.279060 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:29:52.279060 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:29:52.279060 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:29:52.279060 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:29:52.279060 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:29:52.279060 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:29:52.279060 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:29:52.279060 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:29:52.279060 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:29:52.279060 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:29:52.279060 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:29:52.279891 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:29:52.279891 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:29:52.279891 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:29:52.279891 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:29:52.279891 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:29:52.279891 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:29:52.279891 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:29:52.279891 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:29:52.279891 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:29:52.279891 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:29:52.279891 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 03:29:52.279891 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:29:52.279891 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 41/81] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:29:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:29:52.280728 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13c00a-7ce3-470c-a4cc-33dd4f11ecc2 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:52.327724 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb9f3a6-ea51-404d-be9c-703594299ce4 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:52.340152 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:52.361421 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca7a97-f062-4625-aa57-04bc764a1602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:52.362291 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca7a97-f062-4625-aa57-04bc764a1602 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:52.362622 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca7a97-f062-4625-aa57-04bc764a1602 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:52.362903 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca7a97-f062-4625-aa57-04bc764a1602 None admin] PATH_INFO: `/v3/users/b4287006dc2145adb045a433972123e5` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:52.364124 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca7a97-f062-4625-aa57-04bc764a1602 None admin] RBAC: Authorizing `identity:get_user(user_id=b4287006dc2145adb045a433972123e5)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:52.365598 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca7a97-f062-4625-aa57-04bc764a1602 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:52.367285 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 41/82] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:29:52 2022] GET /identity/v3/users/b4287006dc2145adb045a433972123e5 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:29:52.368078 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca7a97-f062-4625-aa57-04bc764a1602 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:52.378214 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef13c00a-7ce3-470c-a4cc-33dd4f11ecc2 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:52.411339 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6d24d-4239-4234-9cff-3e8782d9046d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:52.411986 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6d24d-4239-4234-9cff-3e8782d9046d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:52.412278 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6d24d-4239-4234-9cff-3e8782d9046d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:52.412561 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6d24d-4239-4234-9cff-3e8782d9046d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:52.422999 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:52.467010 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca7a97-f062-4625-aa57-04bc764a1602 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:52.478670 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f6d24d-4239-4234-9cff-3e8782d9046d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:52.480137 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f6d24d-4239-4234-9cff-3e8782d9046d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:52.499802 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c68c1-2745-4217-8553-e8b47ecb5410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:52.500446 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c68c1-2745-4217-8553-e8b47ecb5410 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:52.500736 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c68c1-2745-4217-8553-e8b47ecb5410 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:52.501018 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c68c1-2745-4217-8553-e8b47ecb5410 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:52.538117 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:52.567158 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c68c1-2745-4217-8553-e8b47ecb5410 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:52.568623 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c68c1-2745-4217-8553-e8b47ecb5410 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:52.579272 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 42/83] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:29:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 03:29:52.580059 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6d24d-4239-4234-9cff-3e8782d9046d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:52.626293 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:52.671138 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 42/84] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:29:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 03:29:52.672044 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c68c1-2745-4217-8553-e8b47ecb5410 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:52.679163 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6d24d-4239-4234-9cff-3e8782d9046d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:52.715519 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad8dc2e-9fa0-4d96-8426-90e2107e3e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:52.716199 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8dc2e-9fa0-4d96-8426-90e2107e3e2e None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:52.716494 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8dc2e-9fa0-4d96-8426-90e2107e3e2e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:52.716772 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8dc2e-9fa0-4d96-8426-90e2107e3e2e None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:52.717544 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad8dc2e-9fa0-4d96-8426-90e2107e3e2e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:52.718987 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad8dc2e-9fa0-4d96-8426-90e2107e3e2e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:52.739212 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 43/85] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jul 21 03:29:52 2022] POST /identity/v3/users => generated 289 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:29:52.740012 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad8dc2e-9fa0-4d96-8426-90e2107e3e2e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:52.762778 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:52.790691 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c68c1-2745-4217-8553-e8b47ecb5410 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:52.830705 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a038c-5a6b-4c2d-9913-773d50829346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:52.831399 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a038c-5a6b-4c2d-9913-773d50829346 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:52.832153 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a038c-5a6b-4c2d-9913-773d50829346 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:52.832153 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a038c-5a6b-4c2d-9913-773d50829346 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:52.832786 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a038c-5a6b-4c2d-9913-773d50829346 None admin] RBAC: Adding query filter params (name=member) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:29:52.833098 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a038c-5a6b-4c2d-9913-773d50829346 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:52.834547 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a038c-5a6b-4c2d-9913-773d50829346 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:52.848126 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 43/86] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 03:29:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:29:52.848126 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a038c-5a6b-4c2d-9913-773d50829346 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:52.864670 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:52.869283 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad8dc2e-9fa0-4d96-8426-90e2107e3e2e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:52.912435 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88017abe-eb0f-4912-ae3e-7d13bf53bdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:52.913277 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88017abe-eb0f-4912-ae3e-7d13bf53bdf4 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:52.913570 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88017abe-eb0f-4912-ae3e-7d13bf53bdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:52.913854 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88017abe-eb0f-4912-ae3e-7d13bf53bdf4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:52.972873 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a038c-5a6b-4c2d-9913-773d50829346 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:53.005787 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88017abe-eb0f-4912-ae3e-7d13bf53bdf4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:53.006167 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88017abe-eb0f-4912-ae3e-7d13bf53bdf4 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:53.022244 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886bdfac-75df-4e3d-84f0-7295c68fa3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:53.023523 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886bdfac-75df-4e3d-84f0-7295c68fa3c9 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:53.024212 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886bdfac-75df-4e3d-84f0-7295c68fa3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:53.024506 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886bdfac-75df-4e3d-84f0-7295c68fa3c9 None admin] PATH_INFO: `/v3/projects/e7eff2725d90448aaf1b1dc5e791bd90` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:53.026124 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886bdfac-75df-4e3d-84f0-7295c68fa3c9 None admin] RBAC: Authorizing `identity:get_project(project_id=e7eff2725d90448aaf1b1dc5e791bd90)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:53.028115 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886bdfac-75df-4e3d-84f0-7295c68fa3c9 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:53.029877 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:53.030172 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 44/87] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:29:52 2022] GET /identity/v3/projects/e7eff2725d90448aaf1b1dc5e791bd90 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:29:53.030968 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886bdfac-75df-4e3d-84f0-7295c68fa3c9 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:53.136198 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:53.151316 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 44/88] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:29:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 03:29:53.152172 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88017abe-eb0f-4912-ae3e-7d13bf53bdf4 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:53.163898 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886bdfac-75df-4e3d-84f0-7295c68fa3c9 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:53.199956 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad718009-9e36-4a3b-98f9-194856c78247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:53.200838 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad718009-9e36-4a3b-98f9-194856c78247 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:53.201178 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad718009-9e36-4a3b-98f9-194856c78247 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:53.201469 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad718009-9e36-4a3b-98f9-194856c78247 None admin] PATH_INFO: `/v3/projects/e7eff2725d90448aaf1b1dc5e791bd90` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:53.202716 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad718009-9e36-4a3b-98f9-194856c78247 None admin] RBAC: Authorizing `identity:get_project(project_id=e7eff2725d90448aaf1b1dc5e791bd90)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:53.204195 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad718009-9e36-4a3b-98f9-194856c78247 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:53.206241 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 45/89] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:29:53 2022] GET /identity/v3/projects/e7eff2725d90448aaf1b1dc5e791bd90 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:29:53.207060 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad718009-9e36-4a3b-98f9-194856c78247 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:53.268776 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88017abe-eb0f-4912-ae3e-7d13bf53bdf4 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:53.287482 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:53.307083 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df6345-ffdb-4448-88d5-ee12f96cfd98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:53.307974 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df6345-ffdb-4448-88d5-ee12f96cfd98 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:53.308269 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df6345-ffdb-4448-88d5-ee12f96cfd98 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:53.308551 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df6345-ffdb-4448-88d5-ee12f96cfd98 None admin] PATH_INFO: `/v3/users/b4287006dc2145adb045a433972123e5` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:53.309793 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df6345-ffdb-4448-88d5-ee12f96cfd98 None admin] RBAC: Authorizing `identity:get_user(user_id=b4287006dc2145adb045a433972123e5)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:53.311292 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df6345-ffdb-4448-88d5-ee12f96cfd98 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:53.311933 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad718009-9e36-4a3b-98f9-194856c78247 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:53.313125 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 45/90] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:29:53 2022] GET /identity/v3/users/b4287006dc2145adb045a433972123e5 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:29:53.313818 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df6345-ffdb-4448-88d5-ee12f96cfd98 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:53.348017 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c069a0-1ecd-4d76-9f12-e5adfaa72bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:53.348688 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c069a0-1ecd-4d76-9f12-e5adfaa72bb3 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:53.348977 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c069a0-1ecd-4d76-9f12-e5adfaa72bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:53.349259 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c069a0-1ecd-4d76-9f12-e5adfaa72bb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:53.350105 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c069a0-1ecd-4d76-9f12-e5adfaa72bb3 None admin] RBAC: Adding query filter params (role.id=1ac721157e9b40f18cbbc76f5a6b0d3d, scope.project.id=e7eff2725d90448aaf1b1dc5e791bd90, user.id=b4287006dc2145adb045a433972123e5) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:29:53.350419 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c069a0-1ecd-4d76-9f12-e5adfaa72bb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:53.352471 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c069a0-1ecd-4d76-9f12-e5adfaa72bb3 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:53.358324 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 46/91] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:29:53 2022] GET /identity/v3/role_assignments?user.id=b4287006dc2145adb045a433972123e5&scope.project.id=e7eff2725d90448aaf1b1dc5e791bd90&role.id=1ac721157e9b40f18cbbc76f5a6b0d3d => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:29:53.359155 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c069a0-1ecd-4d76-9f12-e5adfaa72bb3 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:53.397060 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:53.485702 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df6345-ffdb-4448-88d5-ee12f96cfd98 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:53.536238 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c069a0-1ecd-4d76-9f12-e5adfaa72bb3 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:53.544275 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208b96c-263b-4848-a754-6577677c8309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:53.545513 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208b96c-263b-4848-a754-6577677c8309 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:53.545997 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208b96c-263b-4848-a754-6577677c8309 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:53.546488 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208b96c-263b-4848-a754-6577677c8309 None admin] PATH_INFO: `/v3/projects/e7eff2725d90448aaf1b1dc5e791bd90` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:53.548019 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208b96c-263b-4848-a754-6577677c8309 None admin] RBAC: Authorizing `identity:get_project(project_id=e7eff2725d90448aaf1b1dc5e791bd90)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:53.549727 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208b96c-263b-4848-a754-6577677c8309 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:53.552128 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 46/92] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:29:53 2022] GET /identity/v3/projects/e7eff2725d90448aaf1b1dc5e791bd90 => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:29:53.559596 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208b96c-263b-4848-a754-6577677c8309 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:53.577189 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de258acb-d89c-4498-ba57-5d9978d282e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:53.577926 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de258acb-d89c-4498-ba57-5d9978d282e0 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:53.578222 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de258acb-d89c-4498-ba57-5d9978d282e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:53.578533 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de258acb-d89c-4498-ba57-5d9978d282e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:53.579601 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de258acb-d89c-4498-ba57-5d9978d282e0 None admin] RBAC: Adding query filter params (role.id=27e53d6c56f24c25a8c8057bfd36bcf1, scope.project.id=e7eff2725d90448aaf1b1dc5e791bd90, user.id=eec6b06f7801471e932e859de1190593) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:29:53.579925 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de258acb-d89c-4498-ba57-5d9978d282e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:53.581459 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de258acb-d89c-4498-ba57-5d9978d282e0 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:53.588515 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 47/93] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:29:53 2022] GET /identity/v3/role_assignments?user.id=eec6b06f7801471e932e859de1190593&scope.project.id=e7eff2725d90448aaf1b1dc5e791bd90&role.id=27e53d6c56f24c25a8c8057bfd36bcf1 => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:29:53.589292 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de258acb-d89c-4498-ba57-5d9978d282e0 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:53.660589 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:53.761290 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208b96c-263b-4848-a754-6577677c8309 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:53.765332 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:53.798807 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de258acb-d89c-4498-ba57-5d9978d282e0 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:53.847757 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d58d1-0b67-4f42-8c7f-52c96d6de6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:53.848440 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d58d1-0b67-4f42-8c7f-52c96d6de6c7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:53.848734 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d58d1-0b67-4f42-8c7f-52c96d6de6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:53.849016 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d58d1-0b67-4f42-8c7f-52c96d6de6c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:53.850785 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b932ea-1c6f-4199-a778-1f974046589f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:53.851665 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b932ea-1c6f-4199-a778-1f974046589f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:53.852189 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b932ea-1c6f-4199-a778-1f974046589f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:53.852687 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b932ea-1c6f-4199-a778-1f974046589f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:53.853746 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b932ea-1c6f-4199-a778-1f974046589f None admin] RBAC: Adding query filter params (role.id=76578c4e1dbb4559b293fb93830ed5b2, scope.project.id=e7eff2725d90448aaf1b1dc5e791bd90, user.id=b4287006dc2145adb045a433972123e5) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:29:53.854268 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b932ea-1c6f-4199-a778-1f974046589f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:53.856079 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b932ea-1c6f-4199-a778-1f974046589f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:53.862797 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 48/94] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:29:53 2022] GET /identity/v3/role_assignments?user.id=b4287006dc2145adb045a433972123e5&scope.project.id=e7eff2725d90448aaf1b1dc5e791bd90&role.id=76578c4e1dbb4559b293fb93830ed5b2 => generated 259 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:29:53.953500 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d58d1-0b67-4f42-8c7f-52c96d6de6c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:53.955015 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d58d1-0b67-4f42-8c7f-52c96d6de6c7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:54.032442 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:54.091053 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 47/95] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:29:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 03:29:54.096825 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b932ea-1c6f-4199-a778-1f974046589f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:54.258807 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b932ea-1c6f-4199-a778-1f974046589f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:54.313515 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e31d87-e39f-4b9f-af4a-018313b43615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:54.314393 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e31d87-e39f-4b9f-af4a-018313b43615 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:54.314703 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e31d87-e39f-4b9f-af4a-018313b43615 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:54.314982 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e31d87-e39f-4b9f-af4a-018313b43615 None admin] PATH_INFO: `/v3/projects/ff08f0da218547168d61280850305f5d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:54.316204 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e31d87-e39f-4b9f-af4a-018313b43615 None admin] RBAC: Authorizing `identity:get_project(project_id=ff08f0da218547168d61280850305f5d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:54.317674 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e31d87-e39f-4b9f-af4a-018313b43615 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:54.319651 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 49/96] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:29:54 2022] GET /identity/v3/projects/ff08f0da218547168d61280850305f5d => generated 312 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:29:54.325862 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d58d1-0b67-4f42-8c7f-52c96d6de6c7 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:54.470992 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d58d1-0b67-4f42-8c7f-52c96d6de6c7 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:54.524121 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46199f72-85ec-4591-a094-c57c31d2c0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:54.524795 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46199f72-85ec-4591-a094-c57c31d2c0e0 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:54.525089 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46199f72-85ec-4591-a094-c57c31d2c0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:54.525374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46199f72-85ec-4591-a094-c57c31d2c0e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:54.526229 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46199f72-85ec-4591-a094-c57c31d2c0e0 None admin] RBAC: Adding query filter params (role.id=1ac721157e9b40f18cbbc76f5a6b0d3d, scope.project.id=ff08f0da218547168d61280850305f5d, user.id=b4287006dc2145adb045a433972123e5) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:29:54.526574 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46199f72-85ec-4591-a094-c57c31d2c0e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:54.528021 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46199f72-85ec-4591-a094-c57c31d2c0e0 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:54.533982 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 48/97] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:29:54 2022] GET /identity/v3/role_assignments?user.id=b4287006dc2145adb045a433972123e5&scope.project.id=ff08f0da218547168d61280850305f5d&role.id=1ac721157e9b40f18cbbc76f5a6b0d3d => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:29:55.336767 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d82a6-ba5b-45af-9629-ff8cab1827c2 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:55.337275 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d82a6-ba5b-45af-9629-ff8cab1827c2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:55.337382 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d82a6-ba5b-45af-9629-ff8cab1827c2 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:55.338932 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 50/98] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:29:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:29:55.343823 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c26a3c-d4c1-4190-8e98-c5a44a3ec244 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:55.344209 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c26a3c-d4c1-4190-8e98-c5a44a3ec244 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:55.344387 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c26a3c-d4c1-4190-8e98-c5a44a3ec244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:55.367473 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-30c26a3c-d4c1-4190-8e98-c5a44a3ec244 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:29:55.368684 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-30c26a3c-d4c1-4190-8e98-c5a44a3ec244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:29:55.382635 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:55.453823 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 49/99] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:29:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:29:55.489203 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d82a6-ba5b-45af-9629-ff8cab1827c2 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:55.526003 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:55.553540 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011681a-b1cf-4654-b0bb-348f7fd6582b None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:55.553853 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011681a-b1cf-4654-b0bb-348f7fd6582b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:55.554112 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011681a-b1cf-4654-b0bb-348f7fd6582b None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:55.555574 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 50/100] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:29:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 03:29:55.563768 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730cee21-2f0f-469d-b64d-4adeccac196f None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:55.564359 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730cee21-2f0f-469d-b64d-4adeccac196f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:55.564841 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730cee21-2f0f-469d-b64d-4adeccac196f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:55.591511 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-730cee21-2f0f-469d-b64d-4adeccac196f None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:29:55.593012 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-730cee21-2f0f-469d-b64d-4adeccac196f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:29:55.683301 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d82a6-ba5b-45af-9629-ff8cab1827c2 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:55.717917 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 51/101] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:29:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:29:55.757549 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730cee21-2f0f-469d-b64d-4adeccac196f None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:55.758963 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a4721-d65e-4b0d-9b13-f3870c81f5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:55.759774 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a4721-d65e-4b0d-9b13-f3870c81f5d9 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:55.760063 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a4721-d65e-4b0d-9b13-f3870c81f5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:55.760341 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a4721-d65e-4b0d-9b13-f3870c81f5d9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:55.791453 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855a4721-d65e-4b0d-9b13-f3870c81f5d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:29:55.799358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-855a4721-d65e-4b0d-9b13-f3870c81f5d9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 03:29:55.799358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:29:55.799358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:29:55.799358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:29:55.799358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:29:55.799358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:29:55.799358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:29:55.799358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:29:55.799358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:29:55.799358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:29:55.799358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:29:55.799358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:29:55.799358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:29:55.799358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:29:55.799358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:29:55.799358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:29:55.800256 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:29:55.800256 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:29:55.800256 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:29:55.800256 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:29:55.800256 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:29:55.800256 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:29:55.800256 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:29:55.800256 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:29:55.800256 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:29:55.800256 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:29:55.800256 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:29:55.800256 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:29:55.800256 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:29:55.800256 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:29:55.800256 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:29:55.800256 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:29:55.801008 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:29:55.801008 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:29:55.801008 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:29:55.801008 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:29:55.801008 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:29:55.801008 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:29:55.801008 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:29:55.801008 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:29:55.801008 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:29:55.801008 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:29:55.801008 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 03:29:55.801008 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:29:55.801008 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 51/102] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:29:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:29:55.811771 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a4721-d65e-4b0d-9b13-f3870c81f5d9 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:55.882910 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:55.910694 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730cee21-2f0f-469d-b64d-4adeccac196f None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:55.970810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d63d60-909d-456d-aa5f-5dce00fbd190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:55.972170 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d63d60-909d-456d-aa5f-5dce00fbd190 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:55.972671 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d63d60-909d-456d-aa5f-5dce00fbd190 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:55.973142 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d63d60-909d-456d-aa5f-5dce00fbd190 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:55.974569 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d63d60-909d-456d-aa5f-5dce00fbd190 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:55.977224 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d63d60-909d-456d-aa5f-5dce00fbd190 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:55.979345 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 52/103] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:29:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:29:55.986810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d63d60-909d-456d-aa5f-5dce00fbd190 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:56.003427 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:56.075519 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a4721-d65e-4b0d-9b13-f3870c81f5d9 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:56.159244 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26f839-1ba1-475d-88dc-4ba004a2f2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:56.159850 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26f839-1ba1-475d-88dc-4ba004a2f2ce None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:56.160139 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26f839-1ba1-475d-88dc-4ba004a2f2ce None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:56.160422 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26f839-1ba1-475d-88dc-4ba004a2f2ce None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:56.161184 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26f839-1ba1-475d-88dc-4ba004a2f2ce None admin] RBAC: Adding query filter params (name=reader) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:29:56.161500 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26f839-1ba1-475d-88dc-4ba004a2f2ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:56.162942 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26f839-1ba1-475d-88dc-4ba004a2f2ce None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:56.182110 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 52/104] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 03:29:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:29:56.187504 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26f839-1ba1-475d-88dc-4ba004a2f2ce None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:56.190605 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d63d60-909d-456d-aa5f-5dce00fbd190 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:56.275210 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa398a-55d4-4fbb-a2da-714aa24f152b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:56.275908 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa398a-55d4-4fbb-a2da-714aa24f152b None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:56.276194 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa398a-55d4-4fbb-a2da-714aa24f152b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:56.276460 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa398a-55d4-4fbb-a2da-714aa24f152b None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:56.277185 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fa398a-55d4-4fbb-a2da-714aa24f152b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:56.278676 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fa398a-55d4-4fbb-a2da-714aa24f152b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:56.317656 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26f839-1ba1-475d-88dc-4ba004a2f2ce None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:56.322551 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:56.340477 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 53/105] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jul 21 03:29:55 2022] POST /identity/v3/projects => generated 302 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:29:56.341820 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2ef95-86e7-494a-83cd-9a8923940440 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:56.342136 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2ef95-86e7-494a-83cd-9a8923940440 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:56.346927 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2ef95-86e7-494a-83cd-9a8923940440 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:56.353086 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 54/106] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:29:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:29:56.363874 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946aa33-721e-49a4-af2c-3b1e9164950c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:56.364169 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946aa33-721e-49a4-af2c-3b1e9164950c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:56.364452 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946aa33-721e-49a4-af2c-3b1e9164950c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:56.371452 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68181d0-25e7-499f-9df5-f19be50039f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:56.372375 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68181d0-25e7-499f-9df5-f19be50039f3 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:56.372661 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68181d0-25e7-499f-9df5-f19be50039f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:56.372939 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68181d0-25e7-499f-9df5-f19be50039f3 None admin] PATH_INFO: `/v3/users/0fdeb152d5d1494fb09a286cbbbbe0cc` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:56.380740 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:56.407804 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b946aa33-721e-49a4-af2c-3b1e9164950c None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:29:56.408837 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b946aa33-721e-49a4-af2c-3b1e9164950c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:29:56.411783 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68181d0-25e7-499f-9df5-f19be50039f3 None admin] RBAC: Authorizing `identity:get_user(user_id=0fdeb152d5d1494fb09a286cbbbbe0cc)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:56.412753 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68181d0-25e7-499f-9df5-f19be50039f3 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:56.419174 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 53/107] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:29:56 2022] GET /identity/v3/users/0fdeb152d5d1494fb09a286cbbbbe0cc => generated 289 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:29:56.425147 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68181d0-25e7-499f-9df5-f19be50039f3 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:56.592787 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 55/108] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:29:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 03:29:56.593244 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68181d0-25e7-499f-9df5-f19be50039f3 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:56.642474 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523086e3-ff6b-439b-a1f5-5bec515f3f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:56.643487 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523086e3-ff6b-439b-a1f5-5bec515f3f41 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:56.643978 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523086e3-ff6b-439b-a1f5-5bec515f3f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:56.644474 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523086e3-ff6b-439b-a1f5-5bec515f3f41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:56.655546 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946aa33-721e-49a4-af2c-3b1e9164950c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:56.718967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:56.729276 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523086e3-ff6b-439b-a1f5-5bec515f3f41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:56.731239 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523086e3-ff6b-439b-a1f5-5bec515f3f41 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:56.861140 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 54/109] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:29:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 03:29:56.862559 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14fd3a-373a-48e3-b451-9d6f8e93b014 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:56.862993 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14fd3a-373a-48e3-b451-9d6f8e93b014 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:56.863330 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd14fd3a-373a-48e3-b451-9d6f8e93b014 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:56.865022 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 55/110] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:29:56.870764 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83121df2-214b-4297-a320-8ef1daed4f72 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:56.871054 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83121df2-214b-4297-a320-8ef1daed4f72 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:56.871335 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83121df2-214b-4297-a320-8ef1daed4f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:56.877305 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946aa33-721e-49a4-af2c-3b1e9164950c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:56.891868 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-83121df2-214b-4297-a320-8ef1daed4f72 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:29:56.893545 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-83121df2-214b-4297-a320-8ef1daed4f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:29:56.907117 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:56.915903 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ac3f1-a2fe-4a9b-9702-071227a9ba6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:56.916708 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ac3f1-a2fe-4a9b-9702-071227a9ba6b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:56.916996 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ac3f1-a2fe-4a9b-9702-071227a9ba6b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:56.917272 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ac3f1-a2fe-4a9b-9702-071227a9ba6b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:56.928627 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46ac3f1-a2fe-4a9b-9702-071227a9ba6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:29:56.936457 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-d46ac3f1-a2fe-4a9b-9702-071227a9ba6b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 03:29:56.936457 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:29:56.936457 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:29:56.936457 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:29:56.936457 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:29:56.936457 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:29:56.936457 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:29:56.936457 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:29:56.936457 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:29:56.936457 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:29:56.936457 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:29:56.936457 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:29:56.936457 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:29:56.936457 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:29:56.936457 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:29:56.936457 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:29:56.937296 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:29:56.937296 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:29:56.937296 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:29:56.937296 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:29:56.937296 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:29:56.937296 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:29:56.937296 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:29:56.937296 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:29:56.937296 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:29:56.937296 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:29:56.937296 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:29:56.937296 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:29:56.937296 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:29:56.937296 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:29:56.937296 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:29:56.937296 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:29:56.938067 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:29:56.938067 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:29:56.938067 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:29:56.938067 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:29:56.938067 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:29:56.938067 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:29:56.938067 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:29:56.938067 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:29:56.938067 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:29:56.938067 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:29:56.938067 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 03:29:56.938067 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:29:56.938067 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 56/111] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:29:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:29:56.939272 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ac3f1-a2fe-4a9b-9702-071227a9ba6b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:57.006239 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 56/112] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:29:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:29:57.007382 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83121df2-214b-4297-a320-8ef1daed4f72 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:57.036936 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:57.069621 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ac3f1-a2fe-4a9b-9702-071227a9ba6b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:57.115116 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83121df2-214b-4297-a320-8ef1daed4f72 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:57.124881 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb08e51-6cbd-4d0b-b006-ac53da944d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:57.127312 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb08e51-6cbd-4d0b-b006-ac53da944d06 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:57.128411 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb08e51-6cbd-4d0b-b006-ac53da944d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:57.129042 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb08e51-6cbd-4d0b-b006-ac53da944d06 None admin] PATH_INFO: `/v3/projects/e7eff2725d90448aaf1b1dc5e791bd90` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:57.130757 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb08e51-6cbd-4d0b-b006-ac53da944d06 None admin] RBAC: Authorizing `identity:get_project(project_id=e7eff2725d90448aaf1b1dc5e791bd90)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:57.133762 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb08e51-6cbd-4d0b-b006-ac53da944d06 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:57.136305 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 57/113] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:29:56 2022] GET /identity/v3/projects/e7eff2725d90448aaf1b1dc5e791bd90 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:29:57.137750 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b607a-42cd-4401-8fb8-7fbca0bb27b0 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:57.138121 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b607a-42cd-4401-8fb8-7fbca0bb27b0 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:57.138997 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b607a-42cd-4401-8fb8-7fbca0bb27b0 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:57.140571 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 58/114] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:29:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:29:57.143190 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b607a-42cd-4401-8fb8-7fbca0bb27b0 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:57.157321 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2418b2-de23-4c6d-b6e4-f4c6dbe094c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:57.158009 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2418b2-de23-4c6d-b6e4-f4c6dbe094c5 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:57.158339 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2418b2-de23-4c6d-b6e4-f4c6dbe094c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:57.158667 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2418b2-de23-4c6d-b6e4-f4c6dbe094c5 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:57.159433 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2418b2-de23-4c6d-b6e4-f4c6dbe094c5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:29:57.159796 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2418b2-de23-4c6d-b6e4-f4c6dbe094c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:57.161265 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2418b2-de23-4c6d-b6e4-f4c6dbe094c5 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:57.171747 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 57/115] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 03:29:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:29:57.177028 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2418b2-de23-4c6d-b6e4-f4c6dbe094c5 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:57.226342 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:57.273344 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:57.295127 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b607a-42cd-4401-8fb8-7fbca0bb27b0 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:57.298540 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2418b2-de23-4c6d-b6e4-f4c6dbe094c5 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:57.335178 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568043b1-e135-4cf4-9f57-4fec84494248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:57.335847 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568043b1-e135-4cf4-9f57-4fec84494248 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:57.336174 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568043b1-e135-4cf4-9f57-4fec84494248 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:57.336462 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568043b1-e135-4cf4-9f57-4fec84494248 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:57.337309 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568043b1-e135-4cf4-9f57-4fec84494248 None admin] RBAC: Adding query filter params (role.id=8670c500985c4abea21f372ef30378a6, scope.project.id=e7eff2725d90448aaf1b1dc5e791bd90, user.id=0fdeb152d5d1494fb09a286cbbbbe0cc) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:29:57.337628 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568043b1-e135-4cf4-9f57-4fec84494248 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:57.339255 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568043b1-e135-4cf4-9f57-4fec84494248 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:57.344265 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b26642-0eda-4e23-aa1b-1031ebac1a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:57.345235 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 58/116] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:29:57 2022] GET /identity/v3/role_assignments?user.id=0fdeb152d5d1494fb09a286cbbbbe0cc&scope.project.id=e7eff2725d90448aaf1b1dc5e791bd90&role.id=8670c500985c4abea21f372ef30378a6 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:29:57.345588 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b26642-0eda-4e23-aa1b-1031ebac1a5d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:57.346131 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b26642-0eda-4e23-aa1b-1031ebac1a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:57.346643 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc2526-8bfb-4465-b47f-20557d92824f None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:57.346749 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b26642-0eda-4e23-aa1b-1031ebac1a5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:57.346932 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc2526-8bfb-4465-b47f-20557d92824f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:57.347263 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc2526-8bfb-4465-b47f-20557d92824f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:57.366185 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b26642-0eda-4e23-aa1b-1031ebac1a5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:29:57.366722 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-34cc2526-8bfb-4465-b47f-20557d92824f None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:29:57.368258 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-34cc2526-8bfb-4465-b47f-20557d92824f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:29:57.377785 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-e2b26642-0eda-4e23-aa1b-1031ebac1a5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:29:57.377785 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:29:57.377785 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:29:57.377785 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:29:57.377785 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:29:57.377785 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:29:57.377785 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:29:57.377785 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:29:57.377785 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:29:57.377785 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:29:57.377785 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:29:57.377785 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:29:57.377785 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:29:57.377785 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:29:57.377785 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:29:57.377785 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:29:57.378750 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:29:57.378750 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:29:57.378750 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:29:57.378750 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:29:57.378750 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:29:57.378750 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:29:57.378750 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:29:57.378750 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:29:57.378750 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:29:57.378750 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:29:57.378750 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:29:57.378750 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:29:57.378750 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:29:57.378750 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:29:57.378750 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:29:57.378750 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:29:57.379495 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:29:57.379495 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:29:57.379495 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:29:57.379495 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:29:57.379495 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:29:57.379495 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:29:57.379495 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:29:57.379495 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:29:57.379495 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:29:57.379495 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:29:57.379495 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:29:57.379495 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:29:57.382660 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 59/117] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 03:29:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:29:57.384727 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b26642-0eda-4e23-aa1b-1031ebac1a5d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:57.454489 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 59/118] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:29:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:29:57.454489 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc2526-8bfb-4465-b47f-20557d92824f None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:57.547785 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b26642-0eda-4e23-aa1b-1031ebac1a5d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:57.564686 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:57.567093 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:57.587098 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653ff4a-6307-4b87-9aaa-c14a80ea512d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:57.588211 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653ff4a-6307-4b87-9aaa-c14a80ea512d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:57.588618 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653ff4a-6307-4b87-9aaa-c14a80ea512d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:57.589006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653ff4a-6307-4b87-9aaa-c14a80ea512d None admin] PATH_INFO: `/v3/users/b4287006dc2145adb045a433972123e5` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:57.590449 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9653ff4a-6307-4b87-9aaa-c14a80ea512d None admin] RBAC: Authorizing `identity:get_user(user_id=b4287006dc2145adb045a433972123e5)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:57.592427 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9653ff4a-6307-4b87-9aaa-c14a80ea512d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:57.594137 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 60/119] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:29:57 2022] GET /identity/v3/users/b4287006dc2145adb045a433972123e5 => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:29:57.599179 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653ff4a-6307-4b87-9aaa-c14a80ea512d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:57.599810 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc2526-8bfb-4465-b47f-20557d92824f None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:57.648622 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23874705-4abc-4bb0-95f3-898e9c12e52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:57.649649 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23874705-4abc-4bb0-95f3-898e9c12e52d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:57.650085 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23874705-4abc-4bb0-95f3-898e9c12e52d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:57.650782 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23874705-4abc-4bb0-95f3-898e9c12e52d None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:57.652160 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23874705-4abc-4bb0-95f3-898e9c12e52d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:29:57.652641 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23874705-4abc-4bb0-95f3-898e9c12e52d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:57.654442 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23874705-4abc-4bb0-95f3-898e9c12e52d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:57.667034 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 60/120] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:29:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:29:57.668490 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23874705-4abc-4bb0-95f3-898e9c12e52d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:57.720807 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653ff4a-6307-4b87-9aaa-c14a80ea512d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:57.765285 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca89bc-74e4-4e04-8699-1be190276da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:57.766640 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca89bc-74e4-4e04-8699-1be190276da4 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:57.767078 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca89bc-74e4-4e04-8699-1be190276da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:57.767511 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca89bc-74e4-4e04-8699-1be190276da4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:57.781606 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ca89bc-74e4-4e04-8699-1be190276da4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:29:57.791224 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-51ca89bc-74e4-4e04-8699-1be190276da4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 03:29:57.791224 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:29:57.791224 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:29:57.791224 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:29:57.791224 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:29:57.791224 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:29:57.791224 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:29:57.791224 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:29:57.791224 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:29:57.791224 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:29:57.791224 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:29:57.791224 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:29:57.791224 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:29:57.791224 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:29:57.791224 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:29:57.791224 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:29:57.792062 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:29:57.792062 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:29:57.792062 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:29:57.792062 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:29:57.792062 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:29:57.792062 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:29:57.792062 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:29:57.792062 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:29:57.792062 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:29:57.792062 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:29:57.792062 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:29:57.792062 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:29:57.792062 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:29:57.792062 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:29:57.792062 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:29:57.792062 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:29:57.792843 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:29:57.792843 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:29:57.792843 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:29:57.792843 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:29:57.792843 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:29:57.792843 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:29:57.792843 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:29:57.792843 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:29:57.792843 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:29:57.792843 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:29:57.792843 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 03:29:57.792843 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:29:57.800780 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 61/121] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jul 21 03:29:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:29:57.801915 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca89bc-74e4-4e04-8699-1be190276da4 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:57.830687 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23874705-4abc-4bb0-95f3-898e9c12e52d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:57.866317 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:57.868703 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff05d9-8167-471d-ad5d-0c4820819292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:57.869626 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff05d9-8167-471d-ad5d-0c4820819292 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:57.869918 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff05d9-8167-471d-ad5d-0c4820819292 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:57.870277 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff05d9-8167-471d-ad5d-0c4820819292 None admin] PATH_INFO: `/v3/projects/e7eff2725d90448aaf1b1dc5e791bd90` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:57.871651 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ff05d9-8167-471d-ad5d-0c4820819292 None admin] RBAC: Authorizing `identity:get_project(project_id=e7eff2725d90448aaf1b1dc5e791bd90)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:57.873233 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ff05d9-8167-471d-ad5d-0c4820819292 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:57.875492 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 61/122] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:29:57 2022] GET /identity/v3/projects/e7eff2725d90448aaf1b1dc5e791bd90 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:29:57.876912 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532cb1b-0462-40ab-b264-0012b64a1128 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:57.877204 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532cb1b-0462-40ab-b264-0012b64a1128 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:57.877484 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532cb1b-0462-40ab-b264-0012b64a1128 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:57.879234 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 62/123] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:29:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:29:57.880039 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532cb1b-0462-40ab-b264-0012b64a1128 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:57.892774 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:57.952488 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca89bc-74e4-4e04-8699-1be190276da4 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:57.991680 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8118fb-26ed-42f5-adb8-8cc3940d28e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:57.992669 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8118fb-26ed-42f5-adb8-8cc3940d28e9 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:57.993155 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8118fb-26ed-42f5-adb8-8cc3940d28e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:57.993439 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8118fb-26ed-42f5-adb8-8cc3940d28e9 None admin] PATH_INFO: `/v3/users/eec6b06f7801471e932e859de1190593` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:57.994857 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8118fb-26ed-42f5-adb8-8cc3940d28e9 None admin] RBAC: Authorizing `identity:get_user(user_id=eec6b06f7801471e932e859de1190593)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:57.996458 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8118fb-26ed-42f5-adb8-8cc3940d28e9 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:57.998397 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 62/124] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:29:57 2022] GET /identity/v3/users/eec6b06f7801471e932e859de1190593 => generated 247 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:29:58.003038 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8118fb-26ed-42f5-adb8-8cc3940d28e9 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:58.020115 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532cb1b-0462-40ab-b264-0012b64a1128 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:58.070212 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c770ccd4-8a41-40d7-8c46-dfc33c269d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:58.071545 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770ccd4-8a41-40d7-8c46-dfc33c269d88 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:58.072454 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770ccd4-8a41-40d7-8c46-dfc33c269d88 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:58.073444 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770ccd4-8a41-40d7-8c46-dfc33c269d88 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:58.074422 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c770ccd4-8a41-40d7-8c46-dfc33c269d88 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:29:58.074976 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c770ccd4-8a41-40d7-8c46-dfc33c269d88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:58.077412 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c770ccd4-8a41-40d7-8c46-dfc33c269d88 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:58.089254 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 63/125] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:29:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:29:58.095700 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd4ac6-1a9e-4869-a31f-5abc074093ff None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:58.096069 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd4ac6-1a9e-4869-a31f-5abc074093ff None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:58.096429 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd4ac6-1a9e-4869-a31f-5abc074093ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:58.117565 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8118fb-26ed-42f5-adb8-8cc3940d28e9 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:58.118023 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-1bfd4ac6-1a9e-4869-a31f-5abc074093ff None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:29:58.119329 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1bfd4ac6-1a9e-4869-a31f-5abc074093ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:29:58.131616 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:58.156447 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff0ba9-be90-4158-ba9d-b3a8ded26c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:58.157629 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff0ba9-be90-4158-ba9d-b3a8ded26c13 None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:58.158097 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff0ba9-be90-4158-ba9d-b3a8ded26c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:58.158620 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff0ba9-be90-4158-ba9d-b3a8ded26c13 None admin] PATH_INFO: `/v3/projects/e7eff2725d90448aaf1b1dc5e791bd90/users/b4287006dc2145adb045a433972123e5/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:58.160944 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff0ba9-be90-4158-ba9d-b3a8ded26c13 None admin] RBAC: Authorizing `identity:create_grant(project_id=e7eff2725d90448aaf1b1dc5e791bd90, user_id=b4287006dc2145adb045a433972123e5, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:58.162664 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff0ba9-be90-4158-ba9d-b3a8ded26c13 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:58.181969 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 63/126] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 03:29:57 2022] PUT /identity/v3/projects/e7eff2725d90448aaf1b1dc5e791bd90/users/b4287006dc2145adb045a433972123e5/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:29:58.183418 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff0ba9-be90-4158-ba9d-b3a8ded26c13 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:58.197181 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:58.203970 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 64/127] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:29:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:29:58.205462 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd4ac6-1a9e-4869-a31f-5abc074093ff None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:58.338562 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd4ac6-1a9e-4869-a31f-5abc074093ff None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:58.352288 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff0ba9-be90-4158-ba9d-b3a8ded26c13 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:58.379642 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e47fb6-637a-4855-892b-60eaf66b4da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:58.382111 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e47fb6-637a-4855-892b-60eaf66b4da5 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:58.382111 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e47fb6-637a-4855-892b-60eaf66b4da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:58.382111 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e47fb6-637a-4855-892b-60eaf66b4da5 None admin] PATH_INFO: `/v3/users/b4287006dc2145adb045a433972123e5` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:58.384747 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e47fb6-637a-4855-892b-60eaf66b4da5 None admin] RBAC: Authorizing `identity:get_user(user_id=b4287006dc2145adb045a433972123e5)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:58.386276 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e47fb6-637a-4855-892b-60eaf66b4da5 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:58.392903 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 65/128] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:29:58 2022] GET /identity/v3/users/b4287006dc2145adb045a433972123e5 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:29:58.393785 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e47fb6-637a-4855-892b-60eaf66b4da5 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:58.425196 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e5573-f5f4-4b90-927c-615d8bb3982f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:58.426084 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e5573-f5f4-4b90-927c-615d8bb3982f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:58.426435 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e5573-f5f4-4b90-927c-615d8bb3982f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:58.426749 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e5573-f5f4-4b90-927c-615d8bb3982f None admin] PATH_INFO: `/v3/projects/e7eff2725d90448aaf1b1dc5e791bd90` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:58.429747 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e5573-f5f4-4b90-927c-615d8bb3982f None admin] RBAC: Authorizing `identity:get_project(project_id=e7eff2725d90448aaf1b1dc5e791bd90)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:58.432162 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e5573-f5f4-4b90-927c-615d8bb3982f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:58.434433 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 64/129] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:29:58 2022] GET /identity/v3/projects/e7eff2725d90448aaf1b1dc5e791bd90 => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:29:58.435481 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e5573-f5f4-4b90-927c-615d8bb3982f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:58.488774 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:58.516318 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:58.557707 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e47fb6-637a-4855-892b-60eaf66b4da5 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:58.563951 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e5573-f5f4-4b90-927c-615d8bb3982f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:58.604455 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1eeee7-d16d-4929-b1c1-ba26135ac00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:58.605181 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1eeee7-d16d-4929-b1c1-ba26135ac00a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:58.605469 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1eeee7-d16d-4929-b1c1-ba26135ac00a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:58.605751 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1eeee7-d16d-4929-b1c1-ba26135ac00a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:58.613880 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df518f1a-cf53-4f80-929d-e11edf16994f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:58.614780 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df518f1a-cf53-4f80-929d-e11edf16994f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:58.615066 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df518f1a-cf53-4f80-929d-e11edf16994f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:58.615342 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df518f1a-cf53-4f80-929d-e11edf16994f None admin] PATH_INFO: `/v3/projects/e7eff2725d90448aaf1b1dc5e791bd90` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:58.618032 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df518f1a-cf53-4f80-929d-e11edf16994f None admin] RBAC: Authorizing `identity:get_project(project_id=e7eff2725d90448aaf1b1dc5e791bd90)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:58.619520 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df518f1a-cf53-4f80-929d-e11edf16994f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:58.621448 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 65/130] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:29:58 2022] GET /identity/v3/projects/e7eff2725d90448aaf1b1dc5e791bd90 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:29:58.621974 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df518f1a-cf53-4f80-929d-e11edf16994f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:58.627877 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1eeee7-d16d-4929-b1c1-ba26135ac00a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:29:58.644696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-ff1eeee7-d16d-4929-b1c1-ba26135ac00a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 03:29:58.644696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:29:58.644696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:29:58.644696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:29:58.644696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:29:58.644696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:29:58.644696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:29:58.644696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:29:58.644696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:29:58.644696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:29:58.644696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:29:58.644696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:29:58.644696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:29:58.644696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:29:58.644696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:29:58.644696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:29:58.645637 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:29:58.645637 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:29:58.645637 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:29:58.645637 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:29:58.645637 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:29:58.645637 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:29:58.645637 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:29:58.645637 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:29:58.645637 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:29:58.645637 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:29:58.645637 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:29:58.645637 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:29:58.645637 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:29:58.645637 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:29:58.645637 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:29:58.645637 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:29:58.646508 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:29:58.646508 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:29:58.646508 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:29:58.646508 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:29:58.646508 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:29:58.646508 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:29:58.646508 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:29:58.646508 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:29:58.646508 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:29:58.646508 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:29:58.646508 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 03:29:58.646508 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:29:58.650490 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 66/131] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:29:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:29:58.650490 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1eeee7-d16d-4929-b1c1-ba26135ac00a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:58.804610 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df518f1a-cf53-4f80-929d-e11edf16994f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:58.815183 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:58.850137 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f1849-00ce-4f50-867e-771183749be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:58.851095 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f1849-00ce-4f50-867e-771183749be9 None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:58.851383 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f1849-00ce-4f50-867e-771183749be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:58.851707 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f1849-00ce-4f50-867e-771183749be9 None admin] PATH_INFO: `/v3/projects/e7eff2725d90448aaf1b1dc5e791bd90/users/eec6b06f7801471e932e859de1190593/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:58.855283 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f1849-00ce-4f50-867e-771183749be9 None admin] RBAC: Authorizing `identity:create_grant(project_id=e7eff2725d90448aaf1b1dc5e791bd90, user_id=eec6b06f7801471e932e859de1190593, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:58.856708 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f1849-00ce-4f50-867e-771183749be9 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:58.874586 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1eeee7-d16d-4929-b1c1-ba26135ac00a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:58.879171 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 66/132] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 03:29:58 2022] PUT /identity/v3/projects/e7eff2725d90448aaf1b1dc5e791bd90/users/eec6b06f7801471e932e859de1190593/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:29:58.880060 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f1849-00ce-4f50-867e-771183749be9 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:58.948280 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:58.979927 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff65038-97e5-48e3-9874-0e5db775c850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:58.980869 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff65038-97e5-48e3-9874-0e5db775c850 None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:58.981161 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff65038-97e5-48e3-9874-0e5db775c850 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:58.981449 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff65038-97e5-48e3-9874-0e5db775c850 None admin] PATH_INFO: `/v3/projects/e7eff2725d90448aaf1b1dc5e791bd90/users/b4287006dc2145adb045a433972123e5/roles/76578c4e1dbb4559b293fb93830ed5b2` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:58.984422 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff65038-97e5-48e3-9874-0e5db775c850 None admin] RBAC: Authorizing `identity:create_grant(project_id=e7eff2725d90448aaf1b1dc5e791bd90, user_id=b4287006dc2145adb045a433972123e5, role_id=76578c4e1dbb4559b293fb93830ed5b2)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:58.985920 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff65038-97e5-48e3-9874-0e5db775c850 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:59.022589 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f1849-00ce-4f50-867e-771183749be9 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:59.028724 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 67/133] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 03:29:58 2022] PUT /identity/v3/projects/e7eff2725d90448aaf1b1dc5e791bd90/users/b4287006dc2145adb045a433972123e5/roles/76578c4e1dbb4559b293fb93830ed5b2 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:29:59.030057 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7bd27-ec0c-4eb7-901f-7bfa5a313c3f None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:59.030349 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7bd27-ec0c-4eb7-901f-7bfa5a313c3f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:59.030652 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7bd27-ec0c-4eb7-901f-7bfa5a313c3f None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:59.031912 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 68/134] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:29:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:29:59.039131 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4643f0-efff-4124-a7d4-3dd5fd84b52b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:59.039964 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4643f0-efff-4124-a7d4-3dd5fd84b52b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:59.040257 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4643f0-efff-4124-a7d4-3dd5fd84b52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:59.077794 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-db4643f0-efff-4124-a7d4-3dd5fd84b52b None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:29:59.079063 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-db4643f0-efff-4124-a7d4-3dd5fd84b52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:29:59.086279 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ad4c2-e917-4b5a-a8a4-4a660a1c72e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:59.087004 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ad4c2-e917-4b5a-a8a4-4a660a1c72e1 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:59.087297 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ad4c2-e917-4b5a-a8a4-4a660a1c72e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:59.087577 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ad4c2-e917-4b5a-a8a4-4a660a1c72e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:59.088347 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ad4c2-e917-4b5a-a8a4-4a660a1c72e1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:29:59.088660 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ad4c2-e917-4b5a-a8a4-4a660a1c72e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:59.092915 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ad4c2-e917-4b5a-a8a4-4a660a1c72e1 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:59.110259 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 67/135] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 03:29:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:29:59.121222 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ad4c2-e917-4b5a-a8a4-4a660a1c72e1 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:59.159521 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:59.229635 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 69/136] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:29:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 03:29:59.253974 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ad4c2-e917-4b5a-a8a4-4a660a1c72e1 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:59.291174 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4643f0-efff-4124-a7d4-3dd5fd84b52b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:59.293103 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e1e16-f5e8-4190-96fa-2c1a11bafd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:59.294306 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e1e16-f5e8-4190-96fa-2c1a11bafd37 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:59.294631 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e1e16-f5e8-4190-96fa-2c1a11bafd37 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:59.294917 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1e1e16-f5e8-4190-96fa-2c1a11bafd37 None admin] PATH_INFO: `/v3/users/b4287006dc2145adb045a433972123e5` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:59.297263 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1e1e16-f5e8-4190-96fa-2c1a11bafd37 None admin] RBAC: Authorizing `identity:get_user(user_id=b4287006dc2145adb045a433972123e5)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:59.298773 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1e1e16-f5e8-4190-96fa-2c1a11bafd37 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:59.300770 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 68/137] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:29:59 2022] GET /identity/v3/users/b4287006dc2145adb045a433972123e5 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:29:59.307549 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e1e16-f5e8-4190-96fa-2c1a11bafd37 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:59.426792 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:59.430324 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1e1e16-f5e8-4190-96fa-2c1a11bafd37 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:59.487763 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266389a-8631-4c8d-b667-c39fad75d646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:59.488637 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266389a-8631-4c8d-b667-c39fad75d646 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:59.488929 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266389a-8631-4c8d-b667-c39fad75d646 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:59.490390 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266389a-8631-4c8d-b667-c39fad75d646 None admin] PATH_INFO: `/v3/projects/ff08f0da218547168d61280850305f5d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:59.492406 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6266389a-8631-4c8d-b667-c39fad75d646 None admin] RBAC: Authorizing `identity:get_project(project_id=ff08f0da218547168d61280850305f5d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:59.493870 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6266389a-8631-4c8d-b667-c39fad75d646 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:59.496696 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 69/138] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:29:59 2022] GET /identity/v3/projects/ff08f0da218547168d61280850305f5d => generated 312 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:29:59.498586 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4643f0-efff-4124-a7d4-3dd5fd84b52b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:59.501740 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266389a-8631-4c8d-b667-c39fad75d646 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:59.530971 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:29:59.563463 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc359f2e-8d75-461a-8e79-ae9ad82053b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:59.564269 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc359f2e-8d75-461a-8e79-ae9ad82053b7 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:59.564553 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc359f2e-8d75-461a-8e79-ae9ad82053b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:59.564829 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc359f2e-8d75-461a-8e79-ae9ad82053b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:59.570633 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc359f2e-8d75-461a-8e79-ae9ad82053b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:59.572118 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc359f2e-8d75-461a-8e79-ae9ad82053b7 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:59.573789 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 70/139] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:29:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:29:59.582019 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc359f2e-8d75-461a-8e79-ae9ad82053b7 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:29:59.686556 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266389a-8631-4c8d-b667-c39fad75d646 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:59.759701 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab5ebf-45e7-418a-9114-0406ce1ff7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:59.760617 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab5ebf-45e7-418a-9114-0406ce1ff7fa None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:59.760902 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab5ebf-45e7-418a-9114-0406ce1ff7fa None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:59.761181 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab5ebf-45e7-418a-9114-0406ce1ff7fa None admin] PATH_INFO: `/v3/projects/ff08f0da218547168d61280850305f5d/users/b4287006dc2145adb045a433972123e5/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:59.763752 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc359f2e-8d75-461a-8e79-ae9ad82053b7 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:29:59.767093 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab5ebf-45e7-418a-9114-0406ce1ff7fa None admin] RBAC: Authorizing `identity:create_grant(project_id=ff08f0da218547168d61280850305f5d, user_id=b4287006dc2145adb045a433972123e5, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:59.768545 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ab5ebf-45e7-418a-9114-0406ce1ff7fa None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:59.791461 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 70/140] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 03:29:59 2022] PUT /identity/v3/projects/ff08f0da218547168d61280850305f5d/users/b4287006dc2145adb045a433972123e5/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:29:59.812233 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec295d0-99aa-4e07-9b71-30c34b161218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:29:59.812990 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec295d0-99aa-4e07-9b71-30c34b161218 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:29:59.813284 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec295d0-99aa-4e07-9b71-30c34b161218 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:29:59.813568 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec295d0-99aa-4e07-9b71-30c34b161218 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:29:59.814373 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec295d0-99aa-4e07-9b71-30c34b161218 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:29:59.815966 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec295d0-99aa-4e07-9b71-30c34b161218 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:29:59.859225 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 71/141] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jul 21 03:29:59 2022] POST /identity/v3/users => generated 283 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:30:00.027302 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a15b43-85ac-4472-befc-014739a62086 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:00.027302 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a15b43-85ac-4472-befc-014739a62086 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:00.027302 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a15b43-85ac-4472-befc-014739a62086 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:00.027302 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 71/142] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:00.033362 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a412d68-b338-4f17-83c0-ddfb0f6b60c4 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:00.033895 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a412d68-b338-4f17-83c0-ddfb0f6b60c4 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:00.034380 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a412d68-b338-4f17-83c0-ddfb0f6b60c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:00.053363 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-8a412d68-b338-4f17-83c0-ddfb0f6b60c4 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:00.055627 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8a412d68-b338-4f17-83c0-ddfb0f6b60c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:00.097540 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:00.137941 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 72/143] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:30:00.163122 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a15b43-85ac-4472-befc-014739a62086 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:00.193702 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:00.273099 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a15b43-85ac-4472-befc-014739a62086 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:00.308885 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a2126-1e0a-428f-9d89-6f849b88f8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:00.309611 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a2126-1e0a-428f-9d89-6f849b88f8cc None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:00.309900 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a2126-1e0a-428f-9d89-6f849b88f8cc None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:00.310187 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a2126-1e0a-428f-9d89-6f849b88f8cc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:00.321491 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a2126-1e0a-428f-9d89-6f849b88f8cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:00.329365 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-120a2126-1e0a-428f-9d89-6f849b88f8cc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 03:30:00.329365 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:00.329365 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:00.329365 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:00.329365 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:00.329365 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:00.329365 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:00.329365 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:00.329365 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:00.329365 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:00.329365 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:00.329365 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:00.329365 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:00.329365 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:00.329365 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:00.329365 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:00.330962 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:00.330962 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:00.330962 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:00.330962 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:00.330962 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:00.330962 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:00.330962 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:00.330962 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:00.330962 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:00.330962 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:00.330962 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:00.330962 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:00.330962 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:00.330962 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:00.330962 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:00.330962 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:00.332052 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:00.332052 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:00.332052 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:00.332052 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:00.332052 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:00.332052 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:00.332052 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:00.332052 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:00.332052 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:00.332052 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:00.332052 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 03:30:00.332052 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:00.332052 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 72/144] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:30:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:00.336866 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a412d68-b338-4f17-83c0-ddfb0f6b60c4 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:00.448146 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a412d68-b338-4f17-83c0-ddfb0f6b60c4 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:00.486538 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0b9a3-6388-4d31-8f0f-a1fb9d845748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:00.487225 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0b9a3-6388-4d31-8f0f-a1fb9d845748 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:00.487515 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0b9a3-6388-4d31-8f0f-a1fb9d845748 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:00.487798 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0b9a3-6388-4d31-8f0f-a1fb9d845748 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:00.488559 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae0b9a3-6388-4d31-8f0f-a1fb9d845748 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:00.488873 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae0b9a3-6388-4d31-8f0f-a1fb9d845748 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:00.490286 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae0b9a3-6388-4d31-8f0f-a1fb9d845748 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:00.499781 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 73/145] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 03:30:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:00.511557 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a2126-1e0a-428f-9d89-6f849b88f8cc None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:00.622425 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:00.644074 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a2126-1e0a-428f-9d89-6f849b88f8cc None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:00.683521 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b6b82-8150-4afa-962c-1cd96ab090ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:00.684419 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b6b82-8150-4afa-962c-1cd96ab090ef None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:00.684711 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b6b82-8150-4afa-962c-1cd96ab090ef None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:00.685002 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b6b82-8150-4afa-962c-1cd96ab090ef None admin] PATH_INFO: `/v3/users/0fdeb152d5d1494fb09a286cbbbbe0cc` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:00.686228 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b6b82-8150-4afa-962c-1cd96ab090ef None admin] RBAC: Authorizing `identity:get_user(user_id=0fdeb152d5d1494fb09a286cbbbbe0cc)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:00.687837 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2b6b82-8150-4afa-962c-1cd96ab090ef None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:00.689491 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 73/146] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:30:00 2022] GET /identity/v3/users/0fdeb152d5d1494fb09a286cbbbbe0cc => generated 289 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:00.695911 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0b9a3-6388-4d31-8f0f-a1fb9d845748 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:00.744016 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:00.825110 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae0b9a3-6388-4d31-8f0f-a1fb9d845748 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:00.877271 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b97ae-f6af-4e05-a675-3503ca251034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:00.878604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b97ae-f6af-4e05-a675-3503ca251034 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:00.879037 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b97ae-f6af-4e05-a675-3503ca251034 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:00.879455 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b97ae-f6af-4e05-a675-3503ca251034 None admin] PATH_INFO: `/v3/projects/e7eff2725d90448aaf1b1dc5e791bd90` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:00.881313 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b97ae-f6af-4e05-a675-3503ca251034 None admin] RBAC: Authorizing `identity:get_project(project_id=e7eff2725d90448aaf1b1dc5e791bd90)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:00.883735 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b97ae-f6af-4e05-a675-3503ca251034 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:00.888950 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 74/147] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:30:00 2022] GET /identity/v3/projects/e7eff2725d90448aaf1b1dc5e791bd90 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:00.895628 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b6b82-8150-4afa-962c-1cd96ab090ef None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:01.054653 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b6b82-8150-4afa-962c-1cd96ab090ef None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:01.106112 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f27725-791e-40ea-a1b6-2564bdfa08f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:01.107422 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f27725-791e-40ea-a1b6-2564bdfa08f8 None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:01.107934 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f27725-791e-40ea-a1b6-2564bdfa08f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:01.108413 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f27725-791e-40ea-a1b6-2564bdfa08f8 None admin] PATH_INFO: `/v3/projects/e7eff2725d90448aaf1b1dc5e791bd90/users/0fdeb152d5d1494fb09a286cbbbbe0cc/roles/8670c500985c4abea21f372ef30378a6` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:01.110726 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f27725-791e-40ea-a1b6-2564bdfa08f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=e7eff2725d90448aaf1b1dc5e791bd90, user_id=0fdeb152d5d1494fb09a286cbbbbe0cc, role_id=8670c500985c4abea21f372ef30378a6)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:01.112403 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f27725-791e-40ea-a1b6-2564bdfa08f8 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:01.130102 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 74/148] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 03:30:00 2022] PUT /identity/v3/projects/e7eff2725d90448aaf1b1dc5e791bd90/users/0fdeb152d5d1494fb09a286cbbbbe0cc/roles/8670c500985c4abea21f372ef30378a6 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:30:01.397882 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9c41f-9c08-4962-9dcf-b85b9dc797a1 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:01.398232 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9c41f-9c08-4962-9dcf-b85b9dc797a1 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:01.398345 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9c41f-9c08-4962-9dcf-b85b9dc797a1 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:01.400473 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 75/149] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:01.405779 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ce4e9-723f-4da7-8bca-7756d1e55da3 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:01.406364 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ce4e9-723f-4da7-8bca-7756d1e55da3 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:01.406881 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ce4e9-723f-4da7-8bca-7756d1e55da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:01.428455 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b17ce4e9-723f-4da7-8bca-7756d1e55da3 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:01.430011 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b17ce4e9-723f-4da7-8bca-7756d1e55da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:01.442118 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:01.515795 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 75/150] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:30:01.555314 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9c41f-9c08-4962-9dcf-b85b9dc797a1 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:01.680696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd9c41f-9c08-4962-9dcf-b85b9dc797a1 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:01.682203 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:01.726581 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5dfafe-b9ca-423e-bf85-a1f618676c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:01.727425 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5dfafe-b9ca-423e-bf85-a1f618676c86 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:01.727706 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5dfafe-b9ca-423e-bf85-a1f618676c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:01.727982 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5dfafe-b9ca-423e-bf85-a1f618676c86 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:01.740661 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5dfafe-b9ca-423e-bf85-a1f618676c86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:01.748821 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-ca5dfafe-b9ca-423e-bf85-a1f618676c86 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 03:30:01.748821 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:01.748821 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:01.748821 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:01.748821 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:01.748821 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:01.748821 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:01.748821 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:01.748821 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:01.748821 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:01.748821 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:01.748821 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:01.748821 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:01.748821 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:01.748821 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:01.748821 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:01.749675 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:01.749675 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:01.749675 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:01.749675 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:01.749675 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:01.749675 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:01.749675 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:01.749675 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:01.749675 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:01.749675 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:01.749675 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:01.749675 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:01.749675 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:01.749675 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:01.749675 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:01.749675 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:01.750566 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:01.750566 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:01.750566 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:01.750566 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:01.750566 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:01.750566 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:01.750566 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:01.750566 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:01.750566 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:01.750566 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:01.750566 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 03:30:01.750566 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:30:01.750566 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 76/151] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:30:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:01.759611 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ce4e9-723f-4da7-8bca-7756d1e55da3 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:01.916126 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ce4e9-723f-4da7-8bca-7756d1e55da3 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:01.959105 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b0340-49a5-4783-aa2c-601ec7c16b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:01.959701 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b0340-49a5-4783-aa2c-601ec7c16b2d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:01.959989 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b0340-49a5-4783-aa2c-601ec7c16b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:01.960267 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b0340-49a5-4783-aa2c-601ec7c16b2d None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:01.961059 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287b0340-49a5-4783-aa2c-601ec7c16b2d None admin] RBAC: Adding query filter params (name=member) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:01.961369 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287b0340-49a5-4783-aa2c-601ec7c16b2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:01.962772 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287b0340-49a5-4783-aa2c-601ec7c16b2d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:01.973947 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 76/152] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 03:30:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:01.980206 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5dfafe-b9ca-423e-bf85-a1f618676c86 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:02.121736 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5dfafe-b9ca-423e-bf85-a1f618676c86 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:02.161833 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccd497a-eb5f-49dd-b934-d859834ac2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:02.162746 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd497a-eb5f-49dd-b934-d859834ac2e9 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:02.163029 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd497a-eb5f-49dd-b934-d859834ac2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:02.163301 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd497a-eb5f-49dd-b934-d859834ac2e9 None admin] PATH_INFO: `/v3/users/b4287006dc2145adb045a433972123e5` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:02.165030 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd497a-eb5f-49dd-b934-d859834ac2e9 None admin] RBAC: Authorizing `identity:get_user(user_id=b4287006dc2145adb045a433972123e5)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:02.166537 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd497a-eb5f-49dd-b934-d859834ac2e9 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:02.168538 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 77/153] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:30:01 2022] GET /identity/v3/users/b4287006dc2145adb045a433972123e5 => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:02.175583 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b0340-49a5-4783-aa2c-601ec7c16b2d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:02.194813 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:02.285077 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7436d-fa15-41fb-90e6-a3ba76971a6a None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:02.285364 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7436d-fa15-41fb-90e6-a3ba76971a6a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:02.285551 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7436d-fa15-41fb-90e6-a3ba76971a6a None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:02.286954 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 78/154] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:02.292731 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92af4c1-ab03-4760-b24a-90de429769af None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:02.292999 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92af4c1-ab03-4760-b24a-90de429769af None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:02.293292 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92af4c1-ab03-4760-b24a-90de429769af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:02.322119 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d92af4c1-ab03-4760-b24a-90de429769af None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:02.323398 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d92af4c1-ab03-4760-b24a-90de429769af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:02.325509 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b0340-49a5-4783-aa2c-601ec7c16b2d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:02.369143 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:02.419768 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5356b9f-1d3b-476f-9914-8e54e4209034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:02.420455 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5356b9f-1d3b-476f-9914-8e54e4209034 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:02.420747 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5356b9f-1d3b-476f-9914-8e54e4209034 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:02.421031 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5356b9f-1d3b-476f-9914-8e54e4209034 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:02.456960 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 79/155] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 03:30:02.496293 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92af4c1-ab03-4760-b24a-90de429769af None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:02.551851 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5356b9f-1d3b-476f-9914-8e54e4209034 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:02.553253 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5356b9f-1d3b-476f-9914-8e54e4209034 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:02.565631 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:02.644359 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92af4c1-ab03-4760-b24a-90de429769af None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:02.683742 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563615c7-2ec0-40bb-af47-4254827562b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:02.684545 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563615c7-2ec0-40bb-af47-4254827562b9 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:02.684826 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563615c7-2ec0-40bb-af47-4254827562b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:02.685099 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563615c7-2ec0-40bb-af47-4254827562b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:02.703713 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563615c7-2ec0-40bb-af47-4254827562b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:02.718015 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-563615c7-2ec0-40bb-af47-4254827562b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:30:02.718015 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:02.718015 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:02.718015 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:02.718015 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:02.718015 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:02.718015 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:02.718015 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:02.718015 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:02.718015 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:02.718015 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:02.718015 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:02.718015 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:02.718015 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:02.718015 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:02.718015 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:02.719056 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:02.719056 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:02.719056 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:02.719056 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:02.719056 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:02.719056 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:02.719056 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:02.719056 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:02.719056 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:02.719056 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:02.719056 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:02.719056 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:02.719056 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:02.719056 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:02.719056 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:02.719056 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:02.719917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:02.719917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:02.719917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:02.719917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:02.719917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:02.719917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:02.719917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:02.719917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:02.719917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:02.719917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:02.719917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:30:02.719917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:30:02.727612 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 80/156] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 03:30:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:30:02.728813 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d433f4-0c79-48cb-a831-46c29204c422 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:02.729104 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d433f4-0c79-48cb-a831-46c29204c422 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:02.729385 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d433f4-0c79-48cb-a831-46c29204c422 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:02.731332 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 81/157] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:02.735740 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d433f4-0c79-48cb-a831-46c29204c422 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:02.779239 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 77/158] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:30:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 03:30:02.780778 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7867449-e2a0-443f-bddf-ff688c83b01f None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:02.781303 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7867449-e2a0-443f-bddf-ff688c83b01f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:02.781620 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7867449-e2a0-443f-bddf-ff688c83b01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:02.797962 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:02.817018 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e7867449-e2a0-443f-bddf-ff688c83b01f None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:02.818124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e7867449-e2a0-443f-bddf-ff688c83b01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:02.941671 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 78/159] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:30:02.944427 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7867449-e2a0-443f-bddf-ff688c83b01f None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:03.014393 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:03.028047 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d433f4-0c79-48cb-a831-46c29204c422 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:03.083073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80648f83-2dca-4a60-8f84-67de74136c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:03.083662 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80648f83-2dca-4a60-8f84-67de74136c6b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:03.083946 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80648f83-2dca-4a60-8f84-67de74136c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:03.084216 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80648f83-2dca-4a60-8f84-67de74136c6b None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:03.084961 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80648f83-2dca-4a60-8f84-67de74136c6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:03.085269 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80648f83-2dca-4a60-8f84-67de74136c6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:03.087248 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80648f83-2dca-4a60-8f84-67de74136c6b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:03.096735 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 82/160] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:30:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:30:03.097516 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80648f83-2dca-4a60-8f84-67de74136c6b None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:03.145051 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7867449-e2a0-443f-bddf-ff688c83b01f None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:03.233723 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c600fbe-e4ce-44c8-9cca-dc9c6ecfe4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:03.235147 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c600fbe-e4ce-44c8-9cca-dc9c6ecfe4ed None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:03.235147 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c600fbe-e4ce-44c8-9cca-dc9c6ecfe4ed None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:03.235147 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c600fbe-e4ce-44c8-9cca-dc9c6ecfe4ed None admin] PATH_INFO: `/v3/projects/e7eff2725d90448aaf1b1dc5e791bd90` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:03.242055 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c600fbe-e4ce-44c8-9cca-dc9c6ecfe4ed None admin] RBAC: Authorizing `identity:get_project(project_id=e7eff2725d90448aaf1b1dc5e791bd90)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:03.242055 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c600fbe-e4ce-44c8-9cca-dc9c6ecfe4ed None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:03.242055 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 79/161] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:30:02 2022] GET /identity/v3/projects/e7eff2725d90448aaf1b1dc5e791bd90 => generated 298 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:03.252321 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c600fbe-e4ce-44c8-9cca-dc9c6ecfe4ed None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:03.291743 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:03.328432 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80648f83-2dca-4a60-8f84-67de74136c6b None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:03.390427 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ffde3b-2e52-46f3-a040-41e4e85e1b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:03.391398 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffde3b-2e52-46f3-a040-41e4e85e1b75 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:03.391743 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffde3b-2e52-46f3-a040-41e4e85e1b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:03.392092 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffde3b-2e52-46f3-a040-41e4e85e1b75 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:03.405900 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ffde3b-2e52-46f3-a040-41e4e85e1b75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:03.414225 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-99ffde3b-2e52-46f3-a040-41e4e85e1b75 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 03:30:03.414225 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:03.414225 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:03.414225 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:03.414225 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:03.414225 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:03.414225 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:03.414225 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:03.414225 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:03.414225 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:03.414225 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:03.414225 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:03.414225 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:03.414225 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:03.414225 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:03.414225 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:03.415127 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:03.415127 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:03.415127 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:03.415127 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:03.415127 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:03.415127 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:03.415127 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:03.415127 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:03.415127 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:03.415127 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:03.415127 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:03.415127 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:03.415127 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:03.415127 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:03.415127 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:03.415127 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:03.415968 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:03.415968 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:03.415968 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:03.415968 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:03.415968 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:03.415968 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:03.415968 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:03.415968 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:03.415968 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:03.415968 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:03.415968 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 03:30:03.415968 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:30:03.418021 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 83/162] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jul 21 03:30:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:03.418824 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ffde3b-2e52-46f3-a040-41e4e85e1b75 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:03.456422 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c600fbe-e4ce-44c8-9cca-dc9c6ecfe4ed None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:03.474095 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:03.531753 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43c503-0478-4b2a-b58b-11f086747748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:03.532648 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43c503-0478-4b2a-b58b-11f086747748 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:03.532929 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43c503-0478-4b2a-b58b-11f086747748 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:03.533200 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43c503-0478-4b2a-b58b-11f086747748 None admin] PATH_INFO: `/v3/users/eec6b06f7801471e932e859de1190593` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:03.534431 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af43c503-0478-4b2a-b58b-11f086747748 None admin] RBAC: Authorizing `identity:get_user(user_id=eec6b06f7801471e932e859de1190593)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:03.535903 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af43c503-0478-4b2a-b58b-11f086747748 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:03.537560 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 80/163] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:30:03 2022] GET /identity/v3/users/eec6b06f7801471e932e859de1190593 => generated 247 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:03.538312 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43c503-0478-4b2a-b58b-11f086747748 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:03.585716 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ffde3b-2e52-46f3-a040-41e4e85e1b75 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:03.647239 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30d884-035b-4951-9015-800bce643942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:03.647833 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30d884-035b-4951-9015-800bce643942 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:03.648120 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30d884-035b-4951-9015-800bce643942 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:03.648386 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30d884-035b-4951-9015-800bce643942 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:03.650602 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e30d884-035b-4951-9015-800bce643942 None admin] RBAC: Adding query filter params (role.id=1ac721157e9b40f18cbbc76f5a6b0d3d, scope.project.id=e7eff2725d90448aaf1b1dc5e791bd90, user.id=b4287006dc2145adb045a433972123e5) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:03.650602 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e30d884-035b-4951-9015-800bce643942 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:03.651084 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e30d884-035b-4951-9015-800bce643942 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:03.670564 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 84/164] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:30:03 2022] GET /identity/v3/role_assignments?user.id=b4287006dc2145adb045a433972123e5&scope.project.id=e7eff2725d90448aaf1b1dc5e791bd90&role.id=1ac721157e9b40f18cbbc76f5a6b0d3d => generated 608 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:03.670564 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30d884-035b-4951-9015-800bce643942 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:03.688042 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:03.770600 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43c503-0478-4b2a-b58b-11f086747748 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:03.863987 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130dbea-1f85-4612-8eb7-94cf36d6ad55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:03.864678 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130dbea-1f85-4612-8eb7-94cf36d6ad55 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:03.864965 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130dbea-1f85-4612-8eb7-94cf36d6ad55 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:03.865241 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b130dbea-1f85-4612-8eb7-94cf36d6ad55 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:03.866017 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b130dbea-1f85-4612-8eb7-94cf36d6ad55 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:03.866318 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b130dbea-1f85-4612-8eb7-94cf36d6ad55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:03.868013 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b130dbea-1f85-4612-8eb7-94cf36d6ad55 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:03.891073 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 81/165] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:30:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:03.897096 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130dbea-1f85-4612-8eb7-94cf36d6ad55 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:03.947446 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30d884-035b-4951-9015-800bce643942 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:03.949350 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:04.026971 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b130dbea-1f85-4612-8eb7-94cf36d6ad55 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:04.048785 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56687b29-1009-428a-9666-af7aef9d2906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:04.049860 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56687b29-1009-428a-9666-af7aef9d2906 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:04.050379 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56687b29-1009-428a-9666-af7aef9d2906 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:04.050885 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56687b29-1009-428a-9666-af7aef9d2906 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:04.066487 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c65ca-a6e5-420e-858e-b2b16396a309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:04.066487 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c65ca-a6e5-420e-858e-b2b16396a309 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:04.066487 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c65ca-a6e5-420e-858e-b2b16396a309 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:04.066487 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c65ca-a6e5-420e-858e-b2b16396a309 None admin] PATH_INFO: `/v3/users/b4287006dc2145adb045a433972123e5` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:04.066897 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c65ca-a6e5-420e-858e-b2b16396a309 None admin] RBAC: Authorizing `identity:get_user(user_id=b4287006dc2145adb045a433972123e5)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:04.067835 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c65ca-a6e5-420e-858e-b2b16396a309 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:04.069846 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 82/166] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:30:03 2022] GET /identity/v3/users/b4287006dc2145adb045a433972123e5 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:04.071191 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd97fb6-ebd3-45c4-bfb2-961d8674744e None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:04.071475 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd97fb6-ebd3-45c4-bfb2-961d8674744e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:04.071750 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd97fb6-ebd3-45c4-bfb2-961d8674744e None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:04.073006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 83/167] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:04.077965 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd97fb6-ebd3-45c4-bfb2-961d8674744e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:04.186817 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd97fb6-ebd3-45c4-bfb2-961d8674744e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:04.188507 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:04.202236 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56687b29-1009-428a-9666-af7aef9d2906 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:04.204125 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56687b29-1009-428a-9666-af7aef9d2906 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:04.217541 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:04.227495 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08644e3d-0b24-4f00-899f-867fb3c42dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:04.228325 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08644e3d-0b24-4f00-899f-867fb3c42dc2 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:04.228751 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08644e3d-0b24-4f00-899f-867fb3c42dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:04.229035 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08644e3d-0b24-4f00-899f-867fb3c42dc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:04.308466 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08644e3d-0b24-4f00-899f-867fb3c42dc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:04.309965 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08644e3d-0b24-4f00-899f-867fb3c42dc2 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:04.392850 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 85/168] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:30:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 726 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 03:30:04.393994 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd4e11-a547-4073-8492-17bb6fb63a56 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:04.394338 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd4e11-a547-4073-8492-17bb6fb63a56 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:04.398388 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd4e11-a547-4073-8492-17bb6fb63a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:04.413793 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 84/169] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:30:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 03:30:04.415260 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18688784-61bd-4545-9ee6-b2695e38ca39 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:04.415562 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18688784-61bd-4545-9ee6-b2695e38ca39 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:04.415841 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18688784-61bd-4545-9ee6-b2695e38ca39 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:04.417115 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 85/170] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:04.417809 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18688784-61bd-4545-9ee6-b2695e38ca39 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:04.435882 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-87cd4e11-a547-4073-8492-17bb6fb63a56 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:04.437101 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-87cd4e11-a547-4073-8492-17bb6fb63a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:04.446825 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:04.525288 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18688784-61bd-4545-9ee6-b2695e38ca39 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:04.560541 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e643a4-15ea-4704-bfd3-d115876731a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:04.561007 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 86/171] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:30:04.561698 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e643a4-15ea-4704-bfd3-d115876731a2 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:04.561979 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e643a4-15ea-4704-bfd3-d115876731a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:04.562261 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e643a4-15ea-4704-bfd3-d115876731a2 None admin] PATH_INFO: `/v3/projects/e7eff2725d90448aaf1b1dc5e791bd90` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:04.562360 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376db360-00b3-4e77-a29a-4b8bdcf2f265 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:04.562656 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376db360-00b3-4e77-a29a-4b8bdcf2f265 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:04.562936 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376db360-00b3-4e77-a29a-4b8bdcf2f265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:04.569609 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e643a4-15ea-4704-bfd3-d115876731a2 None admin] RBAC: Authorizing `identity:get_project(project_id=e7eff2725d90448aaf1b1dc5e791bd90)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:04.571606 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e643a4-15ea-4704-bfd3-d115876731a2 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:04.573441 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 86/172] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:30:04 2022] GET /identity/v3/projects/e7eff2725d90448aaf1b1dc5e791bd90 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:04.574197 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e643a4-15ea-4704-bfd3-d115876731a2 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:04.592406 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-376db360-00b3-4e77-a29a-4b8bdcf2f265 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:04.593692 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-376db360-00b3-4e77-a29a-4b8bdcf2f265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:04.660133 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:04.671409 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:04.702484 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e643a4-15ea-4704-bfd3-d115876731a2 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:04.734946 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 87/173] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:30:04.737154 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376db360-00b3-4e77-a29a-4b8bdcf2f265 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:04.770215 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e3d241-084d-4cba-8696-f623aada177b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:04.771114 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3d241-084d-4cba-8696-f623aada177b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:04.771889 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3d241-084d-4cba-8696-f623aada177b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:04.771889 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3d241-084d-4cba-8696-f623aada177b None admin] PATH_INFO: `/v3/projects/e7eff2725d90448aaf1b1dc5e791bd90` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:04.775904 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e3d241-084d-4cba-8696-f623aada177b None admin] RBAC: Authorizing `identity:get_project(project_id=e7eff2725d90448aaf1b1dc5e791bd90)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:04.777289 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e3d241-084d-4cba-8696-f623aada177b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:04.779046 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 87/174] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:30:04 2022] GET /identity/v3/projects/e7eff2725d90448aaf1b1dc5e791bd90 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:04.780942 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e3d241-084d-4cba-8696-f623aada177b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:04.884260 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376db360-00b3-4e77-a29a-4b8bdcf2f265 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:04.920462 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ae1bc-6385-4ba8-8e66-c6f502692b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:04.921176 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ae1bc-6385-4ba8-8e66-c6f502692b58 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:04.921468 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ae1bc-6385-4ba8-8e66-c6f502692b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:04.921755 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ae1bc-6385-4ba8-8e66-c6f502692b58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:04.922647 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ae1bc-6385-4ba8-8e66-c6f502692b58 None admin] RBAC: Adding query filter params (role.id=27e53d6c56f24c25a8c8057bfd36bcf1, scope.project.id=e7eff2725d90448aaf1b1dc5e791bd90, user.id=eec6b06f7801471e932e859de1190593) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:04.922965 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ae1bc-6385-4ba8-8e66-c6f502692b58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:04.924429 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ae1bc-6385-4ba8-8e66-c6f502692b58 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:04.925871 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e3d241-084d-4cba-8696-f623aada177b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:04.931252 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 88/175] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:30:04 2022] GET /identity/v3/role_assignments?user.id=eec6b06f7801471e932e859de1190593&scope.project.id=e7eff2725d90448aaf1b1dc5e791bd90&role.id=27e53d6c56f24c25a8c8057bfd36bcf1 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:04.932071 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ae1bc-6385-4ba8-8e66-c6f502692b58 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:04.965056 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bafe7-30b1-4e40-81cf-2929b6a5a53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:04.966230 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bafe7-30b1-4e40-81cf-2929b6a5a53a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:04.966740 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bafe7-30b1-4e40-81cf-2929b6a5a53a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:04.967209 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bafe7-30b1-4e40-81cf-2929b6a5a53a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:04.979092 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:04.981594 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:04.989009 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0bafe7-30b1-4e40-81cf-2929b6a5a53a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:05.000172 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-6d0bafe7-30b1-4e40-81cf-2929b6a5a53a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 03:30:05.000172 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:05.000172 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:05.000172 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:05.000172 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:05.000172 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:05.000172 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:05.000172 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:05.000172 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:05.000172 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:05.000172 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:05.000172 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:05.000172 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:05.000172 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:05.000172 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:05.000172 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:05.001124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:05.001124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:05.001124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:05.001124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:05.001124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:05.001124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:05.001124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:05.001124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:05.001124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:05.001124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:05.001124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:05.001124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:05.001124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:05.001124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:05.001124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:05.001124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:05.001915 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:05.001915 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:05.001915 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:05.001915 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:05.001915 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:05.001915 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:05.001915 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:05.001915 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:05.001915 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:05.001915 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:05.001915 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 03:30:05.001915 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:05.001915 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 88/176] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:30:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:05.006487 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bafe7-30b1-4e40-81cf-2929b6a5a53a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:05.111961 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ae1bc-6385-4ba8-8e66-c6f502692b58 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:05.151580 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe43881e-0846-474a-ba1b-0065a942d8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:05.152756 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43881e-0846-474a-ba1b-0065a942d8fc None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:05.153268 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43881e-0846-474a-ba1b-0065a942d8fc None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:05.153755 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43881e-0846-474a-ba1b-0065a942d8fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:05.175855 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe43881e-0846-474a-ba1b-0065a942d8fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:05.184505 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-fe43881e-0846-474a-ba1b-0065a942d8fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:30:05.184505 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:05.184505 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:05.184505 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:05.184505 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:05.184505 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:05.184505 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:05.184505 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:05.184505 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:05.184505 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:05.184505 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:05.184505 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:05.184505 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:05.184505 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:05.184505 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:05.184505 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:05.185449 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:05.185449 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:05.185449 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:05.185449 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:05.185449 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:05.185449 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:05.185449 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:05.185449 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:05.185449 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:05.185449 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:05.185449 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:05.185449 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:05.185449 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:05.185449 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:05.185449 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:05.185449 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:05.186222 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:05.186222 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:05.186222 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:05.186222 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:05.186222 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:05.186222 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:05.186222 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:05.186222 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:05.186222 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:05.186222 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:05.186222 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:30:05.186222 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:30:05.187599 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 89/177] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 03:30:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:05.190622 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60c0ef-0355-416c-819c-238f0b7c5991 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:05.190622 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60c0ef-0355-416c-819c-238f0b7c5991 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:05.190622 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60c0ef-0355-416c-819c-238f0b7c5991 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:05.190622 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 90/178] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:05.191321 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f60c0ef-0355-416c-819c-238f0b7c5991 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:05.202071 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bafe7-30b1-4e40-81cf-2929b6a5a53a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:05.250225 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d8b7f-b67e-4545-b6bb-cd0cbaba03a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:05.251292 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d8b7f-b67e-4545-b6bb-cd0cbaba03a1 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:05.251949 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d8b7f-b67e-4545-b6bb-cd0cbaba03a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:05.252880 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d8b7f-b67e-4545-b6bb-cd0cbaba03a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:05.254185 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d8b7f-b67e-4545-b6bb-cd0cbaba03a1 None admin] RBAC: Adding query filter params (role.id=76578c4e1dbb4559b293fb93830ed5b2, scope.project.id=e7eff2725d90448aaf1b1dc5e791bd90, user.id=b4287006dc2145adb045a433972123e5) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:05.254721 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d8b7f-b67e-4545-b6bb-cd0cbaba03a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:05.257056 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d8b7f-b67e-4545-b6bb-cd0cbaba03a1 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:05.264605 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 89/179] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:30:05 2022] GET /identity/v3/role_assignments?user.id=b4287006dc2145adb045a433972123e5&scope.project.id=e7eff2725d90448aaf1b1dc5e791bd90&role.id=76578c4e1dbb4559b293fb93830ed5b2 => generated 608 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:05.266115 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d8b7f-b67e-4545-b6bb-cd0cbaba03a1 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:05.354808 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:05.366956 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:05.372520 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f60c0ef-0355-416c-819c-238f0b7c5991 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:05.425723 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d8b7f-b67e-4545-b6bb-cd0cbaba03a1 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:05.426740 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5a242-cd83-4134-9722-e39c180170af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:05.427939 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5a242-cd83-4134-9722-e39c180170af None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:05.429345 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5a242-cd83-4134-9722-e39c180170af None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:05.430007 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5a242-cd83-4134-9722-e39c180170af None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:05.431018 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd5a242-cd83-4134-9722-e39c180170af None admin] RBAC: Adding query filter params (name=member) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:05.431585 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd5a242-cd83-4134-9722-e39c180170af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:05.433248 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd5a242-cd83-4134-9722-e39c180170af None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:05.445113 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 91/180] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 03:30:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:05.451182 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce61cb-db72-4a52-9192-abcf14628f64 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:05.451476 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce61cb-db72-4a52-9192-abcf14628f64 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:05.451764 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce61cb-db72-4a52-9192-abcf14628f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:05.463890 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b031d60-62e2-4a97-bc0a-42d586a1453f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:05.464667 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b031d60-62e2-4a97-bc0a-42d586a1453f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:05.464957 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b031d60-62e2-4a97-bc0a-42d586a1453f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:05.466500 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b031d60-62e2-4a97-bc0a-42d586a1453f None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:05.466500 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b031d60-62e2-4a97-bc0a-42d586a1453f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:05.466500 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b031d60-62e2-4a97-bc0a-42d586a1453f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:05.467717 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b031d60-62e2-4a97-bc0a-42d586a1453f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:05.469688 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-afce61cb-db72-4a52-9192-abcf14628f64 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:05.470923 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-afce61cb-db72-4a52-9192-abcf14628f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:05.478182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 90/181] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:30:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:05.479609 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbf57c-e38d-4460-9c46-3c792874249a None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:05.479856 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbf57c-e38d-4460-9c46-3c792874249a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:05.480134 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbf57c-e38d-4460-9c46-3c792874249a None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:05.481401 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 91/182] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:05.482448 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290f136-1b83-4872-a4a4-7eef31f81cd4 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:05.483555 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290f136-1b83-4872-a4a4-7eef31f81cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:05.483837 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9290f136-1b83-4872-a4a4-7eef31f81cd4 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:05.485203 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 92/183] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:05.485787 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9290f136-1b83-4872-a4a4-7eef31f81cd4 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:05.552664 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 92/184] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:30:05.553431 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce61cb-db72-4a52-9192-abcf14628f64 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:05.597510 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9290f136-1b83-4872-a4a4-7eef31f81cd4 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:05.620576 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:05.631148 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c96dce-b37e-404a-af75-cf83845dff5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:05.632044 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c96dce-b37e-404a-af75-cf83845dff5f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:05.632324 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c96dce-b37e-404a-af75-cf83845dff5f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:05.632595 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c96dce-b37e-404a-af75-cf83845dff5f None admin] PATH_INFO: `/v3/users/b4287006dc2145adb045a433972123e5` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:05.633366 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:05.633806 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c96dce-b37e-404a-af75-cf83845dff5f None admin] RBAC: Authorizing `identity:get_user(user_id=b4287006dc2145adb045a433972123e5)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:05.635520 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c96dce-b37e-404a-af75-cf83845dff5f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:05.637420 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 93/185] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:30:05 2022] GET /identity/v3/users/b4287006dc2145adb045a433972123e5 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:05.638555 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c33a1-9e77-4b89-972e-cfb58b688bf7 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:05.638843 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c33a1-9e77-4b89-972e-cfb58b688bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:05.639117 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c33a1-9e77-4b89-972e-cfb58b688bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:05.654127 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce61cb-db72-4a52-9192-abcf14628f64 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:05.655680 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-0f3c33a1-9e77-4b89-972e-cfb58b688bf7 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:05.656844 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0f3c33a1-9e77-4b89-972e-cfb58b688bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:05.687859 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40875e1d-2761-4d32-b2b5-2c0c0809799d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:05.688727 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40875e1d-2761-4d32-b2b5-2c0c0809799d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:05.689012 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40875e1d-2761-4d32-b2b5-2c0c0809799d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:05.689285 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40875e1d-2761-4d32-b2b5-2c0c0809799d None admin] PATH_INFO: `/v3/users/3beb6ae020154a5188a17f67625e0e0a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:05.703746 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40875e1d-2761-4d32-b2b5-2c0c0809799d None admin] RBAC: Authorizing `identity:get_user(user_id=3beb6ae020154a5188a17f67625e0e0a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:05.705231 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40875e1d-2761-4d32-b2b5-2c0c0809799d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:05.706968 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 93/186] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:30:05 2022] GET /identity/v3/users/3beb6ae020154a5188a17f67625e0e0a => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:05.710384 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77a5df-13dd-4d3e-8008-778122308a3d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:05.710384 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77a5df-13dd-4d3e-8008-778122308a3d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:05.710384 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c77a5df-13dd-4d3e-8008-778122308a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:05.724698 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 94/187] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:30:05.725315 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-2c77a5df-13dd-4d3e-8008-778122308a3d None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:05.726336 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c33a1-9e77-4b89-972e-cfb58b688bf7 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:05.726575 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2c77a5df-13dd-4d3e-8008-778122308a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:05.793754 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 94/188] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:30:05.799329 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77a5df-13dd-4d3e-8008-778122308a3d None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:05.825689 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c33a1-9e77-4b89-972e-cfb58b688bf7 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:05.851291 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:05.863482 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d8a6c-194e-4c79-98e3-ab5ba30a7ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:05.864557 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d8a6c-194e-4c79-98e3-ab5ba30a7ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:05.864843 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d8a6c-194e-4c79-98e3-ab5ba30a7ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:05.865113 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d8a6c-194e-4c79-98e3-ab5ba30a7ad2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:05.874439 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:05.875022 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d8a6c-194e-4c79-98e3-ab5ba30a7ad2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:05.883580 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-db9d8a6c-194e-4c79-98e3-ab5ba30a7ad2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 03:30:05.883580 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:05.883580 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:05.883580 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:05.883580 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:05.883580 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:05.883580 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:05.883580 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:05.883580 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:05.883580 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:05.883580 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:05.883580 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:05.883580 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:05.883580 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:05.883580 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:05.883580 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:05.884649 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:05.884649 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:05.884649 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:05.884649 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:05.884649 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:05.884649 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:05.884649 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:05.884649 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:05.884649 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:05.884649 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:05.884649 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:05.884649 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:05.884649 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:05.884649 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:05.884649 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:05.884649 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:05.885640 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:05.885640 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:05.885640 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:05.885640 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:05.885640 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:05.885640 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:05.885640 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:05.885640 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:05.885640 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:05.885640 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:05.885640 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 03:30:05.885640 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:05.885640 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 95/189] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:30:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:05.885640 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d8a6c-194e-4c79-98e3-ab5ba30a7ad2 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:05.915028 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c77a5df-13dd-4d3e-8008-778122308a3d None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:05.953059 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b9ddf-4e77-4e87-a534-9d49682f0f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:05.953711 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b9ddf-4e77-4e87-a534-9d49682f0f41 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:05.953998 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b9ddf-4e77-4e87-a534-9d49682f0f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:05.954277 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b9ddf-4e77-4e87-a534-9d49682f0f41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:05.986934 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d8a6c-194e-4c79-98e3-ab5ba30a7ad2 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:06.019659 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a11d17-1b0d-42b6-aec2-c07278618fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:06.020302 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a11d17-1b0d-42b6-aec2-c07278618fd5 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:06.020589 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a11d17-1b0d-42b6-aec2-c07278618fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:06.020867 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a11d17-1b0d-42b6-aec2-c07278618fd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:06.021163 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b9ddf-4e77-4e87-a534-9d49682f0f41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:06.022931 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b9ddf-4e77-4e87-a534-9d49682f0f41 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:06.068825 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:06.088299 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a11d17-1b0d-42b6-aec2-c07278618fd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:06.088500 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:06.089855 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a11d17-1b0d-42b6-aec2-c07278618fd5 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:06.120985 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 95/190] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:30:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 03:30:06.121802 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b9ddf-4e77-4e87-a534-9d49682f0f41 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:06.187070 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 96/191] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:30:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 03:30:06.187818 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a11d17-1b0d-42b6-aec2-c07278618fd5 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:06.222992 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b9ddf-4e77-4e87-a534-9d49682f0f41 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:06.257385 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9eb643-10cf-46aa-b2bb-c50e9f52b4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:06.258854 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9eb643-10cf-46aa-b2bb-c50e9f52b4e2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:06.259133 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9eb643-10cf-46aa-b2bb-c50e9f52b4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:06.259408 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9eb643-10cf-46aa-b2bb-c50e9f52b4e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:06.260569 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9eb643-10cf-46aa-b2bb-c50e9f52b4e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:06.262025 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9eb643-10cf-46aa-b2bb-c50e9f52b4e2 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:06.263684 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 96/192] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:30:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:06.264429 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9eb643-10cf-46aa-b2bb-c50e9f52b4e2 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:06.287844 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:06.303150 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:06.309607 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a11d17-1b0d-42b6-aec2-c07278618fd5 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:06.343651 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d5a57-4544-4826-aad7-b7ee6c47d1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:06.344452 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d5a57-4544-4826-aad7-b7ee6c47d1c5 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:06.344731 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d5a57-4544-4826-aad7-b7ee6c47d1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:06.345004 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8d5a57-4544-4826-aad7-b7ee6c47d1c5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:06.355012 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8d5a57-4544-4826-aad7-b7ee6c47d1c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:06.362225 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9eb643-10cf-46aa-b2bb-c50e9f52b4e2 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:06.362988 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-cd8d5a57-4544-4826-aad7-b7ee6c47d1c5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 03:30:06.362988 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:06.362988 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:06.362988 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:06.362988 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:06.362988 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:06.362988 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:06.362988 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:06.362988 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:06.362988 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:06.362988 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:06.362988 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:06.362988 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:06.362988 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:06.362988 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:06.362988 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:06.363955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:06.363955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:06.363955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:06.363955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:06.363955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:06.363955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:06.363955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:06.363955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:06.363955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:06.363955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:06.363955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:06.363955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:06.363955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:06.363955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:06.363955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:06.363955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:06.370220 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:06.370220 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:06.370220 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:06.370220 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:06.370220 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:06.370220 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:06.370220 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:06.370220 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:06.370220 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:06.370220 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:06.370220 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 03:30:06.370220 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:06.370220 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 97/193] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jul 21 03:30:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:06.370220 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d5a57-4544-4826-aad7-b7ee6c47d1c5 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:06.396406 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89976f7-585a-40ba-963b-6e6d3f42f3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:06.397343 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89976f7-585a-40ba-963b-6e6d3f42f3e8 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:06.397633 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89976f7-585a-40ba-963b-6e6d3f42f3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:06.397914 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89976f7-585a-40ba-963b-6e6d3f42f3e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:06.398722 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89976f7-585a-40ba-963b-6e6d3f42f3e8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:06.399035 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89976f7-585a-40ba-963b-6e6d3f42f3e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:06.400431 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89976f7-585a-40ba-963b-6e6d3f42f3e8 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:06.408539 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 97/194] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 03:30:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:06.408539 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89976f7-585a-40ba-963b-6e6d3f42f3e8 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:06.465052 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8d5a57-4544-4826-aad7-b7ee6c47d1c5 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:06.498559 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f45b7b-1d3f-43e7-9013-cc9d26525df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:06.499413 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f45b7b-1d3f-43e7-9013-cc9d26525df0 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:06.499697 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f45b7b-1d3f-43e7-9013-cc9d26525df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:06.499973 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f45b7b-1d3f-43e7-9013-cc9d26525df0 None admin] PATH_INFO: `/v3/projects/ff08f0da218547168d61280850305f5d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:06.501162 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f45b7b-1d3f-43e7-9013-cc9d26525df0 None admin] RBAC: Authorizing `identity:get_project(project_id=ff08f0da218547168d61280850305f5d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:06.502653 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f45b7b-1d3f-43e7-9013-cc9d26525df0 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:06.504360 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 98/195] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:30:06 2022] GET /identity/v3/projects/ff08f0da218547168d61280850305f5d => generated 312 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:06.505095 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f45b7b-1d3f-43e7-9013-cc9d26525df0 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:06.505225 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:06.512390 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89976f7-585a-40ba-963b-6e6d3f42f3e8 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:06.516815 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:06.546936 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf5221-f035-4f19-afb4-ae099dfbcac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:06.547794 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf5221-f035-4f19-afb4-ae099dfbcac4 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:06.548085 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf5221-f035-4f19-afb4-ae099dfbcac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:06.548366 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf5221-f035-4f19-afb4-ae099dfbcac4 None admin] PATH_INFO: `/v3/projects/4243c37e3bcb48b0a62103a25160eb80` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:06.549551 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baf5221-f035-4f19-afb4-ae099dfbcac4 None admin] RBAC: Authorizing `identity:get_project(project_id=4243c37e3bcb48b0a62103a25160eb80)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:06.551047 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baf5221-f035-4f19-afb4-ae099dfbcac4 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:06.552751 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 98/196] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:30:06 2022] GET /identity/v3/projects/4243c37e3bcb48b0a62103a25160eb80 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:06.553506 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf5221-f035-4f19-afb4-ae099dfbcac4 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:06.608860 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f45b7b-1d3f-43e7-9013-cc9d26525df0 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:06.642138 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f174917-3aa4-4de3-9613-58c2cd175052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:06.642842 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f174917-3aa4-4de3-9613-58c2cd175052 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:06.643134 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f174917-3aa4-4de3-9613-58c2cd175052 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:06.643419 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f174917-3aa4-4de3-9613-58c2cd175052 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:06.644133 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f174917-3aa4-4de3-9613-58c2cd175052 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:06.645576 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f174917-3aa4-4de3-9613-58c2cd175052 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:06.655195 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf5221-f035-4f19-afb4-ae099dfbcac4 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:06.665532 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 99/197] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jul 21 03:30:06 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:30:06.666653 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f174917-3aa4-4de3-9613-58c2cd175052 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:06.714580 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c39715-9a4b-46ec-9c32-a6f18ecbfd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:06.715338 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c39715-9a4b-46ec-9c32-a6f18ecbfd30 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:06.715574 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c39715-9a4b-46ec-9c32-a6f18ecbfd30 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:06.715853 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c39715-9a4b-46ec-9c32-a6f18ecbfd30 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:06.716626 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c39715-9a4b-46ec-9c32-a6f18ecbfd30 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:06.716934 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c39715-9a4b-46ec-9c32-a6f18ecbfd30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:06.718512 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c39715-9a4b-46ec-9c32-a6f18ecbfd30 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:06.728642 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 99/198] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:30:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:06.734131 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c39715-9a4b-46ec-9c32-a6f18ecbfd30 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:06.743645 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:06.772245 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:06.791551 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f174917-3aa4-4de3-9613-58c2cd175052 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:06.839354 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22640f6a-4212-48b8-be1e-dd98288a4e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:06.840652 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22640f6a-4212-48b8-be1e-dd98288a4e65 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:06.840652 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22640f6a-4212-48b8-be1e-dd98288a4e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:06.840829 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22640f6a-4212-48b8-be1e-dd98288a4e65 None admin] PATH_INFO: `/v3/users/0fdeb152d5d1494fb09a286cbbbbe0cc` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:06.842796 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22640f6a-4212-48b8-be1e-dd98288a4e65 None admin] RBAC: Authorizing `identity:get_user(user_id=0fdeb152d5d1494fb09a286cbbbbe0cc)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:06.844323 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22640f6a-4212-48b8-be1e-dd98288a4e65 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:06.846553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 100/199] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:30:06 2022] GET /identity/v3/users/0fdeb152d5d1494fb09a286cbbbbe0cc => generated 289 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:06.847228 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22640f6a-4212-48b8-be1e-dd98288a4e65 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:06.865053 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c39715-9a4b-46ec-9c32-a6f18ecbfd30 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:06.910358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa92bd-5c93-4a21-be33-8d04cf94504f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:06.911172 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa92bd-5c93-4a21-be33-8d04cf94504f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:06.911460 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa92bd-5c93-4a21-be33-8d04cf94504f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:06.911737 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa92bd-5c93-4a21-be33-8d04cf94504f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:06.912579 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa92bd-5c93-4a21-be33-8d04cf94504f None admin] RBAC: Adding query filter params (role.id=1ac721157e9b40f18cbbc76f5a6b0d3d, scope.project.id=ff08f0da218547168d61280850305f5d, user.id=b4287006dc2145adb045a433972123e5) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:06.912890 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa92bd-5c93-4a21-be33-8d04cf94504f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:06.917000 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa92bd-5c93-4a21-be33-8d04cf94504f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:06.924335 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 100/200] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:30:06 2022] GET /identity/v3/role_assignments?user.id=b4287006dc2145adb045a433972123e5&scope.project.id=ff08f0da218547168d61280850305f5d&role.id=1ac721157e9b40f18cbbc76f5a6b0d3d => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:06.925623 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa92bd-5c93-4a21-be33-8d04cf94504f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:06.969451 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22640f6a-4212-48b8-be1e-dd98288a4e65 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:07.007364 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f281d-9a19-48ad-860d-c5124123a428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:07.008037 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f281d-9a19-48ad-860d-c5124123a428 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:07.008325 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f281d-9a19-48ad-860d-c5124123a428 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:07.008666 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f281d-9a19-48ad-860d-c5124123a428 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:07.009539 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f281d-9a19-48ad-860d-c5124123a428 None admin] RBAC: Adding query filter params (role.id=27e53d6c56f24c25a8c8057bfd36bcf1, scope.project.id=4243c37e3bcb48b0a62103a25160eb80, user.id=3beb6ae020154a5188a17f67625e0e0a) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:07.009850 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f281d-9a19-48ad-860d-c5124123a428 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:07.011588 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f281d-9a19-48ad-860d-c5124123a428 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:07.013499 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:07.018065 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 101/201] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:30:06 2022] GET /identity/v3/role_assignments?user.id=3beb6ae020154a5188a17f67625e0e0a&scope.project.id=4243c37e3bcb48b0a62103a25160eb80&role.id=27e53d6c56f24c25a8c8057bfd36bcf1 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:07.018920 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f281d-9a19-48ad-860d-c5124123a428 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:07.061296 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:07.070593 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa92bd-5c93-4a21-be33-8d04cf94504f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:07.112730 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673f8ae-fadf-4489-b097-41d51dd8f2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:07.114147 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673f8ae-fadf-4489-b097-41d51dd8f2d7 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:07.114699 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673f8ae-fadf-4489-b097-41d51dd8f2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:07.115202 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673f8ae-fadf-4489-b097-41d51dd8f2d7 None admin] PATH_INFO: `/v3/users/3beb6ae020154a5188a17f67625e0e0a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:07.116918 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673f8ae-fadf-4489-b097-41d51dd8f2d7 None admin] RBAC: Authorizing `identity:get_user(user_id=3beb6ae020154a5188a17f67625e0e0a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:07.118849 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673f8ae-fadf-4489-b097-41d51dd8f2d7 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:07.121228 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 101/202] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:30:06 2022] GET /identity/v3/users/3beb6ae020154a5188a17f67625e0e0a => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:07.130837 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673f8ae-fadf-4489-b097-41d51dd8f2d7 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:07.141743 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f281d-9a19-48ad-860d-c5124123a428 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:07.198112 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f57d3-b0e7-4bdd-9bda-918323488582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:07.199174 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f57d3-b0e7-4bdd-9bda-918323488582 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:07.200019 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f57d3-b0e7-4bdd-9bda-918323488582 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:07.200489 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f57d3-b0e7-4bdd-9bda-918323488582 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:07.277563 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673f8ae-fadf-4489-b097-41d51dd8f2d7 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:07.292298 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:07.296046 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5f57d3-b0e7-4bdd-9bda-918323488582 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:07.297611 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5f57d3-b0e7-4bdd-9bda-918323488582 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:07.322409 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce40f97-c76c-4a79-988a-c50cf782cbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:07.323548 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce40f97-c76c-4a79-988a-c50cf782cbc8 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:07.324042 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce40f97-c76c-4a79-988a-c50cf782cbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:07.324494 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce40f97-c76c-4a79-988a-c50cf782cbc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:07.360648 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:07.404555 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce40f97-c76c-4a79-988a-c50cf782cbc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:07.406562 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce40f97-c76c-4a79-988a-c50cf782cbc8 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:07.409447 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 102/203] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:30:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 03:30:07.415485 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f57d3-b0e7-4bdd-9bda-918323488582 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:07.517932 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 102/204] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:30:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 03:30:07.522487 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:07.523978 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce40f97-c76c-4a79-988a-c50cf782cbc8 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:07.526087 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5f57d3-b0e7-4bdd-9bda-918323488582 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:07.590662 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a57726-f3b1-4c49-9686-160108077414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:07.591545 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a57726-f3b1-4c49-9686-160108077414 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:07.591831 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a57726-f3b1-4c49-9686-160108077414 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:07.592107 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a57726-f3b1-4c49-9686-160108077414 None admin] PATH_INFO: `/v3/projects/e7eff2725d90448aaf1b1dc5e791bd90` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:07.597523 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a57726-f3b1-4c49-9686-160108077414 None admin] RBAC: Authorizing `identity:get_project(project_id=e7eff2725d90448aaf1b1dc5e791bd90)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:07.599036 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a57726-f3b1-4c49-9686-160108077414 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:07.600801 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 103/205] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:30:07 2022] GET /identity/v3/projects/e7eff2725d90448aaf1b1dc5e791bd90 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:30:07.610096 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a57726-f3b1-4c49-9686-160108077414 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:07.660747 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:07.728330 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce40f97-c76c-4a79-988a-c50cf782cbc8 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:07.794169 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a57726-f3b1-4c49-9686-160108077414 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:07.797127 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3933ef-f531-4343-ab87-aac0bbc5231e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:07.798002 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3933ef-f531-4343-ab87-aac0bbc5231e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:07.798290 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3933ef-f531-4343-ab87-aac0bbc5231e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:07.798597 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3933ef-f531-4343-ab87-aac0bbc5231e None admin] PATH_INFO: `/v3/projects/4243c37e3bcb48b0a62103a25160eb80` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:07.801228 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3933ef-f531-4343-ab87-aac0bbc5231e None admin] RBAC: Authorizing `identity:get_project(project_id=4243c37e3bcb48b0a62103a25160eb80)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:07.802723 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3933ef-f531-4343-ab87-aac0bbc5231e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:07.809844 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 103/206] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:30:07 2022] GET /identity/v3/projects/4243c37e3bcb48b0a62103a25160eb80 => generated 302 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:30:07.810699 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3933ef-f531-4343-ab87-aac0bbc5231e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:07.850867 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35730324-61a3-4550-afc0-2c0064d54ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:07.851567 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35730324-61a3-4550-afc0-2c0064d54ebe None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:07.852364 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35730324-61a3-4550-afc0-2c0064d54ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:07.853417 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35730324-61a3-4550-afc0-2c0064d54ebe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:07.853522 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35730324-61a3-4550-afc0-2c0064d54ebe None admin] RBAC: Adding query filter params (role.id=8670c500985c4abea21f372ef30378a6, scope.project.id=e7eff2725d90448aaf1b1dc5e791bd90, user.id=0fdeb152d5d1494fb09a286cbbbbe0cc) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:07.853795 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35730324-61a3-4550-afc0-2c0064d54ebe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:07.856276 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35730324-61a3-4550-afc0-2c0064d54ebe None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:07.864956 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 104/207] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:30:07 2022] GET /identity/v3/role_assignments?user.id=0fdeb152d5d1494fb09a286cbbbbe0cc&scope.project.id=e7eff2725d90448aaf1b1dc5e791bd90&role.id=8670c500985c4abea21f372ef30378a6 => generated 608 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:30:07.994115 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3933ef-f531-4343-ab87-aac0bbc5231e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:08.033637 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:08.039445 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c281bb-ddf0-4076-8d6c-ca01a84bdd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:08.040225 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c281bb-ddf0-4076-8d6c-ca01a84bdd9e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:08.040652 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c281bb-ddf0-4076-8d6c-ca01a84bdd9e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:08.040937 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c281bb-ddf0-4076-8d6c-ca01a84bdd9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:08.041888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c281bb-ddf0-4076-8d6c-ca01a84bdd9e None admin] RBAC: Adding query filter params (role.id=76578c4e1dbb4559b293fb93830ed5b2, scope.project.id=4243c37e3bcb48b0a62103a25160eb80, user.id=3beb6ae020154a5188a17f67625e0e0a) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:08.042209 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c281bb-ddf0-4076-8d6c-ca01a84bdd9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:08.043775 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c281bb-ddf0-4076-8d6c-ca01a84bdd9e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:08.050113 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 104/208] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:30:07 2022] GET /identity/v3/role_assignments?user.id=3beb6ae020154a5188a17f67625e0e0a&scope.project.id=4243c37e3bcb48b0a62103a25160eb80&role.id=76578c4e1dbb4559b293fb93830ed5b2 => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:09.111885 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46823e18-80a3-4d60-b128-73317e5065ce None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:09.112415 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46823e18-80a3-4d60-b128-73317e5065ce None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:09.112415 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46823e18-80a3-4d60-b128-73317e5065ce None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:09.114085 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 105/209] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:09.120281 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5b817-1416-4228-bc73-5e5df121e339 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:09.120680 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5b817-1416-4228-bc73-5e5df121e339 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:09.121030 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5b817-1416-4228-bc73-5e5df121e339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:09.141265 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d5c5b817-1416-4228-bc73-5e5df121e339 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:09.142624 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d5c5b817-1416-4228-bc73-5e5df121e339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:09.229732 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 105/210] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:30:09.253695 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46823e18-80a3-4d60-b128-73317e5065ce None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:09.290860 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:09.385389 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46823e18-80a3-4d60-b128-73317e5065ce None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:09.455275 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8de262-58bb-49e0-93df-f07425656f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:09.456063 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8de262-58bb-49e0-93df-f07425656f6f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:09.456355 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8de262-58bb-49e0-93df-f07425656f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:09.456715 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8de262-58bb-49e0-93df-f07425656f6f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:09.479243 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6c7e6-7913-45e3-aac1-36f75f554022 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:09.479243 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6c7e6-7913-45e3-aac1-36f75f554022 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:09.479243 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6c7e6-7913-45e3-aac1-36f75f554022 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:09.480242 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 106/211] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:09.484712 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8de262-58bb-49e0-93df-f07425656f6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:09.485414 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dde85e-3dcf-4fdd-ba82-0a51776fc970 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:09.485700 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dde85e-3dcf-4fdd-ba82-0a51776fc970 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:09.485978 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dde85e-3dcf-4fdd-ba82-0a51776fc970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:09.493386 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-ff8de262-58bb-49e0-93df-f07425656f6f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 03:30:09.493386 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:09.493386 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:09.493386 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:09.493386 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:09.493386 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:09.493386 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:09.493386 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:09.493386 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:09.493386 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:09.493386 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:09.493386 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:09.493386 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:09.493386 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:09.493386 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:09.493386 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:09.494252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:09.494252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:09.494252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:09.494252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:09.494252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:09.494252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:09.494252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:09.494252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:09.494252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:09.494252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:09.494252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:09.494252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:09.494252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:09.494252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:09.494252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:09.494252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:09.495070 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:09.495070 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:09.495070 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:09.495070 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:09.495070 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:09.495070 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:09.495070 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:09.495070 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:09.495070 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:09.495070 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:09.495070 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 03:30:09.495070 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:09.495070 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 106/212] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:30:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:09.496134 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d8709-d146-4d5b-87a5-e21de4b9652e None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:09.496339 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d8709-d146-4d5b-87a5-e21de4b9652e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:09.497043 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d8709-d146-4d5b-87a5-e21de4b9652e None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:09.498552 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 107/213] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:09.503905 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d8709-d146-4d5b-87a5-e21de4b9652e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:09.514215 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-89dde85e-3dcf-4fdd-ba82-0a51776fc970 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:09.515611 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-89dde85e-3dcf-4fdd-ba82-0a51776fc970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:09.599327 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 107/214] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:30:09.600851 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3a65a-8618-436e-badd-334dd0fb29a2 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:09.601143 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3a65a-8618-436e-badd-334dd0fb29a2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:09.601420 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3a65a-8618-436e-badd-334dd0fb29a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:09.625960 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:09.630602 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-84d3a65a-8618-436e-badd-334dd0fb29a2 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:09.632851 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-84d3a65a-8618-436e-badd-334dd0fb29a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:09.641146 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d8709-d146-4d5b-87a5-e21de4b9652e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:09.689624 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ec389-ff2f-4416-a1ce-f5a557f05293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:09.690293 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ec389-ff2f-4416-a1ce-f5a557f05293 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:09.690642 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ec389-ff2f-4416-a1ce-f5a557f05293 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:09.690923 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ec389-ff2f-4416-a1ce-f5a557f05293 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:09.691669 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ec389-ff2f-4416-a1ce-f5a557f05293 None admin] RBAC: Adding query filter params (name=member) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:09.694994 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ec389-ff2f-4416-a1ce-f5a557f05293 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:09.694994 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421ec389-ff2f-4416-a1ce-f5a557f05293 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:09.704451 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:09.710521 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 108/215] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 03:30:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:09.710521 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ec389-ff2f-4416-a1ce-f5a557f05293 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:09.725978 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 108/216] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:30:09.727370 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3a65a-8618-436e-badd-334dd0fb29a2 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:09.818844 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421ec389-ff2f-4416-a1ce-f5a557f05293 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:09.847775 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3a65a-8618-436e-badd-334dd0fb29a2 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:09.858902 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1e2a3-e891-440b-8399-34d1bd0b8257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:09.859697 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1e2a3-e891-440b-8399-34d1bd0b8257 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:09.859977 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1e2a3-e891-440b-8399-34d1bd0b8257 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:09.860239 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1e2a3-e891-440b-8399-34d1bd0b8257 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:09.871811 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d1e2a3-e891-440b-8399-34d1bd0b8257 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:09.879401 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-39d1e2a3-e891-440b-8399-34d1bd0b8257 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:30:09.879401 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:09.879401 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:09.879401 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:09.879401 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:09.879401 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:09.879401 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:09.879401 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:09.879401 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:09.879401 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:09.879401 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:09.879401 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:09.879401 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:09.879401 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:09.879401 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:09.879401 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:09.880354 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:09.880354 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:09.880354 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:09.880354 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:09.880354 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:09.880354 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:09.880354 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:09.880354 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:09.880354 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:09.880354 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:09.880354 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:09.880354 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:09.880354 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:09.880354 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:09.880354 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:09.880354 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:09.881140 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:09.881140 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:09.881140 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:09.881140 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:09.881140 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:09.881140 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:09.881140 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:09.881140 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:09.881140 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:09.881140 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:09.881140 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:30:09.881140 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:09.881140 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 109/217] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 03:30:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:09.881774 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1e2a3-e891-440b-8399-34d1bd0b8257 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:09.886925 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def0f1d1-e61b-4426-aa8c-d1fd13dca886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:09.887809 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0f1d1-e61b-4426-aa8c-d1fd13dca886 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:09.888090 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0f1d1-e61b-4426-aa8c-d1fd13dca886 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:09.888364 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0f1d1-e61b-4426-aa8c-d1fd13dca886 None admin] PATH_INFO: `/v3/users/a14bac39cadc4375b806aabad39f96df` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:09.899711 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:09.903640 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def0f1d1-e61b-4426-aa8c-d1fd13dca886 None admin] RBAC: Authorizing `identity:get_user(user_id=a14bac39cadc4375b806aabad39f96df)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:09.905137 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def0f1d1-e61b-4426-aa8c-d1fd13dca886 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:09.906904 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 109/218] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:30:09 2022] GET /identity/v3/users/a14bac39cadc4375b806aabad39f96df => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:09.907664 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def0f1d1-e61b-4426-aa8c-d1fd13dca886 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:09.956355 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:10.001848 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1e2a3-e891-440b-8399-34d1bd0b8257 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:10.017166 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def0f1d1-e61b-4426-aa8c-d1fd13dca886 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:10.037302 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f2bcb-0c40-467d-82fd-b1180c080f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:10.038110 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f2bcb-0c40-467d-82fd-b1180c080f89 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:10.038421 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f2bcb-0c40-467d-82fd-b1180c080f89 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:10.038732 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f2bcb-0c40-467d-82fd-b1180c080f89 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:10.040488 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f2bcb-0c40-467d-82fd-b1180c080f89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:10.041959 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f2bcb-0c40-467d-82fd-b1180c080f89 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:10.043955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 110/219] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:30:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:10.044737 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f2bcb-0c40-467d-82fd-b1180c080f89 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:10.058772 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a06de-2312-4a6a-ab55-02e30da94de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:10.059688 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a06de-2312-4a6a-ab55-02e30da94de7 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:10.060291 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a06de-2312-4a6a-ab55-02e30da94de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:10.060742 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a06de-2312-4a6a-ab55-02e30da94de7 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:10.061732 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a06de-2312-4a6a-ab55-02e30da94de7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:10.062209 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a06de-2312-4a6a-ab55-02e30da94de7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:10.063924 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a06de-2312-4a6a-ab55-02e30da94de7 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:10.073061 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 110/220] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:30:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:10.074180 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a06de-2312-4a6a-ab55-02e30da94de7 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:10.127212 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:10.147613 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f2bcb-0c40-467d-82fd-b1180c080f89 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:10.188901 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a06de-2312-4a6a-ab55-02e30da94de7 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:10.190613 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc194d39-1cc0-4149-ad88-874b97383a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:10.191276 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc194d39-1cc0-4149-ad88-874b97383a7e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:10.191562 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc194d39-1cc0-4149-ad88-874b97383a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:10.191841 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc194d39-1cc0-4149-ad88-874b97383a7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:10.192172 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:10.225863 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ccfbc-c545-4bb9-9aba-aea465bf7400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:10.226598 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ccfbc-c545-4bb9-9aba-aea465bf7400 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:10.226883 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ccfbc-c545-4bb9-9aba-aea465bf7400 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:10.227160 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6ccfbc-c545-4bb9-9aba-aea465bf7400 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:10.227865 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ccfbc-c545-4bb9-9aba-aea465bf7400 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:10.229312 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6ccfbc-c545-4bb9-9aba-aea465bf7400 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:10.250005 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 111/221] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jul 21 03:30:10 2022] POST /identity/v3/users => generated 297 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:30:10.255097 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ccfbc-c545-4bb9-9aba-aea465bf7400 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:10.262146 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc194d39-1cc0-4149-ad88-874b97383a7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:10.263843 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc194d39-1cc0-4149-ad88-874b97383a7e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:10.360124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:10.375783 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6ccfbc-c545-4bb9-9aba-aea465bf7400 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:10.385951 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 111/222] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:30:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 03:30:10.387573 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a92ac-f7b4-42bf-a024-b1ff9b283bb1 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:10.387868 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a92ac-f7b4-42bf-a024-b1ff9b283bb1 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:10.388151 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a92ac-f7b4-42bf-a024-b1ff9b283bb1 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:10.389862 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 112/223] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:10.394363 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a92ac-f7b4-42bf-a024-b1ff9b283bb1 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:10.423766 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75436efb-ec6a-49a5-8621-36d2ea4336ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:10.424658 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75436efb-ec6a-49a5-8621-36d2ea4336ce None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:10.424936 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75436efb-ec6a-49a5-8621-36d2ea4336ce None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:10.425215 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75436efb-ec6a-49a5-8621-36d2ea4336ce None admin] PATH_INFO: `/v3/users/3beb6ae020154a5188a17f67625e0e0a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:10.427519 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75436efb-ec6a-49a5-8621-36d2ea4336ce None admin] RBAC: Authorizing `identity:get_user(user_id=3beb6ae020154a5188a17f67625e0e0a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:10.429024 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75436efb-ec6a-49a5-8621-36d2ea4336ce None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:10.431899 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 112/224] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:30:10 2022] GET /identity/v3/users/3beb6ae020154a5188a17f67625e0e0a => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:10.432391 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7f9d8-1691-46d1-9e18-aa5f391e1be9 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:10.432680 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7f9d8-1691-46d1-9e18-aa5f391e1be9 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:10.433060 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7f9d8-1691-46d1-9e18-aa5f391e1be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:10.451721 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-acb7f9d8-1691-46d1-9e18-aa5f391e1be9 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:10.452033 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-acb7f9d8-1691-46d1-9e18-aa5f391e1be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:10.484788 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:10.540256 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 113/225] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:30:10.541326 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7f9d8-1691-46d1-9e18-aa5f391e1be9 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:10.548241 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a92ac-f7b4-42bf-a024-b1ff9b283bb1 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:10.591628 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c19de5-4903-43ba-bc4b-1810aa05ca7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:10.592786 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c19de5-4903-43ba-bc4b-1810aa05ca7f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:10.593649 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c19de5-4903-43ba-bc4b-1810aa05ca7f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:10.593932 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c19de5-4903-43ba-bc4b-1810aa05ca7f None admin] PATH_INFO: `/v3/projects/4243c37e3bcb48b0a62103a25160eb80` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:10.595697 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c19de5-4903-43ba-bc4b-1810aa05ca7f None admin] RBAC: Authorizing `identity:get_project(project_id=4243c37e3bcb48b0a62103a25160eb80)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:10.597019 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c19de5-4903-43ba-bc4b-1810aa05ca7f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:10.599331 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 113/226] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:30:10 2022] GET /identity/v3/projects/4243c37e3bcb48b0a62103a25160eb80 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:30:10.602538 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c19de5-4903-43ba-bc4b-1810aa05ca7f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:10.666056 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:10.673638 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7f9d8-1691-46d1-9e18-aa5f391e1be9 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:10.721014 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c19de5-4903-43ba-bc4b-1810aa05ca7f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:10.721308 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb9595-0791-4981-b263-cb5d31ad8f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:10.722580 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb9595-0791-4981-b263-cb5d31ad8f28 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:10.723114 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb9595-0791-4981-b263-cb5d31ad8f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:10.723688 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cb9595-0791-4981-b263-cb5d31ad8f28 None admin] PATH_INFO: `/v3/projects/4243c37e3bcb48b0a62103a25160eb80` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:10.725110 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb9595-0791-4981-b263-cb5d31ad8f28 None admin] RBAC: Authorizing `identity:get_project(project_id=4243c37e3bcb48b0a62103a25160eb80)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:10.727397 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cb9595-0791-4981-b263-cb5d31ad8f28 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:10.729448 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 114/227] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:30:10 2022] GET /identity/v3/projects/4243c37e3bcb48b0a62103a25160eb80 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:10.735167 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb9595-0791-4981-b263-cb5d31ad8f28 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:10.757569 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87cd15a-8e91-47d0-aa07-c46a72845ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:10.758415 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cd15a-8e91-47d0-aa07-c46a72845ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:10.758741 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cd15a-8e91-47d0-aa07-c46a72845ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:10.759017 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cd15a-8e91-47d0-aa07-c46a72845ad5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:10.767621 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:10.770152 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87cd15a-8e91-47d0-aa07-c46a72845ad5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:10.779937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-b87cd15a-8e91-47d0-aa07-c46a72845ad5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 03:30:10.779937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:10.779937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:10.779937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:10.779937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:10.779937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:10.779937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:10.779937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:10.779937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:10.779937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:10.779937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:10.779937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:10.779937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:10.779937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:10.779937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:10.779937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:10.780894 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:10.780894 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:10.780894 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:10.780894 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:10.780894 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:10.780894 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:10.780894 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:10.780894 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:10.780894 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:10.780894 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:10.780894 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:10.780894 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:10.780894 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:10.780894 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:10.780894 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:10.780894 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:10.781707 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:10.781707 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:10.781707 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:10.781707 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:10.781707 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:10.781707 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:10.781707 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:10.781707 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:10.781707 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:10.781707 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:10.781707 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 03:30:10.781707 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:10.781707 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 114/228] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jul 21 03:30:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:10.787685 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87cd15a-8e91-47d0-aa07-c46a72845ad5 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:10.860380 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cb9595-0791-4981-b263-cb5d31ad8f28 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:10.899307 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87cd15a-8e91-47d0-aa07-c46a72845ad5 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:10.902927 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e935aea4-39ca-480c-a1aa-53e60f698705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:10.903849 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935aea4-39ca-480c-a1aa-53e60f698705 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:10.904359 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935aea4-39ca-480c-a1aa-53e60f698705 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:10.904838 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935aea4-39ca-480c-a1aa-53e60f698705 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:10.905889 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e935aea4-39ca-480c-a1aa-53e60f698705 None admin] RBAC: Adding query filter params (role.id=1ac721157e9b40f18cbbc76f5a6b0d3d, scope.project.id=4243c37e3bcb48b0a62103a25160eb80, user.id=a14bac39cadc4375b806aabad39f96df) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:10.906409 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e935aea4-39ca-480c-a1aa-53e60f698705 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:10.908176 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e935aea4-39ca-480c-a1aa-53e60f698705 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:10.910774 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:10.918858 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 115/229] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:30:10 2022] GET /identity/v3/role_assignments?user.id=a14bac39cadc4375b806aabad39f96df&scope.project.id=4243c37e3bcb48b0a62103a25160eb80&role.id=1ac721157e9b40f18cbbc76f5a6b0d3d => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:10.920092 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e935aea4-39ca-480c-a1aa-53e60f698705 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:10.964390 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c672a-2a18-400e-895a-2302bf4e9cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:10.965413 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c672a-2a18-400e-895a-2302bf4e9cac None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:10.965703 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c672a-2a18-400e-895a-2302bf4e9cac None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:10.965980 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c672a-2a18-400e-895a-2302bf4e9cac None admin] PATH_INFO: `/v3/projects/4243c37e3bcb48b0a62103a25160eb80/users/3beb6ae020154a5188a17f67625e0e0a/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:10.972691 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c672a-2a18-400e-895a-2302bf4e9cac None admin] RBAC: Authorizing `identity:create_grant(project_id=4243c37e3bcb48b0a62103a25160eb80, user_id=3beb6ae020154a5188a17f67625e0e0a, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:10.974314 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c672a-2a18-400e-895a-2302bf4e9cac None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:11.010537 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 115/230] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 03:30:10 2022] PUT /identity/v3/projects/4243c37e3bcb48b0a62103a25160eb80/users/3beb6ae020154a5188a17f67625e0e0a/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:30:11.057283 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:11.073300 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e935aea4-39ca-480c-a1aa-53e60f698705 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:11.124035 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2a5ba-c5a6-4476-9789-042da4340377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:11.124732 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2a5ba-c5a6-4476-9789-042da4340377 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:11.125064 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2a5ba-c5a6-4476-9789-042da4340377 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:11.125344 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2a5ba-c5a6-4476-9789-042da4340377 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:11.126113 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b2a5ba-c5a6-4476-9789-042da4340377 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:11.126418 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b2a5ba-c5a6-4476-9789-042da4340377 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:11.127873 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b2a5ba-c5a6-4476-9789-042da4340377 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:11.146396 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 116/231] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:30:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:11.153323 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c672a-2a18-400e-895a-2302bf4e9cac None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:11.298524 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c672a-2a18-400e-895a-2302bf4e9cac None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:11.334060 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cfc3df-927d-4365-8714-e18f2a3af17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:11.335324 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfc3df-927d-4365-8714-e18f2a3af17d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:11.335876 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfc3df-927d-4365-8714-e18f2a3af17d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:11.336877 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfc3df-927d-4365-8714-e18f2a3af17d None admin] PATH_INFO: `/v3/users/3beb6ae020154a5188a17f67625e0e0a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:11.338310 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cfc3df-927d-4365-8714-e18f2a3af17d None admin] RBAC: Authorizing `identity:get_user(user_id=3beb6ae020154a5188a17f67625e0e0a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:11.339981 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cfc3df-927d-4365-8714-e18f2a3af17d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:11.342182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 116/232] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:30:11 2022] GET /identity/v3/users/3beb6ae020154a5188a17f67625e0e0a => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:11.349161 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2a5ba-c5a6-4476-9789-042da4340377 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:11.490317 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b2a5ba-c5a6-4476-9789-042da4340377 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:11.534542 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c60f4-6e44-4cec-a705-fede14cdd8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:11.535664 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c60f4-6e44-4cec-a705-fede14cdd8cf None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:11.536101 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c60f4-6e44-4cec-a705-fede14cdd8cf None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:11.536526 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c60f4-6e44-4cec-a705-fede14cdd8cf None admin] PATH_INFO: `/v3/projects/4243c37e3bcb48b0a62103a25160eb80` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:11.537901 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c60f4-6e44-4cec-a705-fede14cdd8cf None admin] RBAC: Authorizing `identity:get_project(project_id=4243c37e3bcb48b0a62103a25160eb80)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:11.539780 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c60f4-6e44-4cec-a705-fede14cdd8cf None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:11.541979 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 117/233] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:30:11 2022] GET /identity/v3/projects/4243c37e3bcb48b0a62103a25160eb80 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:11.547701 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cfc3df-927d-4365-8714-e18f2a3af17d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:11.610605 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:11.724657 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cfc3df-927d-4365-8714-e18f2a3af17d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:11.776990 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41067adb-1410-4b56-a744-d6cd68e4d480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:11.777889 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41067adb-1410-4b56-a744-d6cd68e4d480 None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:11.778174 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41067adb-1410-4b56-a744-d6cd68e4d480 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:11.778452 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41067adb-1410-4b56-a744-d6cd68e4d480 None admin] PATH_INFO: `/v3/projects/4243c37e3bcb48b0a62103a25160eb80/users/3beb6ae020154a5188a17f67625e0e0a/roles/76578c4e1dbb4559b293fb93830ed5b2` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:11.784268 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41067adb-1410-4b56-a744-d6cd68e4d480 None admin] RBAC: Authorizing `identity:create_grant(project_id=4243c37e3bcb48b0a62103a25160eb80, user_id=3beb6ae020154a5188a17f67625e0e0a, role_id=76578c4e1dbb4559b293fb93830ed5b2)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:11.785712 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41067adb-1410-4b56-a744-d6cd68e4d480 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:11.814149 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 117/234] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 03:30:11 2022] PUT /identity/v3/projects/4243c37e3bcb48b0a62103a25160eb80/users/3beb6ae020154a5188a17f67625e0e0a/roles/76578c4e1dbb4559b293fb93830ed5b2 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:30:12.748734 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa645b71-c1c9-48fc-a7c1-89359ee4aee0 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:12.748734 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa645b71-c1c9-48fc-a7c1-89359ee4aee0 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:12.748734 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa645b71-c1c9-48fc-a7c1-89359ee4aee0 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:12.748734 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 118/235] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:12.759871 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea389a-256e-409b-a4e3-80e6435c49b4 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:12.760722 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea389a-256e-409b-a4e3-80e6435c49b4 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:12.761247 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea389a-256e-409b-a4e3-80e6435c49b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:12.782759 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-cbea389a-256e-409b-a4e3-80e6435c49b4 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:12.784282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-cbea389a-256e-409b-a4e3-80e6435c49b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:12.875031 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee717d-c09e-40ed-8d81-0eeee230c0fa None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:12.875682 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee717d-c09e-40ed-8d81-0eeee230c0fa None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:12.876193 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee717d-c09e-40ed-8d81-0eeee230c0fa None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:12.877782 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 119/236] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:12.884012 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3684e-40aa-4166-961f-fbd9a99c77a7 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:12.884535 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3684e-40aa-4166-961f-fbd9a99c77a7 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:12.885021 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3684e-40aa-4166-961f-fbd9a99c77a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:12.902253 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 118/237] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:30:12.906596 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-8ec3684e-40aa-4166-961f-fbd9a99c77a7 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:12.908007 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8ec3684e-40aa-4166-961f-fbd9a99c77a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:12.938699 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea389a-256e-409b-a4e3-80e6435c49b4 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:12.951247 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:12.987236 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:13.033898 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 120/238] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:30:13.073002 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3684e-40aa-4166-961f-fbd9a99c77a7 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:13.110809 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea389a-256e-409b-a4e3-80e6435c49b4 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:13.159081 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db62187-62e7-4f9d-a261-4c366482040c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:13.160454 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db62187-62e7-4f9d-a261-4c366482040c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:13.161063 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db62187-62e7-4f9d-a261-4c366482040c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:13.161491 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db62187-62e7-4f9d-a261-4c366482040c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:13.162850 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db62187-62e7-4f9d-a261-4c366482040c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:13.165025 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db62187-62e7-4f9d-a261-4c366482040c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:13.167021 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 119/239] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:30:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:30:13.172638 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db62187-62e7-4f9d-a261-4c366482040c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:13.258430 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3684e-40aa-4166-961f-fbd9a99c77a7 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:13.295990 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f808af90-862a-4c20-a871-e0e97b4279ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:13.297036 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808af90-862a-4c20-a871-e0e97b4279ae None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:13.297470 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808af90-862a-4c20-a871-e0e97b4279ae None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:13.297919 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f808af90-862a-4c20-a871-e0e97b4279ae None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:13.319814 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f808af90-862a-4c20-a871-e0e97b4279ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:13.334883 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-f808af90-862a-4c20-a871-e0e97b4279ae None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 03:30:13.334883 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:13.334883 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:13.334883 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:13.334883 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:13.334883 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:13.334883 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:13.334883 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:13.334883 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:13.334883 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:13.334883 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:13.334883 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:13.334883 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:13.334883 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:13.334883 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:13.334883 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:13.336465 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:13.336465 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:13.336465 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:13.336465 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:13.336465 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:13.336465 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:13.336465 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:13.336465 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:13.336465 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:13.336465 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:13.336465 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:13.336465 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:13.336465 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:13.336465 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:13.336465 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:13.336465 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:13.337252 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:13.337252 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:13.337252 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:13.337252 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:13.337252 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:13.337252 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:13.337252 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:13.337252 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:13.337252 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:13.337252 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:13.337252 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 03:30:13.337252 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:30:13.337252 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 121/240] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:30:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:30:13.340985 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae4d27-b339-4ced-b04b-64c691a64359 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:13.340985 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae4d27-b339-4ced-b04b-64c691a64359 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:13.340985 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae4d27-b339-4ced-b04b-64c691a64359 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:13.340985 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 122/241] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:13.346894 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae4d27-b339-4ced-b04b-64c691a64359 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:13.360603 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:13.384486 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:13.397634 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db62187-62e7-4f9d-a261-4c366482040c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:13.440786 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1887175-3fd2-42d8-a535-4190ca967c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:13.441842 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1887175-3fd2-42d8-a535-4190ca967c45 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:13.442353 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1887175-3fd2-42d8-a535-4190ca967c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:13.442885 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1887175-3fd2-42d8-a535-4190ca967c45 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:13.443809 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1887175-3fd2-42d8-a535-4190ca967c45 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:13.446234 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1887175-3fd2-42d8-a535-4190ca967c45 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:13.469776 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 120/242] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jul 21 03:30:13 2022] POST /identity/v3/users => generated 293 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:30:13.471903 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a58ad64-2bcf-45d9-9879-c220b9d01a1c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:13.472505 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a58ad64-2bcf-45d9-9879-c220b9d01a1c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:13.473020 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a58ad64-2bcf-45d9-9879-c220b9d01a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:13.476736 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae4d27-b339-4ced-b04b-64c691a64359 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:13.504509 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-4a58ad64-2bcf-45d9-9879-c220b9d01a1c None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:13.509839 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4a58ad64-2bcf-45d9-9879-c220b9d01a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:13.552158 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2e6ee-9593-4909-bda8-56aae171bbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:13.555829 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2e6ee-9593-4909-bda8-56aae171bbe8 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:13.556370 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2e6ee-9593-4909-bda8-56aae171bbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:13.556854 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2e6ee-9593-4909-bda8-56aae171bbe8 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:13.560995 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a2e6ee-9593-4909-bda8-56aae171bbe8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:13.562659 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a2e6ee-9593-4909-bda8-56aae171bbe8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:13.564509 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a2e6ee-9593-4909-bda8-56aae171bbe8 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:13.582043 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 123/243] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 03:30:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:13.592798 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2e6ee-9593-4909-bda8-56aae171bbe8 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:13.635385 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 121/244] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:30:13.677560 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5fef9-40cb-4189-ac67-554e49a5581c None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:13.677872 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5fef9-40cb-4189-ac67-554e49a5581c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:13.678421 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c5fef9-40cb-4189-ac67-554e49a5581c None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:13.680273 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 122/245] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 03:30:13.683991 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5fef9-40cb-4189-ac67-554e49a5581c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:13.727488 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:13.761365 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2e6ee-9593-4909-bda8-56aae171bbe8 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:13.799248 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327e5f2-9bb6-4cb4-999d-fb8e73257333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:13.800594 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327e5f2-9bb6-4cb4-999d-fb8e73257333 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:13.800594 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327e5f2-9bb6-4cb4-999d-fb8e73257333 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:13.801028 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327e5f2-9bb6-4cb4-999d-fb8e73257333 None admin] PATH_INFO: `/v3/users/a4a221739b93460c89ec315ebe84a606` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:13.803184 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:13.823599 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6327e5f2-9bb6-4cb4-999d-fb8e73257333 None admin] RBAC: Authorizing `identity:get_user(user_id=a4a221739b93460c89ec315ebe84a606)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:13.825399 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6327e5f2-9bb6-4cb4-999d-fb8e73257333 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:13.828499 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 124/246] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:30:13 2022] GET /identity/v3/users/a4a221739b93460c89ec315ebe84a606 => generated 297 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:13.829795 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7780e-55eb-4271-a799-09ec48352ff5 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:13.830081 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7780e-55eb-4271-a799-09ec48352ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:13.830358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f7780e-55eb-4271-a799-09ec48352ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:13.836390 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c5fef9-40cb-4189-ac67-554e49a5581c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:13.852069 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-f7f7780e-55eb-4271-a799-09ec48352ff5 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:13.854041 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f7f7780e-55eb-4271-a799-09ec48352ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:13.887131 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379966c0-549a-46f7-9cc7-65fc40651043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:13.888840 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379966c0-549a-46f7-9cc7-65fc40651043 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:13.889127 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379966c0-549a-46f7-9cc7-65fc40651043 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:13.889403 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379966c0-549a-46f7-9cc7-65fc40651043 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:13.903682 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379966c0-549a-46f7-9cc7-65fc40651043 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:13.913402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-379966c0-549a-46f7-9cc7-65fc40651043 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 03:30:13.913402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:13.913402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:13.913402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:13.913402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:13.913402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:13.913402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:13.913402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:13.913402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:13.913402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:13.913402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:13.913402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:13.913402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:13.913402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:13.913402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:13.913402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:13.914370 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:13.914370 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:13.914370 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:13.914370 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:13.914370 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:13.914370 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:13.914370 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:13.914370 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:13.914370 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:13.914370 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:13.914370 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:13.914370 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:13.914370 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:13.914370 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:13.914370 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:13.914370 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:13.915556 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:13.915556 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:13.915556 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:13.915556 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:13.915556 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:13.915556 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:13.915556 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:13.915556 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:13.915556 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:13.915556 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:13.915556 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 03:30:13.915556 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:13.915556 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 123/247] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:30:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:13.915556 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379966c0-549a-46f7-9cc7-65fc40651043 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:13.942444 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 125/248] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:30:13.943713 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f7780e-55eb-4271-a799-09ec48352ff5 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:14.048958 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:14.053894 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379966c0-549a-46f7-9cc7-65fc40651043 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:14.092913 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e76750-f759-4edc-b787-2151a2e895b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:14.093921 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e76750-f759-4edc-b787-2151a2e895b1 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:14.094412 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e76750-f759-4edc-b787-2151a2e895b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:14.094885 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e76750-f759-4edc-b787-2151a2e895b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:14.107335 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:14.162427 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f7780e-55eb-4271-a799-09ec48352ff5 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:14.174100 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e76750-f759-4edc-b787-2151a2e895b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:14.175908 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e76750-f759-4edc-b787-2151a2e895b1 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:14.276342 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c07b4c-027e-4031-b4fe-d5ffda8f2224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:14.276342 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c07b4c-027e-4031-b4fe-d5ffda8f2224 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:14.276342 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c07b4c-027e-4031-b4fe-d5ffda8f2224 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:14.276688 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c07b4c-027e-4031-b4fe-d5ffda8f2224 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:14.277521 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c07b4c-027e-4031-b4fe-d5ffda8f2224 None admin] RBAC: Adding query filter params (name=member) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:14.277798 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c07b4c-027e-4031-b4fe-d5ffda8f2224 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:14.279277 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c07b4c-027e-4031-b4fe-d5ffda8f2224 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:14.293177 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 124/249] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:30:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 03:30:14.294427 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e76750-f759-4edc-b787-2151a2e895b1 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:14.313806 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 126/250] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 03:30:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:14.314617 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c07b4c-027e-4031-b4fe-d5ffda8f2224 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:14.346831 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:14.419090 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e76750-f759-4edc-b787-2151a2e895b1 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:14.458835 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f7008-10fa-4a95-a62b-d14e88a8cbaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:14.460088 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f7008-10fa-4a95-a62b-d14e88a8cbaa None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:14.461466 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f7008-10fa-4a95-a62b-d14e88a8cbaa None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:14.461950 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176f7008-10fa-4a95-a62b-d14e88a8cbaa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:14.479008 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176f7008-10fa-4a95-a62b-d14e88a8cbaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:14.488150 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-176f7008-10fa-4a95-a62b-d14e88a8cbaa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:30:14.488150 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:14.488150 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:14.488150 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:14.488150 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:14.488150 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:14.488150 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:14.488150 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:14.488150 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:14.488150 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:14.488150 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:14.488150 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:14.488150 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:14.488150 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:14.488150 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:14.488150 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:14.489049 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:14.489049 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:14.489049 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:14.489049 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:14.489049 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:14.489049 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:14.489049 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:14.489049 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:14.489049 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:14.489049 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:14.489049 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:14.489049 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:14.489049 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:14.489049 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:14.489049 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:14.489049 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:14.489836 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:14.489836 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:14.489836 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:14.489836 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:14.489836 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:14.489836 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:14.489836 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:14.489836 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:14.489836 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:14.489836 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:14.489836 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:30:14.489836 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:14.492805 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 125/251] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 03:30:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:14.493932 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f7008-10fa-4a95-a62b-d14e88a8cbaa None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:14.607830 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176f7008-10fa-4a95-a62b-d14e88a8cbaa None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:14.611004 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:14.644496 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c07b4c-027e-4031-b4fe-d5ffda8f2224 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:14.647413 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6561d-be51-4d8d-b327-adb47ffa2a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:14.649559 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6561d-be51-4d8d-b327-adb47ffa2a75 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:14.650050 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6561d-be51-4d8d-b327-adb47ffa2a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:14.650637 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6561d-be51-4d8d-b327-adb47ffa2a75 None admin] PATH_INFO: `/v3/users/a14bac39cadc4375b806aabad39f96df` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:14.654799 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6561d-be51-4d8d-b327-adb47ffa2a75 None admin] RBAC: Authorizing `identity:get_user(user_id=a14bac39cadc4375b806aabad39f96df)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:14.658156 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6561d-be51-4d8d-b327-adb47ffa2a75 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:14.665043 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 126/252] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:30:14 2022] GET /identity/v3/users/a14bac39cadc4375b806aabad39f96df => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:14.666088 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6561d-be51-4d8d-b327-adb47ffa2a75 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:14.701922 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:14.736305 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97521fad-065a-4162-b23b-8e569e0e03e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:14.737957 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97521fad-065a-4162-b23b-8e569e0e03e3 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:14.738990 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97521fad-065a-4162-b23b-8e569e0e03e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:14.739530 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97521fad-065a-4162-b23b-8e569e0e03e3 None admin] PATH_INFO: `/v3/projects/4243c37e3bcb48b0a62103a25160eb80` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:14.742424 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97521fad-065a-4162-b23b-8e569e0e03e3 None admin] RBAC: Authorizing `identity:get_project(project_id=4243c37e3bcb48b0a62103a25160eb80)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:14.744544 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97521fad-065a-4162-b23b-8e569e0e03e3 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:14.750059 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 127/253] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:30:14 2022] GET /identity/v3/projects/4243c37e3bcb48b0a62103a25160eb80 => generated 302 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:14.751918 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931b680-71a0-4bce-8a89-819b42ed3ab9 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:14.754673 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931b680-71a0-4bce-8a89-819b42ed3ab9 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:14.755051 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1931b680-71a0-4bce-8a89-819b42ed3ab9 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:14.756562 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 128/254] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:14.762957 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931b680-71a0-4bce-8a89-819b42ed3ab9 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:14.875424 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6561d-be51-4d8d-b327-adb47ffa2a75 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:14.939818 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b58a0a5-e03f-49d7-b9da-cbe82a5394e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:14.940598 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58a0a5-e03f-49d7-b9da-cbe82a5394e1 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:14.941375 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58a0a5-e03f-49d7-b9da-cbe82a5394e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:14.942405 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58a0a5-e03f-49d7-b9da-cbe82a5394e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:14.943329 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b58a0a5-e03f-49d7-b9da-cbe82a5394e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:14.944493 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b58a0a5-e03f-49d7-b9da-cbe82a5394e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:14.947033 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b58a0a5-e03f-49d7-b9da-cbe82a5394e1 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:14.961749 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 127/255] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:30:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:14.962726 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1931b680-71a0-4bce-8a89-819b42ed3ab9 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:14.964672 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b58a0a5-e03f-49d7-b9da-cbe82a5394e1 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:15.010944 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:15.047786 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a305621-f534-4a63-b842-4414ce12c9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:15.048977 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a305621-f534-4a63-b842-4414ce12c9fd None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:15.049471 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a305621-f534-4a63-b842-4414ce12c9fd None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:15.049977 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a305621-f534-4a63-b842-4414ce12c9fd None admin] PATH_INFO: `/v3/projects/4243c37e3bcb48b0a62103a25160eb80` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:15.051478 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a305621-f534-4a63-b842-4414ce12c9fd None admin] RBAC: Authorizing `identity:get_project(project_id=4243c37e3bcb48b0a62103a25160eb80)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:15.053246 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a305621-f534-4a63-b842-4414ce12c9fd None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:15.055707 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 129/256] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:30:14 2022] GET /identity/v3/projects/4243c37e3bcb48b0a62103a25160eb80 => generated 302 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:15.057318 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416bc10-3fc4-48c8-ba09-9f97ad028a06 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:15.057824 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416bc10-3fc4-48c8-ba09-9f97ad028a06 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:15.058302 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1416bc10-3fc4-48c8-ba09-9f97ad028a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:15.096329 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-1416bc10-3fc4-48c8-ba09-9f97ad028a06 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:15.098927 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1416bc10-3fc4-48c8-ba09-9f97ad028a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:15.161196 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b58a0a5-e03f-49d7-b9da-cbe82a5394e1 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:15.207733 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d2ce93-3b24-4dda-acac-5b3c173f8079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:15.208407 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2ce93-3b24-4dda-acac-5b3c173f8079 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:15.208695 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2ce93-3b24-4dda-acac-5b3c173f8079 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:15.208972 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d2ce93-3b24-4dda-acac-5b3c173f8079 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:15.211169 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d2ce93-3b24-4dda-acac-5b3c173f8079 None admin] RBAC: Adding query filter params (role.id=8670c500985c4abea21f372ef30378a6, scope.project.id=4243c37e3bcb48b0a62103a25160eb80, user.id=a4a221739b93460c89ec315ebe84a606) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:15.211502 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d2ce93-3b24-4dda-acac-5b3c173f8079 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:15.214313 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d2ce93-3b24-4dda-acac-5b3c173f8079 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:15.225712 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 128/257] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:30:14 2022] GET /identity/v3/role_assignments?user.id=a4a221739b93460c89ec315ebe84a606&scope.project.id=4243c37e3bcb48b0a62103a25160eb80&role.id=8670c500985c4abea21f372ef30378a6 => generated 259 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:15.226904 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d2ce93-3b24-4dda-acac-5b3c173f8079 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:15.258844 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:15.305374 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 130/258] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:30:15.314369 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416bc10-3fc4-48c8-ba09-9f97ad028a06 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:15.520067 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:15.533214 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d2ce93-3b24-4dda-acac-5b3c173f8079 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:15.578956 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1416bc10-3fc4-48c8-ba09-9f97ad028a06 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:15.609376 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f61c1-5132-4fd4-a636-d5b97807d2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:15.610655 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f61c1-5132-4fd4-a636-d5b97807d2a6 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:15.611164 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f61c1-5132-4fd4-a636-d5b97807d2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:15.611642 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f61c1-5132-4fd4-a636-d5b97807d2a6 None admin] PATH_INFO: `/v3/users/3beb6ae020154a5188a17f67625e0e0a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:15.619389 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73f61c1-5132-4fd4-a636-d5b97807d2a6 None admin] RBAC: Authorizing `identity:get_user(user_id=3beb6ae020154a5188a17f67625e0e0a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:15.621233 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73f61c1-5132-4fd4-a636-d5b97807d2a6 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:15.623174 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 129/259] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:30:15 2022] GET /identity/v3/users/3beb6ae020154a5188a17f67625e0e0a => generated 283 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:15.627190 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f61c1-5132-4fd4-a636-d5b97807d2a6 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:15.682657 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f895ec-72a7-43c0-a3bd-3bf5ac0c9940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:15.682657 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f895ec-72a7-43c0-a3bd-3bf5ac0c9940 None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:15.682657 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f895ec-72a7-43c0-a3bd-3bf5ac0c9940 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:15.682657 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f895ec-72a7-43c0-a3bd-3bf5ac0c9940 None admin] PATH_INFO: `/v3/projects/4243c37e3bcb48b0a62103a25160eb80/users/a14bac39cadc4375b806aabad39f96df/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:15.683536 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f895ec-72a7-43c0-a3bd-3bf5ac0c9940 None admin] RBAC: Authorizing `identity:create_grant(project_id=4243c37e3bcb48b0a62103a25160eb80, user_id=a14bac39cadc4375b806aabad39f96df, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:15.685101 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f895ec-72a7-43c0-a3bd-3bf5ac0c9940 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:15.726051 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 131/260] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 03:30:15 2022] PUT /identity/v3/projects/4243c37e3bcb48b0a62103a25160eb80/users/a14bac39cadc4375b806aabad39f96df/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:30:15.732601 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f895ec-72a7-43c0-a3bd-3bf5ac0c9940 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:15.783420 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f61c1-5132-4fd4-a636-d5b97807d2a6 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:15.885496 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:15.923265 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453d8b5-1ca2-4275-bf13-7dc7964badbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:15.924175 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453d8b5-1ca2-4275-bf13-7dc7964badbe None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:15.924464 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453d8b5-1ca2-4275-bf13-7dc7964badbe None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:15.924740 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453d8b5-1ca2-4275-bf13-7dc7964badbe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:15.965976 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f895ec-72a7-43c0-a3bd-3bf5ac0c9940 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:15.967510 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b453d8b5-1ca2-4275-bf13-7dc7964badbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:15.980049 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-b453d8b5-1ca2-4275-bf13-7dc7964badbe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 03:30:15.980049 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:15.980049 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:15.980049 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:15.980049 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:15.980049 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:15.980049 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:15.980049 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:15.980049 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:15.980049 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:15.980049 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:15.980049 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:15.980049 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:15.980049 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:15.980049 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:15.980049 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:15.981082 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:15.981082 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:15.981082 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:15.981082 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:15.981082 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:15.981082 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:15.981082 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:15.981082 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:15.981082 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:15.981082 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:15.981082 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:15.981082 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:15.981082 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:15.981082 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:15.981082 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:15.981082 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:15.981888 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:15.981888 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:15.981888 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:15.981888 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:15.981888 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:15.981888 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:15.981888 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:15.981888 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:15.981888 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:15.981888 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:15.981888 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 03:30:15.981888 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:15.981888 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 130/261] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jul 21 03:30:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:15.988563 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453d8b5-1ca2-4275-bf13-7dc7964badbe None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:16.027677 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31f7b5-0f8a-4f8c-a15c-3372ce22ceb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:16.028737 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31f7b5-0f8a-4f8c-a15c-3372ce22ceb5 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:16.029228 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31f7b5-0f8a-4f8c-a15c-3372ce22ceb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:16.029706 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31f7b5-0f8a-4f8c-a15c-3372ce22ceb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:16.062382 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:16.125741 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a31f7b5-0f8a-4f8c-a15c-3372ce22ceb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:16.128056 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a31f7b5-0f8a-4f8c-a15c-3372ce22ceb5 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:16.187922 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453d8b5-1ca2-4275-bf13-7dc7964badbe None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:16.274860 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:16.300147 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04f03c-24a7-4897-ad9b-30104f8c9b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:16.306140 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04f03c-24a7-4897-ad9b-30104f8c9b36 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:16.306140 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04f03c-24a7-4897-ad9b-30104f8c9b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:16.306140 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04f03c-24a7-4897-ad9b-30104f8c9b36 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:16.306140 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04f03c-24a7-4897-ad9b-30104f8c9b36 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:16.306140 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04f03c-24a7-4897-ad9b-30104f8c9b36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:16.309826 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04f03c-24a7-4897-ad9b-30104f8c9b36 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:16.334508 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 131/262] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:30:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:16.342479 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9513477-ddad-400b-bfd1-d3b4b21b3d67 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:16.342479 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9513477-ddad-400b-bfd1-d3b4b21b3d67 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:16.342479 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9513477-ddad-400b-bfd1-d3b4b21b3d67 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:16.354477 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 132/263] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:16 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:16.358476 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0e946-88e5-4eb6-b53e-d9a6475d5d52 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:16.358476 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0e946-88e5-4eb6-b53e-d9a6475d5d52 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:16.358476 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde0e946-88e5-4eb6-b53e-d9a6475d5d52 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:16.364428 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 133/264] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:16 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:16.372258 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0e946-88e5-4eb6-b53e-d9a6475d5d52 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:16.471272 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 132/265] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:30:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 745 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 03:30:16.475072 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc962856-6175-4433-a049-46d168a178ef None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:16.478476 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc962856-6175-4433-a049-46d168a178ef None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:16.478476 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc962856-6175-4433-a049-46d168a178ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:16.530847 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-fc962856-6175-4433-a049-46d168a178ef None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:16.536210 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fc962856-6175-4433-a049-46d168a178ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:16.775491 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:16.799038 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 133/266] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:30:16.800589 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ee543-5979-4f5f-9de5-e31ad24779c7 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:16.801038 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ee543-5979-4f5f-9de5-e31ad24779c7 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:16.801474 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ee543-5979-4f5f-9de5-e31ad24779c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:16.831559 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde0e946-88e5-4eb6-b53e-d9a6475d5d52 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:16.859520 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-346ee543-5979-4f5f-9de5-e31ad24779c7 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:16.865173 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-346ee543-5979-4f5f-9de5-e31ad24779c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:16.933146 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffefb7c-9dc0-4a68-8703-603bbc3d3501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:16.934038 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffefb7c-9dc0-4a68-8703-603bbc3d3501 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:16.934325 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffefb7c-9dc0-4a68-8703-603bbc3d3501 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:16.934640 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffefb7c-9dc0-4a68-8703-603bbc3d3501 None admin] PATH_INFO: `/v3/users/3beb6ae020154a5188a17f67625e0e0a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:16.936069 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffefb7c-9dc0-4a68-8703-603bbc3d3501 None admin] RBAC: Authorizing `identity:get_user(user_id=3beb6ae020154a5188a17f67625e0e0a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:16.937563 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffefb7c-9dc0-4a68-8703-603bbc3d3501 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:16.939422 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 134/267] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:30:16 2022] GET /identity/v3/users/3beb6ae020154a5188a17f67625e0e0a => generated 283 bytes in 575 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:16.946933 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffefb7c-9dc0-4a68-8703-603bbc3d3501 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:16.956193 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 134/268] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:30:16.957665 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ee543-5979-4f5f-9de5-e31ad24779c7 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:16.970664 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:17.084484 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffefb7c-9dc0-4a68-8703-603bbc3d3501 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:17.089875 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ee543-5979-4f5f-9de5-e31ad24779c7 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:17.123876 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc98a1e-5319-4bb6-a542-29268cad17f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:17.124855 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc98a1e-5319-4bb6-a542-29268cad17f4 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:17.125244 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc98a1e-5319-4bb6-a542-29268cad17f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:17.125647 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc98a1e-5319-4bb6-a542-29268cad17f4 None admin] PATH_INFO: `/v3/projects/4243c37e3bcb48b0a62103a25160eb80` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:17.127017 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc98a1e-5319-4bb6-a542-29268cad17f4 None admin] RBAC: Authorizing `identity:get_project(project_id=4243c37e3bcb48b0a62103a25160eb80)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:17.128579 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc98a1e-5319-4bb6-a542-29268cad17f4 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:17.130824 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 135/269] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:30:16 2022] GET /identity/v3/projects/4243c37e3bcb48b0a62103a25160eb80 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:17.131745 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc98a1e-5319-4bb6-a542-29268cad17f4 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:17.137120 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60911d-27a8-40f3-b74a-8086cc13e135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:17.138134 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60911d-27a8-40f3-b74a-8086cc13e135 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:17.138593 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60911d-27a8-40f3-b74a-8086cc13e135 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:17.139009 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60911d-27a8-40f3-b74a-8086cc13e135 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:17.140337 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c60911d-27a8-40f3-b74a-8086cc13e135 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:17.141925 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c60911d-27a8-40f3-b74a-8086cc13e135 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:17.144625 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 135/270] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:30:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:17.145583 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60911d-27a8-40f3-b74a-8086cc13e135 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:17.158985 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:17.242715 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:17.253701 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc98a1e-5319-4bb6-a542-29268cad17f4 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:17.276748 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c60911d-27a8-40f3-b74a-8086cc13e135 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:17.303974 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece46859-9110-47b0-a538-c05fec3a1a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:17.304780 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece46859-9110-47b0-a538-c05fec3a1a27 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:17.305139 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece46859-9110-47b0-a538-c05fec3a1a27 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:17.305497 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece46859-9110-47b0-a538-c05fec3a1a27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:17.318886 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20661f3-965a-49af-bc3f-847f1978239a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:17.320885 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20661f3-965a-49af-bc3f-847f1978239a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:17.321381 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20661f3-965a-49af-bc3f-847f1978239a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:17.322225 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20661f3-965a-49af-bc3f-847f1978239a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:17.335603 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20661f3-965a-49af-bc3f-847f1978239a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:17.347155 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-f20661f3-965a-49af-bc3f-847f1978239a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 03:30:17.347155 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:17.347155 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:17.347155 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:17.347155 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:17.347155 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:17.347155 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:17.347155 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:17.347155 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:17.347155 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:17.347155 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:17.347155 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:17.347155 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:17.347155 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:17.347155 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:17.347155 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:17.348006 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:17.348006 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:17.348006 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:17.348006 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:17.348006 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:17.348006 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:17.348006 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:17.348006 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:17.348006 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:17.348006 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:17.348006 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:17.348006 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:17.348006 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:17.348006 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:17.348006 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:17.348006 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:17.348795 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:17.348795 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:17.348795 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:17.348795 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:17.348795 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:17.348795 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:17.348795 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:17.348795 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:17.348795 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:17.348795 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:17.348795 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 03:30:17.348795 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:30:17.352028 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 136/271] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:30:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:17.353011 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20661f3-965a-49af-bc3f-847f1978239a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:17.396081 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece46859-9110-47b0-a538-c05fec3a1a27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:17.398015 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece46859-9110-47b0-a538-c05fec3a1a27 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:17.419688 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:17.472930 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20661f3-965a-49af-bc3f-847f1978239a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:17.509100 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 136/272] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:30:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 03:30:17.510182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece46859-9110-47b0-a538-c05fec3a1a27 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:17.512903 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302399f0-baa4-494c-a62b-532e79e4e0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:17.513933 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302399f0-baa4-494c-a62b-532e79e4e0dc None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:17.514224 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302399f0-baa4-494c-a62b-532e79e4e0dc None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:17.518497 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302399f0-baa4-494c-a62b-532e79e4e0dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:17.518497 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302399f0-baa4-494c-a62b-532e79e4e0dc None admin] RBAC: Adding query filter params (role.id=27e53d6c56f24c25a8c8057bfd36bcf1, scope.project.id=4243c37e3bcb48b0a62103a25160eb80, user.id=3beb6ae020154a5188a17f67625e0e0a) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:17.518497 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302399f0-baa4-494c-a62b-532e79e4e0dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:17.518497 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302399f0-baa4-494c-a62b-532e79e4e0dc None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:17.520673 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:17.530488 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 137/273] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:30:17 2022] GET /identity/v3/role_assignments?user.id=3beb6ae020154a5188a17f67625e0e0a&scope.project.id=4243c37e3bcb48b0a62103a25160eb80&role.id=27e53d6c56f24c25a8c8057bfd36bcf1 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:17.530488 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302399f0-baa4-494c-a62b-532e79e4e0dc None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:17.652249 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302399f0-baa4-494c-a62b-532e79e4e0dc None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:17.657580 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece46859-9110-47b0-a538-c05fec3a1a27 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:17.680606 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:17.704575 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f453f751-dc23-4062-92e9-9f18903cf122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:17.704575 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453f751-dc23-4062-92e9-9f18903cf122 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:17.704834 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453f751-dc23-4062-92e9-9f18903cf122 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:17.704902 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453f751-dc23-4062-92e9-9f18903cf122 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:17.705654 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f453f751-dc23-4062-92e9-9f18903cf122 None admin] RBAC: Adding query filter params (name=member) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:17.705961 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f453f751-dc23-4062-92e9-9f18903cf122 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:17.706401 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6567352-26f1-485d-81d2-819a62d5dcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:17.707959 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f453f751-dc23-4062-92e9-9f18903cf122 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:17.708139 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6567352-26f1-485d-81d2-819a62d5dcd7 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:17.708419 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6567352-26f1-485d-81d2-819a62d5dcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:17.709169 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6567352-26f1-485d-81d2-819a62d5dcd7 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:17.709413 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6567352-26f1-485d-81d2-819a62d5dcd7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:17.711707 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6567352-26f1-485d-81d2-819a62d5dcd7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:17.717874 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 138/274] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 03:30:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:17.719646 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffea8f-ba8d-41c0-9f0e-e2dcfa976e85 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:17.719646 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffea8f-ba8d-41c0-9f0e-e2dcfa976e85 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:17.719646 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffea8f-ba8d-41c0-9f0e-e2dcfa976e85 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:17.722196 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 139/275] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:17.722196 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ffea8f-ba8d-41c0-9f0e-e2dcfa976e85 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:17.743811 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 137/276] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jul 21 03:30:17 2022] POST /identity/v3/users => generated 293 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:30:17.744720 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6567352-26f1-485d-81d2-819a62d5dcd7 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:17.804381 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:17.882493 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ffea8f-ba8d-41c0-9f0e-e2dcfa976e85 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:17.906486 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6567352-26f1-485d-81d2-819a62d5dcd7 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:17.927919 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e89a8-1cd7-4dd2-9f52-4c4cc06eb4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:17.928787 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e89a8-1cd7-4dd2-9f52-4c4cc06eb4e3 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:17.931120 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e89a8-1cd7-4dd2-9f52-4c4cc06eb4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:17.931120 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e89a8-1cd7-4dd2-9f52-4c4cc06eb4e3 None admin] PATH_INFO: `/v3/projects/4243c37e3bcb48b0a62103a25160eb80` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:17.931305 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e89a8-1cd7-4dd2-9f52-4c4cc06eb4e3 None admin] RBAC: Authorizing `identity:get_project(project_id=4243c37e3bcb48b0a62103a25160eb80)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:17.935135 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e89a8-1cd7-4dd2-9f52-4c4cc06eb4e3 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:17.936650 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 140/277] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:30:17 2022] GET /identity/v3/projects/4243c37e3bcb48b0a62103a25160eb80 => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:17.937778 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3d9ac-df26-4644-891b-78291c3e087c None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:17.938061 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3d9ac-df26-4644-891b-78291c3e087c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:17.938331 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3d9ac-df26-4644-891b-78291c3e087c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:17.961904 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-e7f3d9ac-df26-4644-891b-78291c3e087c None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:17.962670 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbbdbc2-764e-4c74-a0e5-e9960b283833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:17.963889 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e7f3d9ac-df26-4644-891b-78291c3e087c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:17.963998 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbdbc2-764e-4c74-a0e5-e9960b283833 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:17.963998 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbdbc2-764e-4c74-a0e5-e9960b283833 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:17.964149 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbdbc2-764e-4c74-a0e5-e9960b283833 None admin] PATH_INFO: `/v3/users/6d1c8601b9974771bd7aee8ec2a17aaa` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:17.985817 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbbdbc2-764e-4c74-a0e5-e9960b283833 None admin] RBAC: Authorizing `identity:get_user(user_id=6d1c8601b9974771bd7aee8ec2a17aaa)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:17.987722 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbbdbc2-764e-4c74-a0e5-e9960b283833 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:17.989466 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 138/278] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:30:17 2022] GET /identity/v3/users/6d1c8601b9974771bd7aee8ec2a17aaa => generated 293 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:17.990307 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbbdbc2-764e-4c74-a0e5-e9960b283833 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:18.031892 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:18.063177 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 141/279] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:30:18.063948 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3d9ac-df26-4644-891b-78291c3e087c None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:18.119277 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbbdbc2-764e-4c74-a0e5-e9960b283833 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:18.151011 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:18.167280 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601e590-6e89-475b-b3c5-385277d2af8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:18.167683 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601e590-6e89-475b-b3c5-385277d2af8a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:18.167966 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601e590-6e89-475b-b3c5-385277d2af8a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:18.168239 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601e590-6e89-475b-b3c5-385277d2af8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:18.169107 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4601e590-6e89-475b-b3c5-385277d2af8a None admin] RBAC: Adding query filter params (role.id=76578c4e1dbb4559b293fb93830ed5b2, scope.project.id=4243c37e3bcb48b0a62103a25160eb80, user.id=3beb6ae020154a5188a17f67625e0e0a) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:18.169422 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4601e590-6e89-475b-b3c5-385277d2af8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:18.171501 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4601e590-6e89-475b-b3c5-385277d2af8a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:18.179315 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 139/280] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:30:17 2022] GET /identity/v3/role_assignments?user.id=3beb6ae020154a5188a17f67625e0e0a&scope.project.id=4243c37e3bcb48b0a62103a25160eb80&role.id=76578c4e1dbb4559b293fb93830ed5b2 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:18.181042 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601e590-6e89-475b-b3c5-385277d2af8a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:18.202235 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3d9ac-df26-4644-891b-78291c3e087c None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:18.253576 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a461c98-5246-4208-8746-96c1570b811e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:18.254813 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a461c98-5246-4208-8746-96c1570b811e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:18.255102 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a461c98-5246-4208-8746-96c1570b811e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:18.255407 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a461c98-5246-4208-8746-96c1570b811e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:18.256602 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a461c98-5246-4208-8746-96c1570b811e None admin] RBAC: Adding query filter params (role.id=1ac721157e9b40f18cbbc76f5a6b0d3d, user.id=6d1c8601b9974771bd7aee8ec2a17aaa, scope.system=all) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:18.256933 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a461c98-5246-4208-8746-96c1570b811e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:18.259232 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a461c98-5246-4208-8746-96c1570b811e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:18.265671 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 142/281] 10.222.0.20 () {56 vars in 1308 bytes} [Thu Jul 21 03:30:18 2022] GET /identity/v3/role_assignments?user.id=6d1c8601b9974771bd7aee8ec2a17aaa&scope.system=all&role.id=1ac721157e9b40f18cbbc76f5a6b0d3d => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:18.267085 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9c5fc-eb86-4109-946d-8ef41bd2ff40 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:18.267378 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9c5fc-eb86-4109-946d-8ef41bd2ff40 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:18.267664 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c9c5fc-eb86-4109-946d-8ef41bd2ff40 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:18.274197 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 143/282] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:18.277476 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa8cc6-55f7-4ff4-96bf-7a6fd7fa4ffb None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:18.277780 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa8cc6-55f7-4ff4-96bf-7a6fd7fa4ffb None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:18.278065 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa8cc6-55f7-4ff4-96bf-7a6fd7fa4ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:18.324215 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-7dfa8cc6-55f7-4ff4-96bf-7a6fd7fa4ffb None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:18.325842 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7dfa8cc6-55f7-4ff4-96bf-7a6fd7fa4ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:18.366786 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:18.372675 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601e590-6e89-475b-b3c5-385277d2af8a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:18.413488 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192d0b6-1d0d-4231-a009-5ebf19089108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:18.414759 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192d0b6-1d0d-4231-a009-5ebf19089108 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:18.415264 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192d0b6-1d0d-4231-a009-5ebf19089108 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:18.415755 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192d0b6-1d0d-4231-a009-5ebf19089108 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:18.430334 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192d0b6-1d0d-4231-a009-5ebf19089108 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:18.439534 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-9192d0b6-1d0d-4231-a009-5ebf19089108 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 03:30:18.439534 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:18.439534 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:18.439534 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:18.439534 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:18.439534 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:18.439534 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:18.439534 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:18.439534 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:18.439534 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:18.439534 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:18.439534 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:18.439534 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:18.439534 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:18.439534 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:18.439534 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:18.440624 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:18.440624 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:18.440624 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:18.440624 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:18.440624 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:18.440624 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:18.440624 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:18.440624 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:18.440624 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:18.440624 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:18.440624 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:18.440624 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:18.440624 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:18.440624 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:18.440624 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:18.440624 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:18.441393 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:18.441393 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:18.441393 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:18.441393 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:18.441393 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:18.441393 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:18.441393 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:18.441393 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:18.441393 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:18.441393 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:18.441393 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 03:30:18.441393 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:18.444464 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 140/283] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:30:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:18.458130 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192d0b6-1d0d-4231-a009-5ebf19089108 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:18.469486 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 144/284] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:30:18.512051 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa8cc6-55f7-4ff4-96bf-7a6fd7fa4ffb None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:18.582902 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:18.631653 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa8cc6-55f7-4ff4-96bf-7a6fd7fa4ffb None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:18.674964 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35bbf3-a577-4f18-8b0b-bc1eb5954fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:18.675766 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35bbf3-a577-4f18-8b0b-bc1eb5954fff None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:18.676047 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35bbf3-a577-4f18-8b0b-bc1eb5954fff None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:18.676321 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35bbf3-a577-4f18-8b0b-bc1eb5954fff None admin] PATH_INFO: `/v3/roles/member` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:18.680548 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192d0b6-1d0d-4231-a009-5ebf19089108 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:18.706510 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de35bbf3-a577-4f18-8b0b-bc1eb5954fff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:18.720408 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-de35bbf3-a577-4f18-8b0b-bc1eb5954fff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 03:30:18.720408 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:18.720408 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:18.720408 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:18.720408 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:18.720408 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:18.720408 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:18.720408 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:18.720408 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:18.720408 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:18.720408 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:18.720408 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:18.720408 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:18.720408 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:18.720408 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:18.720408 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:18.721280 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:18.721280 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:18.721280 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:18.721280 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:18.721280 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:18.721280 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:18.721280 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:18.721280 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:18.721280 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:18.721280 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:18.721280 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:18.721280 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:18.721280 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:18.721280 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:18.721280 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:18.721280 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:18.722043 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:18.722043 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:18.722043 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:18.722043 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:18.722043 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:18.722043 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:18.722043 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:18.722043 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:18.722043 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:18.722043 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:18.722043 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 03:30:18.722043 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:30:18.726816 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 145/285] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:30:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:30:18.729917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35bbf3-a577-4f18-8b0b-bc1eb5954fff None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:18.752512 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43c27f-7e84-4104-87a4-56f6816ce569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:18.753186 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43c27f-7e84-4104-87a4-56f6816ce569 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:18.753469 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43c27f-7e84-4104-87a4-56f6816ce569 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:18.753740 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43c27f-7e84-4104-87a4-56f6816ce569 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:18.754514 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d43c27f-7e84-4104-87a4-56f6816ce569 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:18.754842 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d43c27f-7e84-4104-87a4-56f6816ce569 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:18.756211 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d43c27f-7e84-4104-87a4-56f6816ce569 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:18.781032 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 141/286] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 03:30:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:30:18.786597 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43c27f-7e84-4104-87a4-56f6816ce569 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:18.856730 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35bbf3-a577-4f18-8b0b-bc1eb5954fff None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:18.882869 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:18.894890 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:18.897823 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0536d6-ae2a-4a38-9961-8830416f3f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:18.900605 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0536d6-ae2a-4a38-9961-8830416f3f1d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:18.900895 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0536d6-ae2a-4a38-9961-8830416f3f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:18.901180 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0536d6-ae2a-4a38-9961-8830416f3f1d None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:18.902054 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0536d6-ae2a-4a38-9961-8830416f3f1d None admin] RBAC: Adding query filter params (name=member) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:18.902253 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0536d6-ae2a-4a38-9961-8830416f3f1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:18.906478 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0536d6-ae2a-4a38-9961-8830416f3f1d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:18.927136 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 146/287] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 03:30:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:18.931476 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0536d6-ae2a-4a38-9961-8830416f3f1d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:19.044519 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43c27f-7e84-4104-87a4-56f6816ce569 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:19.118435 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eaf7fc-06f4-460e-af87-8b1d5b51a2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:19.119275 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eaf7fc-06f4-460e-af87-8b1d5b51a2a3 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:19.119558 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eaf7fc-06f4-460e-af87-8b1d5b51a2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:19.119835 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eaf7fc-06f4-460e-af87-8b1d5b51a2a3 None admin] PATH_INFO: `/v3/users/a4a221739b93460c89ec315ebe84a606` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:19.122012 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eaf7fc-06f4-460e-af87-8b1d5b51a2a3 None admin] RBAC: Authorizing `identity:get_user(user_id=a4a221739b93460c89ec315ebe84a606)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:19.123478 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eaf7fc-06f4-460e-af87-8b1d5b51a2a3 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:19.131852 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0536d6-ae2a-4a38-9961-8830416f3f1d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:19.133660 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 142/288] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:30:18 2022] GET /identity/v3/users/a4a221739b93460c89ec315ebe84a606 => generated 297 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:19.135266 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eaf7fc-06f4-460e-af87-8b1d5b51a2a3 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:19.184740 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee792a7-ce61-47e4-bdd2-d3b750b53b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:19.185634 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee792a7-ce61-47e4-bdd2-d3b750b53b27 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:19.185915 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee792a7-ce61-47e4-bdd2-d3b750b53b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:19.186195 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee792a7-ce61-47e4-bdd2-d3b750b53b27 None admin] PATH_INFO: `/v3/users/a14bac39cadc4375b806aabad39f96df` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:19.187831 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee792a7-ce61-47e4-bdd2-d3b750b53b27 None admin] RBAC: Authorizing `identity:get_user(user_id=a14bac39cadc4375b806aabad39f96df)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:19.189307 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee792a7-ce61-47e4-bdd2-d3b750b53b27 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:19.191286 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 147/289] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:30:18 2022] GET /identity/v3/users/a14bac39cadc4375b806aabad39f96df => generated 297 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:19.203390 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee792a7-ce61-47e4-bdd2-d3b750b53b27 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:19.272212 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:19.279048 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eaf7fc-06f4-460e-af87-8b1d5b51a2a3 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:19.310801 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:19.313590 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e654d-18e3-4dc2-bc45-13c1d2999158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:19.314592 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e654d-18e3-4dc2-bc45-13c1d2999158 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:19.314878 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e654d-18e3-4dc2-bc45-13c1d2999158 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:19.315332 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e654d-18e3-4dc2-bc45-13c1d2999158 None admin] PATH_INFO: `/v3/projects/4243c37e3bcb48b0a62103a25160eb80` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:19.316536 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e654d-18e3-4dc2-bc45-13c1d2999158 None admin] RBAC: Authorizing `identity:get_project(project_id=4243c37e3bcb48b0a62103a25160eb80)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:19.317969 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e654d-18e3-4dc2-bc45-13c1d2999158 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:19.320590 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 143/290] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:30:19 2022] GET /identity/v3/projects/4243c37e3bcb48b0a62103a25160eb80 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:19.326347 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e654d-18e3-4dc2-bc45-13c1d2999158 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:19.424875 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee792a7-ce61-47e4-bdd2-d3b750b53b27 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:19.447501 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e654d-18e3-4dc2-bc45-13c1d2999158 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:19.498488 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff41c9f-2b75-4e29-93cd-38e9ff456a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:19.498488 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff41c9f-2b75-4e29-93cd-38e9ff456a84 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:19.498488 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff41c9f-2b75-4e29-93cd-38e9ff456a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:19.498488 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff41c9f-2b75-4e29-93cd-38e9ff456a84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:19.518279 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a41084-4b6d-4de6-a8e7-b312ee87abc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:19.519191 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a41084-4b6d-4de6-a8e7-b312ee87abc7 None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:19.519471 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a41084-4b6d-4de6-a8e7-b312ee87abc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:19.519747 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a41084-4b6d-4de6-a8e7-b312ee87abc7 None admin] PATH_INFO: `/v3/projects/4243c37e3bcb48b0a62103a25160eb80/users/a4a221739b93460c89ec315ebe84a606/roles/8670c500985c4abea21f372ef30378a6` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:19.524118 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a41084-4b6d-4de6-a8e7-b312ee87abc7 None admin] RBAC: Authorizing `identity:create_grant(project_id=4243c37e3bcb48b0a62103a25160eb80, user_id=a4a221739b93460c89ec315ebe84a606, role_id=8670c500985c4abea21f372ef30378a6)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:19.525787 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a41084-4b6d-4de6-a8e7-b312ee87abc7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:19.555626 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 144/291] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 03:30:19 2022] PUT /identity/v3/projects/4243c37e3bcb48b0a62103a25160eb80/users/a4a221739b93460c89ec315ebe84a606/roles/8670c500985c4abea21f372ef30378a6 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:30:19.658476 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff41c9f-2b75-4e29-93cd-38e9ff456a84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:19.659959 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff41c9f-2b75-4e29-93cd-38e9ff456a84 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:19.748719 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:19.842085 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 148/292] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:30:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 639 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 03:30:19.847465 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a41084-4b6d-4de6-a8e7-b312ee87abc7 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:19.870278 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:19.958952 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a41084-4b6d-4de6-a8e7-b312ee87abc7 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:20.023908 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d5422b-8cd9-47e9-915e-4fa96302318d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:20.024696 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5422b-8cd9-47e9-915e-4fa96302318d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:20.024983 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5422b-8cd9-47e9-915e-4fa96302318d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:20.025258 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d5422b-8cd9-47e9-915e-4fa96302318d None admin] PATH_INFO: `/v3/projects/4243c37e3bcb48b0a62103a25160eb80` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:20.026485 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d5422b-8cd9-47e9-915e-4fa96302318d None admin] RBAC: Authorizing `identity:get_project(project_id=4243c37e3bcb48b0a62103a25160eb80)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:20.028010 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d5422b-8cd9-47e9-915e-4fa96302318d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:20.029758 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 145/293] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:30:19 2022] GET /identity/v3/projects/4243c37e3bcb48b0a62103a25160eb80 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:20.035959 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff41c9f-2b75-4e29-93cd-38e9ff456a84 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:20.184162 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801019b5-f341-4058-aad3-54c3dbd2c7d4 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:20.184694 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801019b5-f341-4058-aad3-54c3dbd2c7d4 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:20.184694 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801019b5-f341-4058-aad3-54c3dbd2c7d4 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:20.186823 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 146/294] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:20.192277 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee05ea-3d13-4641-b367-8cccb6a0a904 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:20.192571 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee05ea-3d13-4641-b367-8cccb6a0a904 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:20.193394 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee05ea-3d13-4641-b367-8cccb6a0a904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:20.207719 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff41c9f-2b75-4e29-93cd-38e9ff456a84 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:20.222146 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-68ee05ea-3d13-4641-b367-8cccb6a0a904 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:20.223405 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-68ee05ea-3d13-4641-b367-8cccb6a0a904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:20.279876 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca64e52-ad0f-4c97-9ca1-d6eaef4211a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:20.280311 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca64e52-ad0f-4c97-9ca1-d6eaef4211a7 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:20.280598 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca64e52-ad0f-4c97-9ca1-d6eaef4211a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:20.280879 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca64e52-ad0f-4c97-9ca1-d6eaef4211a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:20.281826 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca64e52-ad0f-4c97-9ca1-d6eaef4211a7 None admin] RBAC: Adding query filter params (role.id=1ac721157e9b40f18cbbc76f5a6b0d3d, scope.project.id=4243c37e3bcb48b0a62103a25160eb80, user.id=a14bac39cadc4375b806aabad39f96df) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:20.282041 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca64e52-ad0f-4c97-9ca1-d6eaef4211a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:20.285188 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca64e52-ad0f-4c97-9ca1-d6eaef4211a7 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:20.306906 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 149/295] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:30:20 2022] GET /identity/v3/role_assignments?user.id=a14bac39cadc4375b806aabad39f96df&scope.project.id=4243c37e3bcb48b0a62103a25160eb80&role.id=1ac721157e9b40f18cbbc76f5a6b0d3d => generated 608 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:20.354906 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 147/296] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 03:30:20.392581 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca64e52-ad0f-4c97-9ca1-d6eaef4211a7 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:20.419248 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:20.560221 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca64e52-ad0f-4c97-9ca1-d6eaef4211a7 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:20.604371 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e83e4-5967-4692-8e9e-1c3377e2ae93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:20.605187 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e83e4-5967-4692-8e9e-1c3377e2ae93 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:20.605475 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e83e4-5967-4692-8e9e-1c3377e2ae93 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:20.605752 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e83e4-5967-4692-8e9e-1c3377e2ae93 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:20.616675 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e83e4-5967-4692-8e9e-1c3377e2ae93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:20.624668 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-c87e83e4-5967-4692-8e9e-1c3377e2ae93 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 03:30:20.624668 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:20.624668 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:20.624668 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:20.624668 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:20.624668 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:20.624668 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:20.624668 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:20.624668 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:20.624668 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:20.624668 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:20.624668 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:20.624668 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:20.624668 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:20.624668 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:20.624668 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:20.626727 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:20.626727 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:20.626727 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:20.626727 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:20.626727 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:20.626727 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:20.626727 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:20.626727 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:20.626727 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:20.626727 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:20.626727 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:20.626727 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:20.626727 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:20.626727 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:20.626727 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:20.626727 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:20.628644 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:20.628644 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:20.628644 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:20.628644 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:20.628644 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:20.628644 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:20.628644 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:20.628644 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:20.628644 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:20.628644 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:20.628644 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 03:30:20.628644 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:30:20.628644 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 150/297] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:30:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:20.637027 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee05ea-3d13-4641-b367-8cccb6a0a904 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:20.651982 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8854181-5046-4cc0-9862-457253a6a015 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:20.652281 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8854181-5046-4cc0-9862-457253a6a015 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:20.653201 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8854181-5046-4cc0-9862-457253a6a015 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:20.654492 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 151/298] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:20.658511 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:20.662131 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a0d76-f124-4a8f-b89a-428b264898ca None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:20.662422 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a0d76-f124-4a8f-b89a-428b264898ca None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:20.662727 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a0d76-f124-4a8f-b89a-428b264898ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:20.681290 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-6f8a0d76-f124-4a8f-b89a-428b264898ca None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:20.682501 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6f8a0d76-f124-4a8f-b89a-428b264898ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:20.760961 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:20.764180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee05ea-3d13-4641-b367-8cccb6a0a904 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:20.770601 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 152/299] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:30:20.772860 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f36bf-ede6-493f-9829-72db0516e8e6 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:20.773916 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f36bf-ede6-493f-9829-72db0516e8e6 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:20.774402 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f36bf-ede6-493f-9829-72db0516e8e6 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:20.776921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 153/300] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:20.784294 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac36e7e-4383-4d50-b1f4-91ef3b522be3 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:20.784294 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac36e7e-4383-4d50-b1f4-91ef3b522be3 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:20.784294 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac36e7e-4383-4d50-b1f4-91ef3b522be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:20.801506 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-3ac36e7e-4383-4d50-b1f4-91ef3b522be3 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:20.801701 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f78566-2357-4b39-9e74-571f0b9e5ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:20.802192 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f78566-2357-4b39-9e74-571f0b9e5ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:20.802528 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f78566-2357-4b39-9e74-571f0b9e5ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:20.802711 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3ac36e7e-4383-4d50-b1f4-91ef3b522be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:20.802809 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f78566-2357-4b39-9e74-571f0b9e5ad3 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:20.803531 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f78566-2357-4b39-9e74-571f0b9e5ad3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:20.803843 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f78566-2357-4b39-9e74-571f0b9e5ad3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:20.805259 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f78566-2357-4b39-9e74-571f0b9e5ad3 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:20.817794 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 148/301] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 03:30:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:20.817794 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f78566-2357-4b39-9e74-571f0b9e5ad3 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:20.891820 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 154/302] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 03:30:20.891820 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac36e7e-4383-4d50-b1f4-91ef3b522be3 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:20.908711 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:20.924959 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f78566-2357-4b39-9e74-571f0b9e5ad3 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:20.965533 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a2e73-5f0f-4440-969b-ed739f0849d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:20.966913 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a2e73-5f0f-4440-969b-ed739f0849d9 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:20.967256 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a2e73-5f0f-4440-969b-ed739f0849d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:20.967601 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a2e73-5f0f-4440-969b-ed739f0849d9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:20.979274 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a2e73-5f0f-4440-969b-ed739f0849d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:20.987480 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-020a2e73-5f0f-4440-969b-ed739f0849d9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 03:30:20.987480 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:20.987480 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:20.987480 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:20.987480 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:20.987480 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:20.987480 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:20.987480 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:20.987480 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:20.987480 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:20.987480 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:20.987480 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:20.987480 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:20.987480 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:20.987480 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:20.987480 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:20.988400 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:20.988400 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:20.988400 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:20.988400 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:20.988400 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:20.988400 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:20.988400 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:20.988400 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:20.988400 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:20.988400 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:20.988400 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:20.988400 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:20.988400 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:20.988400 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:20.988400 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:20.988400 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:20.989192 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:20.989192 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:20.989192 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:20.989192 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:20.989192 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:20.989192 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:20.989192 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:20.989192 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:20.989192 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:20.989192 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:20.989192 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 03:30:20.989192 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:20.989192 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 149/303] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:30:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:20.989865 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a2e73-5f0f-4440-969b-ed739f0849d9 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:21.001385 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac36e7e-4383-4d50-b1f4-91ef3b522be3 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:21.028410 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:21.036388 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caac63e-f9e5-48bf-9533-e33a2d6bbbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:21.037270 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caac63e-f9e5-48bf-9533-e33a2d6bbbe3 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:21.037559 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caac63e-f9e5-48bf-9533-e33a2d6bbbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:21.037839 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caac63e-f9e5-48bf-9533-e33a2d6bbbe3 None admin] PATH_INFO: `/v3/users/f48052d7482a4e638304e00aa98e47b5` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:21.052756 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caac63e-f9e5-48bf-9533-e33a2d6bbbe3 None admin] RBAC: Authorizing `identity:get_user(user_id=f48052d7482a4e638304e00aa98e47b5)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:21.054258 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caac63e-f9e5-48bf-9533-e33a2d6bbbe3 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:21.056228 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 155/304] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:30:20 2022] GET /identity/v3/users/f48052d7482a4e638304e00aa98e47b5 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:21.056803 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caac63e-f9e5-48bf-9533-e33a2d6bbbe3 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:21.102498 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a2e73-5f0f-4440-969b-ed739f0849d9 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:21.139231 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92cd33-bb16-4e29-9bb1-041c16a4c6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:21.140681 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92cd33-bb16-4e29-9bb1-041c16a4c6aa None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:21.140982 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92cd33-bb16-4e29-9bb1-041c16a4c6aa None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:21.141268 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92cd33-bb16-4e29-9bb1-041c16a4c6aa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:21.143042 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92cd33-bb16-4e29-9bb1-041c16a4c6aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:21.144946 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92cd33-bb16-4e29-9bb1-041c16a4c6aa None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:21.151495 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 150/305] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:30:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:21.151495 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92cd33-bb16-4e29-9bb1-041c16a4c6aa None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:21.152358 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:21.175692 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caac63e-f9e5-48bf-9533-e33a2d6bbbe3 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:21.224237 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba44ebe-a85e-45fc-b65c-fa5c6e058b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:21.224881 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba44ebe-a85e-45fc-b65c-fa5c6e058b2a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:21.225138 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba44ebe-a85e-45fc-b65c-fa5c6e058b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:21.225416 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba44ebe-a85e-45fc-b65c-fa5c6e058b2a None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:21.226173 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba44ebe-a85e-45fc-b65c-fa5c6e058b2a None admin] RBAC: Adding query filter params (name=member) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:21.226539 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba44ebe-a85e-45fc-b65c-fa5c6e058b2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:21.227937 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba44ebe-a85e-45fc-b65c-fa5c6e058b2a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:21.240602 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 156/306] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 03:30:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:21.240602 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba44ebe-a85e-45fc-b65c-fa5c6e058b2a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:21.275271 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92cd33-bb16-4e29-9bb1-041c16a4c6aa None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:21.295175 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:21.311313 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e71610-1119-4761-8478-ae20c13d9084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:21.312049 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e71610-1119-4761-8478-ae20c13d9084 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:21.312414 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e71610-1119-4761-8478-ae20c13d9084 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:21.312700 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e71610-1119-4761-8478-ae20c13d9084 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:21.313533 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e71610-1119-4761-8478-ae20c13d9084 None admin] RBAC: Adding query filter params (role.id=8670c500985c4abea21f372ef30378a6, user.id=f48052d7482a4e638304e00aa98e47b5, scope.system=all) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:21.313846 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e71610-1119-4761-8478-ae20c13d9084 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:21.315378 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e71610-1119-4761-8478-ae20c13d9084 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:21.321075 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 151/307] 10.222.0.20 () {56 vars in 1308 bytes} [Thu Jul 21 03:30:21 2022] GET /identity/v3/role_assignments?user.id=f48052d7482a4e638304e00aa98e47b5&scope.system=all&role.id=8670c500985c4abea21f372ef30378a6 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:21.321841 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e71610-1119-4761-8478-ae20c13d9084 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:21.359636 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba44ebe-a85e-45fc-b65c-fa5c6e058b2a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:21.401423 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720507c-134d-4c2b-a85e-9a7736cc5f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:21.402382 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720507c-134d-4c2b-a85e-9a7736cc5f1b None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:21.402839 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720507c-134d-4c2b-a85e-9a7736cc5f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:21.403261 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720507c-134d-4c2b-a85e-9a7736cc5f1b None admin] PATH_INFO: `/v3/groups` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:21.404249 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2720507c-134d-4c2b-a85e-9a7736cc5f1b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:21.405889 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2720507c-134d-4c2b-a85e-9a7736cc5f1b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:21.421210 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:21.430968 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 157/308] 10.222.0.20 () {60 vars in 1134 bytes} [Thu Jul 21 03:30:21 2022] POST /identity/v3/groups => generated 229 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:30:21.470856 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e71610-1119-4761-8478-ae20c13d9084 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:21.514872 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b54b4-2484-420a-b613-276f802dab0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:21.516022 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b54b4-2484-420a-b613-276f802dab0f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:21.516456 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b54b4-2484-420a-b613-276f802dab0f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:21.516908 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b54b4-2484-420a-b613-276f802dab0f None admin] PATH_INFO: `/v3/users/6d1c8601b9974771bd7aee8ec2a17aaa` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:21.518392 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367b54b4-2484-420a-b613-276f802dab0f None admin] RBAC: Authorizing `identity:get_user(user_id=6d1c8601b9974771bd7aee8ec2a17aaa)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:21.519894 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367b54b4-2484-420a-b613-276f802dab0f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:21.522029 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 152/309] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:30:21 2022] GET /identity/v3/users/6d1c8601b9974771bd7aee8ec2a17aaa => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:21.527853 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720507c-134d-4c2b-a85e-9a7736cc5f1b None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:21.645772 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720507c-134d-4c2b-a85e-9a7736cc5f1b None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:21.655166 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:21.684082 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a6aed6-7b1b-4a1d-99ad-57f73bea5cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:21.684960 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6aed6-7b1b-4a1d-99ad-57f73bea5cf8 None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:21.685243 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6aed6-7b1b-4a1d-99ad-57f73bea5cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:21.685520 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a6aed6-7b1b-4a1d-99ad-57f73bea5cf8 None admin] PATH_INFO: `/v3/system/users/6d1c8601b9974771bd7aee8ec2a17aaa/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:21.687086 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a6aed6-7b1b-4a1d-99ad-57f73bea5cf8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6d1c8601b9974771bd7aee8ec2a17aaa, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:21.688487 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a6aed6-7b1b-4a1d-99ad-57f73bea5cf8 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:21.703265 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 158/310] 10.222.0.20 () {58 vars in 1334 bytes} [Thu Jul 21 03:30:21 2022] PUT /identity/v3/system/users/6d1c8601b9974771bd7aee8ec2a17aaa/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:30:22.103653 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c4a1e-65ef-44e2-8726-fe56fd396ed0 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:22.104033 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c4a1e-65ef-44e2-8726-fe56fd396ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:22.104209 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c4a1e-65ef-44e2-8726-fe56fd396ed0 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:22.105879 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 153/311] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:22.111122 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af915b3-b5b7-4e6d-8253-f8f10a15681c None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:22.111414 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af915b3-b5b7-4e6d-8253-f8f10a15681c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:22.111695 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af915b3-b5b7-4e6d-8253-f8f10a15681c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:22.128602 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-7af915b3-b5b7-4e6d-8253-f8f10a15681c None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:22.129776 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7af915b3-b5b7-4e6d-8253-f8f10a15681c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:22.214597 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 159/312] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:30:22.230763 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c4a1e-65ef-44e2-8726-fe56fd396ed0 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:22.343042 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c4a1e-65ef-44e2-8726-fe56fd396ed0 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:22.378292 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4557e78-c11d-4b3a-af12-99948446d74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:22.379303 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4557e78-c11d-4b3a-af12-99948446d74f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:22.379731 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4557e78-c11d-4b3a-af12-99948446d74f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:22.380163 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4557e78-c11d-4b3a-af12-99948446d74f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:22.383428 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:22.392158 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4557e78-c11d-4b3a-af12-99948446d74f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:22.401259 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-c4557e78-c11d-4b3a-af12-99948446d74f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 03:30:22.401259 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:22.401259 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:22.401259 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:22.401259 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:22.401259 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:22.401259 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:22.401259 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:22.401259 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:22.401259 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:22.401259 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:22.401259 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:22.401259 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:22.401259 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:22.401259 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:22.401259 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:22.402332 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:22.402332 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:22.402332 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:22.402332 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:22.402332 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:22.402332 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:22.402332 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:22.402332 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:22.402332 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:22.402332 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:22.402332 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:22.402332 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:22.402332 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:22.402332 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:22.402332 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:22.402332 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:22.403327 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:22.403327 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:22.403327 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:22.403327 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:22.403327 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:22.403327 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:22.403327 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:22.403327 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:22.403327 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:22.403327 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:22.403327 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 03:30:22.403327 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:22.405747 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 154/313] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:30:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:22.411728 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af915b3-b5b7-4e6d-8253-f8f10a15681c None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:22.524754 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af915b3-b5b7-4e6d-8253-f8f10a15681c None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:22.538880 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:22.568530 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e0a50-47ac-4324-990f-3dd173e8b9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:22.569227 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e0a50-47ac-4324-990f-3dd173e8b9e4 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:22.569516 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e0a50-47ac-4324-990f-3dd173e8b9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:22.569796 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e0a50-47ac-4324-990f-3dd173e8b9e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:22.571615 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e0a50-47ac-4324-990f-3dd173e8b9e4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:22.572037 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e0a50-47ac-4324-990f-3dd173e8b9e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:22.573432 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e0a50-47ac-4324-990f-3dd173e8b9e4 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:22.582334 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 160/314] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 03:30:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:22.588245 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4557e78-c11d-4b3a-af12-99948446d74f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:22.700908 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4557e78-c11d-4b3a-af12-99948446d74f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:22.736314 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8cca6-77fa-45c5-8a2c-a576f66c3e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:22.737186 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8cca6-77fa-45c5-8a2c-a576f66c3e53 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:22.737467 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8cca6-77fa-45c5-8a2c-a576f66c3e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:22.737740 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8cca6-77fa-45c5-8a2c-a576f66c3e53 None admin] PATH_INFO: `/v3/users/a4a221739b93460c89ec315ebe84a606` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:22.738966 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8cca6-77fa-45c5-8a2c-a576f66c3e53 None admin] RBAC: Authorizing `identity:get_user(user_id=a4a221739b93460c89ec315ebe84a606)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:22.740399 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8cca6-77fa-45c5-8a2c-a576f66c3e53 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:22.742871 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 155/315] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:30:22 2022] GET /identity/v3/users/a4a221739b93460c89ec315ebe84a606 => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:22.748181 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e0a50-47ac-4324-990f-3dd173e8b9e4 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:22.860299 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e0a50-47ac-4324-990f-3dd173e8b9e4 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:22.898247 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31bebd-1ac3-4936-bfa7-2d3efd7c0013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:22.899260 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31bebd-1ac3-4936-bfa7-2d3efd7c0013 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:22.899764 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31bebd-1ac3-4936-bfa7-2d3efd7c0013 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:22.900231 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31bebd-1ac3-4936-bfa7-2d3efd7c0013 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:22.932541 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:22.979620 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31bebd-1ac3-4936-bfa7-2d3efd7c0013 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:22.981598 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b31bebd-1ac3-4936-bfa7-2d3efd7c0013 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:23.087799 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 161/316] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:30:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 03:30:23.093135 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8cca6-77fa-45c5-8a2c-a576f66c3e53 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:23.166638 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:23.205610 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8cca6-77fa-45c5-8a2c-a576f66c3e53 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:23.240498 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a462407-d5a1-45e5-9b90-3070ceee9319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:23.241279 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a462407-d5a1-45e5-9b90-3070ceee9319 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:23.241564 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a462407-d5a1-45e5-9b90-3070ceee9319 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:23.241901 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a462407-d5a1-45e5-9b90-3070ceee9319 None admin] PATH_INFO: `/v3/projects/4243c37e3bcb48b0a62103a25160eb80` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:23.243628 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a462407-d5a1-45e5-9b90-3070ceee9319 None admin] RBAC: Authorizing `identity:get_project(project_id=4243c37e3bcb48b0a62103a25160eb80)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:23.245061 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a462407-d5a1-45e5-9b90-3070ceee9319 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:23.247122 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 156/317] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:30:23 2022] GET /identity/v3/projects/4243c37e3bcb48b0a62103a25160eb80 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:23.253011 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31bebd-1ac3-4936-bfa7-2d3efd7c0013 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:23.317808 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:23.363845 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b31bebd-1ac3-4936-bfa7-2d3efd7c0013 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:23.403230 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98def3-79ff-4080-b68d-b10f86d66bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:23.403894 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98def3-79ff-4080-b68d-b10f86d66bdd None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:23.404183 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98def3-79ff-4080-b68d-b10f86d66bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:23.404463 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98def3-79ff-4080-b68d-b10f86d66bdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:23.405312 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98def3-79ff-4080-b68d-b10f86d66bdd None admin] RBAC: Adding query filter params (role.id=8670c500985c4abea21f372ef30378a6, scope.project.id=4243c37e3bcb48b0a62103a25160eb80, user.id=a4a221739b93460c89ec315ebe84a606) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:23.405631 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98def3-79ff-4080-b68d-b10f86d66bdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:23.407117 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98def3-79ff-4080-b68d-b10f86d66bdd None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:23.413522 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 162/318] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:30:23 2022] GET /identity/v3/role_assignments?user.id=a4a221739b93460c89ec315ebe84a606&scope.project.id=4243c37e3bcb48b0a62103a25160eb80&role.id=8670c500985c4abea21f372ef30378a6 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:23.476972 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d0a18-e172-477b-8c6e-914b32a1ec23 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:23.477482 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d0a18-e172-477b-8c6e-914b32a1ec23 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:23.477581 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d0a18-e172-477b-8c6e-914b32a1ec23 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:23.479226 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 157/319] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:23.485001 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b1d81-1599-42f7-b0fd-a7c7623d8dcf None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:23.485329 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b1d81-1599-42f7-b0fd-a7c7623d8dcf None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:23.485569 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b1d81-1599-42f7-b0fd-a7c7623d8dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:23.508473 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-a79b1d81-1599-42f7-b0fd-a7c7623d8dcf None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:23.509639 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a79b1d81-1599-42f7-b0fd-a7c7623d8dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:23.588881 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 163/320] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:30:23.613774 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d0a18-e172-477b-8c6e-914b32a1ec23 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:23.688232 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4636c0-7b93-4b23-bfb7-d5021f169ebc None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:23.688535 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4636c0-7b93-4b23-bfb7-d5021f169ebc None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:23.688795 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4636c0-7b93-4b23-bfb7-d5021f169ebc None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:23.691000 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 164/321] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:23.697147 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e8937-4c2b-41dd-974b-fa4f997a9645 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:23.697441 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e8937-4c2b-41dd-974b-fa4f997a9645 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:23.697720 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716e8937-4c2b-41dd-974b-fa4f997a9645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:23.717758 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-716e8937-4c2b-41dd-974b-fa4f997a9645 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:23.718975 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-716e8937-4c2b-41dd-974b-fa4f997a9645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:23.731322 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d0a18-e172-477b-8c6e-914b32a1ec23 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:23.762257 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:23.771695 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27272fa0-7070-4c3b-888d-03a66300e2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:23.771695 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27272fa0-7070-4c3b-888d-03a66300e2fc None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:23.772179 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27272fa0-7070-4c3b-888d-03a66300e2fc None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:23.772658 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27272fa0-7070-4c3b-888d-03a66300e2fc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:23.777819 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:23.786315 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27272fa0-7070-4c3b-888d-03a66300e2fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:23.794099 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-27272fa0-7070-4c3b-888d-03a66300e2fc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 03:30:23.794099 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:23.794099 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:23.794099 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:23.794099 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:23.794099 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:23.794099 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:23.794099 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:23.794099 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:23.794099 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:23.794099 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:23.794099 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:23.794099 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:23.794099 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:23.794099 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:23.794099 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:23.795011 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:23.795011 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:23.795011 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:23.795011 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:23.795011 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:23.795011 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:23.795011 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:23.795011 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:23.795011 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:23.795011 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:23.795011 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:23.795011 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:23.795011 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:23.795011 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:23.795011 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:23.795011 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:23.795784 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:23.795784 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:23.795784 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:23.795784 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:23.795784 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:23.795784 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:23.795784 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:23.795784 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:23.795784 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:23.795784 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:23.795784 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 03:30:23.795784 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:23.796402 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 165/322] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 03:30:23.799236 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 158/323] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:30:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:23.804823 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e8937-4c2b-41dd-974b-fa4f997a9645 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:23.817232 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27272fa0-7070-4c3b-888d-03a66300e2fc None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:23.907623 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716e8937-4c2b-41dd-974b-fa4f997a9645 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:23.918537 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27272fa0-7070-4c3b-888d-03a66300e2fc None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:23.940313 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a208061-ce39-4777-a0c2-b8cda367bd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:23.940915 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a208061-ce39-4777-a0c2-b8cda367bd5b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:23.941208 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a208061-ce39-4777-a0c2-b8cda367bd5b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:23.941482 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a208061-ce39-4777-a0c2-b8cda367bd5b None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:23.942233 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a208061-ce39-4777-a0c2-b8cda367bd5b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:23.942581 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a208061-ce39-4777-a0c2-b8cda367bd5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:23.943982 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a208061-ce39-4777-a0c2-b8cda367bd5b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:23.951658 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573dda3-2112-4881-a349-2476942d8736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:23.952444 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573dda3-2112-4881-a349-2476942d8736 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:23.952731 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 166/324] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 03:30:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:30:23.952841 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573dda3-2112-4881-a349-2476942d8736 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:23.953009 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573dda3-2112-4881-a349-2476942d8736 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:23.953997 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c59aa-f09a-44be-a42a-1355ee1e7616 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:23.954192 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0573dda3-2112-4881-a349-2476942d8736 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:23.954298 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c59aa-f09a-44be-a42a-1355ee1e7616 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:23.954594 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c59aa-f09a-44be-a42a-1355ee1e7616 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:23.955673 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0573dda3-2112-4881-a349-2476942d8736 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:23.959842 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 167/325] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:23.959967 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 159/326] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:30:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:30:23.960070 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c59aa-f09a-44be-a42a-1355ee1e7616 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:23.963970 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a071c-d302-4b0b-98c3-b0b6e0c2b519 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:23.964264 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a071c-d302-4b0b-98c3-b0b6e0c2b519 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:23.964544 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a071c-d302-4b0b-98c3-b0b6e0c2b519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:23.980512 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-eb8a071c-d302-4b0b-98c3-b0b6e0c2b519 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:23.981714 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-eb8a071c-d302-4b0b-98c3-b0b6e0c2b519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:24.011934 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:24.039243 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:24.050126 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 160/327] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 03:30:24.062637 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a071c-d302-4b0b-98c3-b0b6e0c2b519 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:24.063623 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c59aa-f09a-44be-a42a-1355ee1e7616 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:24.099740 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb9ab9-ef7e-46c4-9a9d-e670ef634cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:24.100621 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb9ab9-ef7e-46c4-9a9d-e670ef634cac None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:24.100907 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb9ab9-ef7e-46c4-9a9d-e670ef634cac None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:24.101192 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb9ab9-ef7e-46c4-9a9d-e670ef634cac None admin] PATH_INFO: `/v3/users/f48052d7482a4e638304e00aa98e47b5` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:24.102378 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cb9ab9-ef7e-46c4-9a9d-e670ef634cac None admin] RBAC: Authorizing `identity:get_user(user_id=f48052d7482a4e638304e00aa98e47b5)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:24.103877 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cb9ab9-ef7e-46c4-9a9d-e670ef634cac None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:24.105519 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 168/328] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:30:23 2022] GET /identity/v3/users/f48052d7482a4e638304e00aa98e47b5 => generated 293 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:24.106278 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb9ab9-ef7e-46c4-9a9d-e670ef634cac None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:24.154938 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a071c-d302-4b0b-98c3-b0b6e0c2b519 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:24.187907 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764d604-ddf7-4e2c-a560-243d517bd1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:24.188566 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764d604-ddf7-4e2c-a560-243d517bd1af None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:24.188847 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764d604-ddf7-4e2c-a560-243d517bd1af None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:24.189122 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764d604-ddf7-4e2c-a560-243d517bd1af None admin] PATH_INFO: `/v3/groups` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:24.189805 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764d604-ddf7-4e2c-a560-243d517bd1af None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:24.191296 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764d604-ddf7-4e2c-a560-243d517bd1af None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:24.207269 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb9ab9-ef7e-46c4-9a9d-e670ef634cac None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:24.207593 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 161/329] 10.222.0.20 () {60 vars in 1134 bytes} [Thu Jul 21 03:30:24 2022] POST /identity/v3/groups => generated 226 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:30:24.208379 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764d604-ddf7-4e2c-a560-243d517bd1af None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:24.227884 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:24.249744 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58c15c-edf9-4fb9-a740-f2252c6acf46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:24.250583 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58c15c-edf9-4fb9-a740-f2252c6acf46 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:24.250868 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58c15c-edf9-4fb9-a740-f2252c6acf46 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:24.251145 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58c15c-edf9-4fb9-a740-f2252c6acf46 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:24.264653 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd58c15c-edf9-4fb9-a740-f2252c6acf46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:24.270092 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:24.273653 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-cd58c15c-edf9-4fb9-a740-f2252c6acf46 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 03:30:24.273653 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:24.273653 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:24.273653 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:24.273653 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:24.273653 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:24.273653 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:24.273653 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:24.273653 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:24.273653 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:24.273653 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:24.273653 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:24.273653 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:24.273653 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:24.273653 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:24.273653 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:24.274845 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:24.274845 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:24.274845 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:24.274845 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:24.274845 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:24.274845 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:24.274845 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:24.274845 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:24.274845 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:24.274845 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:24.274845 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:24.274845 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:24.274845 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:24.274845 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:24.274845 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:24.274845 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:24.275716 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:24.275716 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:24.275716 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:24.275716 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:24.275716 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:24.275716 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:24.275716 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:24.275716 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:24.275716 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:24.275716 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:24.275716 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 03:30:24.275716 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:30:24.275716 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 169/330] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:30:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:24.281697 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58c15c-edf9-4fb9-a740-f2252c6acf46 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:24.333944 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764d604-ddf7-4e2c-a560-243d517bd1af None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:24.374138 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e4b00-1e29-4460-a5b5-f595649da8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:24.375311 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e4b00-1e29-4460-a5b5-f595649da8bb None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:24.375738 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e4b00-1e29-4460-a5b5-f595649da8bb None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:24.376160 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e4b00-1e29-4460-a5b5-f595649da8bb None admin] PATH_INFO: `/v3/system/users/f48052d7482a4e638304e00aa98e47b5/roles/8670c500985c4abea21f372ef30378a6` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:24.377711 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e4b00-1e29-4460-a5b5-f595649da8bb None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f48052d7482a4e638304e00aa98e47b5, role_id=8670c500985c4abea21f372ef30378a6)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:24.379177 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e4b00-1e29-4460-a5b5-f595649da8bb None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:24.390083 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 162/331] 10.222.0.20 () {58 vars in 1334 bytes} [Thu Jul 21 03:30:24 2022] PUT /identity/v3/system/users/f48052d7482a4e638304e00aa98e47b5/roles/8670c500985c4abea21f372ef30378a6 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:30:24.404340 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd58c15c-edf9-4fb9-a740-f2252c6acf46 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:24.448093 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed479e5-5aca-4689-a1ed-7f60cc9a0e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:24.448956 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed479e5-5aca-4689-a1ed-7f60cc9a0e0f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:24.449343 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed479e5-5aca-4689-a1ed-7f60cc9a0e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:24.449718 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed479e5-5aca-4689-a1ed-7f60cc9a0e0f None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:24.450655 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed479e5-5aca-4689-a1ed-7f60cc9a0e0f None admin] RBAC: Adding query filter params (name=member) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:24.451065 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed479e5-5aca-4689-a1ed-7f60cc9a0e0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:24.452627 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed479e5-5aca-4689-a1ed-7f60cc9a0e0f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:24.463702 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 170/332] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 03:30:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:30:24.469547 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e4b00-1e29-4460-a5b5-f595649da8bb None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:24.583186 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e4b00-1e29-4460-a5b5-f595649da8bb None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:24.598192 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:24.625270 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1455a-062e-45cb-b94b-b2956b46db3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:24.626298 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1455a-062e-45cb-b94b-b2956b46db3e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:24.626716 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1455a-062e-45cb-b94b-b2956b46db3e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:24.627344 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1455a-062e-45cb-b94b-b2956b46db3e None admin] PATH_INFO: `/v3/users/6d1c8601b9974771bd7aee8ec2a17aaa` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:24.628417 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc1455a-062e-45cb-b94b-b2956b46db3e None admin] RBAC: Authorizing `identity:get_user(user_id=6d1c8601b9974771bd7aee8ec2a17aaa)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:24.629971 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc1455a-062e-45cb-b94b-b2956b46db3e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:24.632813 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 163/333] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:30:24 2022] GET /identity/v3/users/6d1c8601b9974771bd7aee8ec2a17aaa => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:30:24.637945 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed479e5-5aca-4689-a1ed-7f60cc9a0e0f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:24.686717 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:24.762410 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed479e5-5aca-4689-a1ed-7f60cc9a0e0f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:24.803424 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307cb43d-cc57-4585-a2d8-4eb5bf04564e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:24.804092 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307cb43d-cc57-4585-a2d8-4eb5bf04564e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:24.805062 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307cb43d-cc57-4585-a2d8-4eb5bf04564e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:24.805345 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307cb43d-cc57-4585-a2d8-4eb5bf04564e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:24.806194 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307cb43d-cc57-4585-a2d8-4eb5bf04564e None admin] RBAC: Adding query filter params (role.id=1ac721157e9b40f18cbbc76f5a6b0d3d, user.id=6d1c8601b9974771bd7aee8ec2a17aaa, scope.system=all) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:24.806585 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307cb43d-cc57-4585-a2d8-4eb5bf04564e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:24.808669 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307cb43d-cc57-4585-a2d8-4eb5bf04564e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:24.824198 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 171/334] 10.222.0.20 () {56 vars in 1308 bytes} [Thu Jul 21 03:30:24 2022] GET /identity/v3/role_assignments?user.id=6d1c8601b9974771bd7aee8ec2a17aaa&scope.system=all&role.id=1ac721157e9b40f18cbbc76f5a6b0d3d => generated 510 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:30:26.605306 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332ff29-8b47-4329-b0f2-ebf2844c4b7f None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:26.605821 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332ff29-8b47-4329-b0f2-ebf2844c4b7f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:26.605930 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332ff29-8b47-4329-b0f2-ebf2844c4b7f None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:26.607499 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 164/335] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:26.624239 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f99922-878a-4c33-904e-1833be6f8c04 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:26.624724 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f99922-878a-4c33-904e-1833be6f8c04 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:26.624798 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f99922-878a-4c33-904e-1833be6f8c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:26.649508 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-73f99922-878a-4c33-904e-1833be6f8c04 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:26.650731 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-73f99922-878a-4c33-904e-1833be6f8c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:26.745767 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 172/336] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 03:30:26.756011 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e6dbe-e558-4cf0-b55e-0a62d906a6da None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:26.756303 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e6dbe-e558-4cf0-b55e-0a62d906a6da None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:26.756584 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e6dbe-e558-4cf0-b55e-0a62d906a6da None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:26.758919 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 165/337] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:26.770989 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d3247-a3a1-4bb3-a207-e599b6beb9ec None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:26.771282 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d3247-a3a1-4bb3-a207-e599b6beb9ec None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:26.771566 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d3247-a3a1-4bb3-a207-e599b6beb9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:26.779306 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e6dbe-e558-4cf0-b55e-0a62d906a6da None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:26.802358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-0f5d3247-a3a1-4bb3-a207-e599b6beb9ec None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:26.803568 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0f5d3247-a3a1-4bb3-a207-e599b6beb9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:26.838006 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:26.921356 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 173/338] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:30:26.978431 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d3247-a3a1-4bb3-a207-e599b6beb9ec None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:27.107143 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e6dbe-e558-4cf0-b55e-0a62d906a6da None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:27.118068 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d3247-a3a1-4bb3-a207-e599b6beb9ec None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:27.170623 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e0312-befc-405b-b0af-5a5947e7b5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:27.171484 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e0312-befc-405b-b0af-5a5947e7b5a0 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:27.171722 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e0312-befc-405b-b0af-5a5947e7b5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:27.172001 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2e0312-befc-405b-b0af-5a5947e7b5a0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:27.183234 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0cdb4-dc81-45a0-b3ff-7c1e85b11300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:27.184073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0cdb4-dc81-45a0-b3ff-7c1e85b11300 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:27.184355 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0cdb4-dc81-45a0-b3ff-7c1e85b11300 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:27.184628 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0cdb4-dc81-45a0-b3ff-7c1e85b11300 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:27.205934 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2e0312-befc-405b-b0af-5a5947e7b5a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:27.214951 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec0cdb4-dc81-45a0-b3ff-7c1e85b11300 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:27.224071 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-bb2e0312-befc-405b-b0af-5a5947e7b5a0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 03:30:27.224071 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:27.224071 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:27.224071 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:27.224071 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:27.224071 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:27.224071 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:27.224071 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:27.224071 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:27.224071 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:27.224071 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:27.224071 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:27.224071 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:27.224071 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:27.224071 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:27.224071 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:27.224971 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:27.224971 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:27.224971 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:27.224971 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:27.224971 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:27.224971 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:27.224971 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:27.224971 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:27.224971 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:27.224971 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:27.224971 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:27.224971 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:27.224971 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:27.224971 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:27.224971 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:27.224971 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:27.225759 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:27.225759 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:27.225759 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:27.225759 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:27.225759 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:27.225759 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:27.225759 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:27.225759 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:27.225759 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:27.225759 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:27.225759 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 03:30:27.225759 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:27.225759 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 166/339] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:30:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 447 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:27.231370 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e0312-befc-405b-b0af-5a5947e7b5a0 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:27.233593 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-fec0cdb4-dc81-45a0-b3ff-7c1e85b11300 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 03:30:27.233593 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:27.233593 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:27.233593 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:27.233593 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:27.233593 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:27.233593 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:27.233593 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:27.233593 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:27.233593 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:27.233593 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:27.233593 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:27.233593 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:27.233593 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:27.233593 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:27.233593 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:27.234503 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:27.234503 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:27.234503 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:27.234503 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:27.234503 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:27.234503 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:27.234503 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:27.234503 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:27.234503 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:27.234503 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:27.234503 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:27.234503 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:27.234503 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:27.234503 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:27.234503 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:27.234503 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:27.235305 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:27.235305 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:27.235305 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:27.235305 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:27.235305 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:27.235305 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:27.235305 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:27.235305 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:27.235305 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:27.235305 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:27.235305 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 03:30:27.235305 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:30:27.237984 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 174/340] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jul 21 03:30:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:27.243413 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0cdb4-dc81-45a0-b3ff-7c1e85b11300 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:27.286833 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:27.334255 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:27.435813 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0cdb4-dc81-45a0-b3ff-7c1e85b11300 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:27.479951 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e2d5aa-ac79-4000-92bd-bda546ac278d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:27.481055 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2d5aa-ac79-4000-92bd-bda546ac278d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:27.481615 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2d5aa-ac79-4000-92bd-bda546ac278d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:27.482145 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2d5aa-ac79-4000-92bd-bda546ac278d None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:27.483281 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e2d5aa-ac79-4000-92bd-bda546ac278d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:27.483802 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e2d5aa-ac79-4000-92bd-bda546ac278d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:27.485512 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e2d5aa-ac79-4000-92bd-bda546ac278d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:27.488464 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2e0312-befc-405b-b0af-5a5947e7b5a0 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:27.497465 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 175/341] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:30:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:27.499182 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e35d7e-9950-45df-95f3-f4ff63ca9624 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:27.499682 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e35d7e-9950-45df-95f3-f4ff63ca9624 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:27.500182 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e35d7e-9950-45df-95f3-f4ff63ca9624 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:27.502191 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 176/342] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:27.503310 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e35d7e-9950-45df-95f3-f4ff63ca9624 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:27.539289 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1ceb6-53d4-4297-a6b4-5579585cf12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:27.539995 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1ceb6-53d4-4297-a6b4-5579585cf12d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:27.540325 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1ceb6-53d4-4297-a6b4-5579585cf12d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:27.540601 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1ceb6-53d4-4297-a6b4-5579585cf12d None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:27.541357 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1ceb6-53d4-4297-a6b4-5579585cf12d None admin] RBAC: Adding query filter params (name=member) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:27.541683 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1ceb6-53d4-4297-a6b4-5579585cf12d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:27.543334 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1ceb6-53d4-4297-a6b4-5579585cf12d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:27.553255 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 167/343] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 03:30:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:27.555888 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9211bf7-9be8-41dd-95be-92af2ae98374 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:27.555888 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9211bf7-9be8-41dd-95be-92af2ae98374 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:27.556086 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9211bf7-9be8-41dd-95be-92af2ae98374 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:27.561540 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 168/344] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:27.562767 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c0efd-a537-481c-b170-4ba84ec1817b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:27.563059 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c0efd-a537-481c-b170-4ba84ec1817b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:27.563618 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c0efd-a537-481c-b170-4ba84ec1817b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:27.591337 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-1b4c0efd-a537-481c-b170-4ba84ec1817b None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:27.592887 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1b4c0efd-a537-481c-b170-4ba84ec1817b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:27.608666 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:27.631759 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e35d7e-9950-45df-95f3-f4ff63ca9624 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:27.672544 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 169/345] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:30:27.679157 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c0efd-a537-481c-b170-4ba84ec1817b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:27.682375 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68806d18-5f20-4fb8-a03d-7d8c6081b9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:27.683473 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68806d18-5f20-4fb8-a03d-7d8c6081b9f1 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:27.683963 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68806d18-5f20-4fb8-a03d-7d8c6081b9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:27.684493 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68806d18-5f20-4fb8-a03d-7d8c6081b9f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:27.758823 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:27.808711 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68806d18-5f20-4fb8-a03d-7d8c6081b9f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:27.810194 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68806d18-5f20-4fb8-a03d-7d8c6081b9f1 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:27.851844 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c0efd-a537-481c-b170-4ba84ec1817b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:27.900724 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e67096-1141-4232-a167-c041f20b398e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:27.901414 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:27.904202 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e67096-1141-4232-a167-c041f20b398e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:27.904825 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e67096-1141-4232-a167-c041f20b398e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:27.905341 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e67096-1141-4232-a167-c041f20b398e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:27.923506 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 177/346] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:30:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 03:30:27.924809 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5280ab-368e-472a-b2dc-8631f3a9d619 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:27.925101 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5280ab-368e-472a-b2dc-8631f3a9d619 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:27.925405 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5280ab-368e-472a-b2dc-8631f3a9d619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:27.942194 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-8e5280ab-368e-472a-b2dc-8631f3a9d619 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:27.943434 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8e5280ab-368e-472a-b2dc-8631f3a9d619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:27.999797 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e67096-1141-4232-a167-c041f20b398e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:28.001189 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e67096-1141-4232-a167-c041f20b398e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:28.044033 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 178/347] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:30:28.045845 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5280ab-368e-472a-b2dc-8631f3a9d619 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:28.055275 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:28.153046 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 170/348] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:30:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 03:30:28.153913 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e67096-1141-4232-a167-c041f20b398e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:28.197770 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5280ab-368e-472a-b2dc-8631f3a9d619 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:28.215443 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:28.255981 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8935d-f0f8-449b-a27c-5563b53ba629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:28.257566 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8935d-f0f8-449b-a27c-5563b53ba629 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:28.258015 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8935d-f0f8-449b-a27c-5563b53ba629 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:28.258544 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8935d-f0f8-449b-a27c-5563b53ba629 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:28.274180 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8935d-f0f8-449b-a27c-5563b53ba629 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:28.282864 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-30d8935d-f0f8-449b-a27c-5563b53ba629 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 03:30:28.282864 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:28.282864 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:28.282864 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:28.282864 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:28.282864 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:28.282864 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:28.282864 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:28.282864 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:28.282864 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:28.282864 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:28.282864 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:28.282864 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:28.282864 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:28.282864 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:28.282864 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:28.283854 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:28.283854 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:28.283854 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:28.283854 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:28.283854 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:28.283854 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:28.283854 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:28.283854 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:28.283854 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:28.283854 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:28.283854 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:28.283854 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:28.283854 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:28.283854 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:28.283854 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:28.283854 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:28.284660 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:28.284660 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:28.284660 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:28.284660 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:28.284660 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:28.284660 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:28.284660 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:28.284660 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:28.284660 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:28.284660 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:28.284660 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 03:30:28.284660 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:30:28.285286 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e67096-1141-4232-a167-c041f20b398e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:28.294444 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 179/349] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:30:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:28.295632 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8935d-f0f8-449b-a27c-5563b53ba629 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:28.336641 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b632871-e2c0-4cc6-bb81-13c6e3bbf91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:28.337637 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b632871-e2c0-4cc6-bb81-13c6e3bbf91d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:28.337854 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b632871-e2c0-4cc6-bb81-13c6e3bbf91d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:28.338138 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b632871-e2c0-4cc6-bb81-13c6e3bbf91d None admin] PATH_INFO: `/v3/projects/e7eff2725d90448aaf1b1dc5e791bd90` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:28.339401 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b632871-e2c0-4cc6-bb81-13c6e3bbf91d None admin] RBAC: Authorizing `identity:get_project(project_id=e7eff2725d90448aaf1b1dc5e791bd90)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:28.341047 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b632871-e2c0-4cc6-bb81-13c6e3bbf91d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:28.343261 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 171/350] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:30:28 2022] GET /identity/v3/projects/e7eff2725d90448aaf1b1dc5e791bd90 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:28.344127 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b632871-e2c0-4cc6-bb81-13c6e3bbf91d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:28.346922 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:28.424759 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8935d-f0f8-449b-a27c-5563b53ba629 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:28.463171 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b632871-e2c0-4cc6-bb81-13c6e3bbf91d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:28.468044 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10502bad-8d9c-4d8f-9ab4-c3908e9c3972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:28.469430 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10502bad-8d9c-4d8f-9ab4-c3908e9c3972 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:28.470034 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10502bad-8d9c-4d8f-9ab4-c3908e9c3972 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:28.470553 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10502bad-8d9c-4d8f-9ab4-c3908e9c3972 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:28.483504 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10502bad-8d9c-4d8f-9ab4-c3908e9c3972 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:28.493190 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-10502bad-8d9c-4d8f-9ab4-c3908e9c3972 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 03:30:28.493190 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:28.493190 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:28.493190 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:28.493190 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:28.493190 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:28.493190 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:28.493190 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:28.493190 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:28.493190 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:28.493190 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:28.493190 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:28.493190 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:28.493190 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:28.493190 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:28.493190 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:28.494076 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:28.494076 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:28.494076 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:28.494076 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:28.494076 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:28.494076 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:28.494076 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:28.494076 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:28.494076 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:28.494076 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:28.494076 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:28.494076 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:28.494076 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:28.494076 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:28.494076 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:28.494076 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:28.494899 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:28.494899 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:28.494899 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:28.494899 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:28.494899 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:28.494899 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:28.494899 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:28.494899 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:28.494899 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:28.494899 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:28.494899 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 03:30:28.494899 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:30:28.497472 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 180/351] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:30:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:28.498588 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10502bad-8d9c-4d8f-9ab4-c3908e9c3972 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:28.500587 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d3545-d7a6-4b91-b58a-de532f2e20bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:28.501467 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d3545-d7a6-4b91-b58a-de532f2e20bf None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:28.501801 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d3545-d7a6-4b91-b58a-de532f2e20bf None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:28.502581 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d3545-d7a6-4b91-b58a-de532f2e20bf None admin] PATH_INFO: `/v3/projects/e7eff2725d90448aaf1b1dc5e791bd90` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:28.503407 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772d3545-d7a6-4b91-b58a-de532f2e20bf None admin] RBAC: Authorizing `identity:get_project(project_id=e7eff2725d90448aaf1b1dc5e791bd90)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:28.504898 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772d3545-d7a6-4b91-b58a-de532f2e20bf None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:28.506922 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 172/352] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:30:28 2022] GET /identity/v3/projects/e7eff2725d90448aaf1b1dc5e791bd90 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:28.508421 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d3545-d7a6-4b91-b58a-de532f2e20bf None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:28.538959 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:28.586835 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:28.625813 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10502bad-8d9c-4d8f-9ab4-c3908e9c3972 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:28.633431 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d3545-d7a6-4b91-b58a-de532f2e20bf None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:28.680013 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e5121-3623-49bc-a912-b7135324aff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:28.680696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e5121-3623-49bc-a912-b7135324aff2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:28.680981 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e5121-3623-49bc-a912-b7135324aff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:28.681259 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e5121-3623-49bc-a912-b7135324aff2 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:28.682026 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e5121-3623-49bc-a912-b7135324aff2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:28.682341 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e5121-3623-49bc-a912-b7135324aff2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:28.684403 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402e5121-3623-49bc-a912-b7135324aff2 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:28.687908 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f4c49-90c1-4a64-9c57-613c5917b7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:28.688370 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f4c49-90c1-4a64-9c57-613c5917b7f2 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:28.688370 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f4c49-90c1-4a64-9c57-613c5917b7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:28.688514 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6f4c49-90c1-4a64-9c57-613c5917b7f2 None admin] PATH_INFO: `/v3/groups/06910a0fcb0d4deabe947999059f5f6d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:28.702232 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 181/353] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 03:30:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:28.703537 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e5121-3623-49bc-a912-b7135324aff2 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:28.704407 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6f4c49-90c1-4a64-9c57-613c5917b7f2 None admin] RBAC: Authorizing `identity:get_group(group_id=06910a0fcb0d4deabe947999059f5f6d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:28.706163 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6f4c49-90c1-4a64-9c57-613c5917b7f2 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:28.708514 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 173/354] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jul 21 03:30:28 2022] GET /identity/v3/groups/06910a0fcb0d4deabe947999059f5f6d => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:28.709301 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f4c49-90c1-4a64-9c57-613c5917b7f2 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:28.849464 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:28.860277 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6f4c49-90c1-4a64-9c57-613c5917b7f2 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:28.865647 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402e5121-3623-49bc-a912-b7135324aff2 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:28.918507 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561712a-0b14-4bfe-9771-bc89ec7e6c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:28.919369 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561712a-0b14-4bfe-9771-bc89ec7e6c62 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:28.919697 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561712a-0b14-4bfe-9771-bc89ec7e6c62 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:28.919922 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561712a-0b14-4bfe-9771-bc89ec7e6c62 None admin] PATH_INFO: `/v3/groups/06910a0fcb0d4deabe947999059f5f6d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:28.921102 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c561712a-0b14-4bfe-9771-bc89ec7e6c62 None admin] RBAC: Authorizing `identity:get_group(group_id=06910a0fcb0d4deabe947999059f5f6d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:28.922617 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c561712a-0b14-4bfe-9771-bc89ec7e6c62 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:28.924818 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c91e7e5-6416-4206-a820-845dc2aaad3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:28.927298 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c91e7e5-6416-4206-a820-845dc2aaad3e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:28.927429 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c91e7e5-6416-4206-a820-845dc2aaad3e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:28.927721 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c91e7e5-6416-4206-a820-845dc2aaad3e None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:28.929634 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c91e7e5-6416-4206-a820-845dc2aaad3e None admin] RBAC: Adding query filter params (name=member) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:28.929749 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c91e7e5-6416-4206-a820-845dc2aaad3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:28.930676 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 174/355] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jul 21 03:30:28 2022] GET /identity/v3/groups/06910a0fcb0d4deabe947999059f5f6d => generated 226 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:28.932508 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6920dcb-30ce-4dfa-9779-22b4a7681aff None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:28.932508 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6920dcb-30ce-4dfa-9779-22b4a7681aff None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:28.932689 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6920dcb-30ce-4dfa-9779-22b4a7681aff None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:28.932916 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c91e7e5-6416-4206-a820-845dc2aaad3e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:28.933939 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 175/356] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:28.934688 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6920dcb-30ce-4dfa-9779-22b4a7681aff None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:28.939881 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:28.952337 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 182/357] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 03:30:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:28.953027 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c91e7e5-6416-4206-a820-845dc2aaad3e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:29.101950 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c91e7e5-6416-4206-a820-845dc2aaad3e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:29.102143 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6920dcb-30ce-4dfa-9779-22b4a7681aff None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:29.155511 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7676915-8819-4ccd-9269-2de4888f018c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:29.155511 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7676915-8819-4ccd-9269-2de4888f018c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:29.155511 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7676915-8819-4ccd-9269-2de4888f018c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:29.155511 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7676915-8819-4ccd-9269-2de4888f018c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:29.155928 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d5c37-ec3b-4e76-8846-bc943f213134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:29.156020 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7676915-8819-4ccd-9269-2de4888f018c None admin] RBAC: Adding query filter params (group.id=06910a0fcb0d4deabe947999059f5f6d, role.id=76578c4e1dbb4559b293fb93830ed5b2, scope.project.id=e7eff2725d90448aaf1b1dc5e791bd90) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:29.156020 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7676915-8819-4ccd-9269-2de4888f018c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:29.158116 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d5c37-ec3b-4e76-8846-bc943f213134 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:29.158232 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7676915-8819-4ccd-9269-2de4888f018c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:29.158319 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d5c37-ec3b-4e76-8846-bc943f213134 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:29.158319 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d5c37-ec3b-4e76-8846-bc943f213134 None admin] PATH_INFO: `/v3/users/f48052d7482a4e638304e00aa98e47b5` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:29.159719 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d5c37-ec3b-4e76-8846-bc943f213134 None admin] RBAC: Authorizing `identity:get_user(user_id=f48052d7482a4e638304e00aa98e47b5)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:29.162572 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d5c37-ec3b-4e76-8846-bc943f213134 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:29.166492 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 176/358] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:30:28 2022] GET /identity/v3/users/f48052d7482a4e638304e00aa98e47b5 => generated 293 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:29.166492 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60cbc22-3ca5-452a-9a7b-132d635506c6 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:29.166492 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60cbc22-3ca5-452a-9a7b-132d635506c6 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:29.166492 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60cbc22-3ca5-452a-9a7b-132d635506c6 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:29.168103 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 177/359] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:29.170830 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 183/360] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Jul 21 03:30:28 2022] GET /identity/v3/role_assignments?group.id=06910a0fcb0d4deabe947999059f5f6d&scope.project.id=e7eff2725d90448aaf1b1dc5e791bd90&role.id=76578c4e1dbb4559b293fb93830ed5b2 => generated 260 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:29.174614 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60cbc22-3ca5-452a-9a7b-132d635506c6 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:29.174781 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3284e-d55a-44ca-92e3-8d43792cc588 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:29.174781 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3284e-d55a-44ca-92e3-8d43792cc588 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:29.175224 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3284e-d55a-44ca-92e3-8d43792cc588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:29.198491 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-55c3284e-d55a-44ca-92e3-8d43792cc588 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:29.200258 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-55c3284e-d55a-44ca-92e3-8d43792cc588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:29.225588 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:29.280671 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:29.316401 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 184/361] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:30:29.317630 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3284e-d55a-44ca-92e3-8d43792cc588 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:29.339087 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60cbc22-3ca5-452a-9a7b-132d635506c6 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:29.387464 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35441797-7ded-4bf6-a6b6-f9de7c1cf513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:29.388059 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35441797-7ded-4bf6-a6b6-f9de7c1cf513 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:29.388352 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35441797-7ded-4bf6-a6b6-f9de7c1cf513 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:29.388636 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35441797-7ded-4bf6-a6b6-f9de7c1cf513 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:29.390864 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35441797-7ded-4bf6-a6b6-f9de7c1cf513 None admin] RBAC: Adding query filter params (group.id=06910a0fcb0d4deabe947999059f5f6d, role.id=1ac721157e9b40f18cbbc76f5a6b0d3d, scope.project.id=e7eff2725d90448aaf1b1dc5e791bd90) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:29.391187 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35441797-7ded-4bf6-a6b6-f9de7c1cf513 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:29.393175 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35441797-7ded-4bf6-a6b6-f9de7c1cf513 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:29.400223 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 178/362] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Jul 21 03:30:29 2022] GET /identity/v3/role_assignments?group.id=06910a0fcb0d4deabe947999059f5f6d&scope.project.id=e7eff2725d90448aaf1b1dc5e791bd90&role.id=1ac721157e9b40f18cbbc76f5a6b0d3d => generated 260 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:29.401836 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8d9fb-e0cd-4909-a9e9-c1143656d874 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:29.402329 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8d9fb-e0cd-4909-a9e9-c1143656d874 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:29.402909 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8d9fb-e0cd-4909-a9e9-c1143656d874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:29.426609 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-8bd8d9fb-e0cd-4909-a9e9-c1143656d874 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:29.428011 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8bd8d9fb-e0cd-4909-a9e9-c1143656d874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:29.464031 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3284e-d55a-44ca-92e3-8d43792cc588 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:29.512497 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9128c3-6795-4a90-9622-5df19bc52976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:29.513181 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9128c3-6795-4a90-9622-5df19bc52976 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:29.513471 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9128c3-6795-4a90-9622-5df19bc52976 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:29.513755 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9128c3-6795-4a90-9622-5df19bc52976 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:29.516881 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 179/363] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:30:29.518706 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8d9fb-e0cd-4909-a9e9-c1143656d874 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:29.541095 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:29.600203 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9128c3-6795-4a90-9622-5df19bc52976 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:29.603501 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9128c3-6795-4a90-9622-5df19bc52976 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:29.634119 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:29.682136 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8d9fb-e0cd-4909-a9e9-c1143656d874 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:29.721543 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 185/364] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:30:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 03:30:29.721965 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ada1dd-f612-4632-8676-2c8cd2f87042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:29.722527 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ada1dd-f612-4632-8676-2c8cd2f87042 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:29.722819 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ada1dd-f612-4632-8676-2c8cd2f87042 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:29.723097 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ada1dd-f612-4632-8676-2c8cd2f87042 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:29.723946 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ada1dd-f612-4632-8676-2c8cd2f87042 None admin] RBAC: Adding query filter params (role.id=8670c500985c4abea21f372ef30378a6, user.id=f48052d7482a4e638304e00aa98e47b5, scope.system=all) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:29.724189 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9128c3-6795-4a90-9622-5df19bc52976 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:29.724298 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ada1dd-f612-4632-8676-2c8cd2f87042 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:29.725677 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ada1dd-f612-4632-8676-2c8cd2f87042 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:29.744944 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 180/365] 10.222.0.20 () {56 vars in 1308 bytes} [Thu Jul 21 03:30:29 2022] GET /identity/v3/role_assignments?user.id=f48052d7482a4e638304e00aa98e47b5&scope.system=all&role.id=8670c500985c4abea21f372ef30378a6 => generated 510 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:29.745793 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ada1dd-f612-4632-8676-2c8cd2f87042 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:29.784350 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:29.868204 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ada1dd-f612-4632-8676-2c8cd2f87042 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:29.897977 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:29.910886 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef1118-f80c-47a4-97c1-b3caaac6b4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:29.911821 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef1118-f80c-47a4-97c1-b3caaac6b4aa None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:29.912414 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef1118-f80c-47a4-97c1-b3caaac6b4aa None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:29.912876 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef1118-f80c-47a4-97c1-b3caaac6b4aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:29.922959 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9128c3-6795-4a90-9622-5df19bc52976 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:29.925464 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef1118-f80c-47a4-97c1-b3caaac6b4aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:29.935805 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-6eef1118-f80c-47a4-97c1-b3caaac6b4aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:30:29.935805 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:29.935805 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:29.935805 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:29.935805 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:29.935805 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:29.935805 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:29.935805 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:29.935805 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:29.935805 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:29.935805 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:29.935805 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:29.935805 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:29.935805 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:29.935805 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:29.935805 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:29.936788 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:29.936788 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:29.936788 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:29.936788 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:29.936788 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:29.936788 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:29.936788 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:29.936788 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:29.936788 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:29.936788 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:29.936788 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:29.936788 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:29.936788 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:29.936788 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:29.936788 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:29.936788 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:29.937632 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:29.937632 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:29.937632 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:29.937632 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:29.937632 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:29.937632 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:29.937632 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:29.937632 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:29.937632 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:29.937632 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:29.937632 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:30:29.937632 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:29.940548 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 181/366] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 03:30:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:29.941589 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef1118-f80c-47a4-97c1-b3caaac6b4aa None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:30.003477 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6326a-6ebf-4853-82b6-fbded9595cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:30.004278 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6326a-6ebf-4853-82b6-fbded9595cfe None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:30.004563 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6326a-6ebf-4853-82b6-fbded9595cfe None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:30.004834 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa6326a-6ebf-4853-82b6-fbded9595cfe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:30.032702 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa6326a-6ebf-4853-82b6-fbded9595cfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:30.045459 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-2fa6326a-6ebf-4853-82b6-fbded9595cfe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 03:30:30.045459 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:30.045459 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:30.045459 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:30.045459 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:30.045459 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:30.045459 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:30.045459 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:30.045459 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:30.045459 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:30.045459 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:30.045459 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:30.045459 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:30.045459 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:30.045459 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:30.045459 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:30.046354 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:30.046354 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:30.046354 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:30.046354 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:30.046354 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:30.046354 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:30.046354 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:30.046354 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:30.046354 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:30.046354 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:30.046354 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:30.046354 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:30.046354 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:30.046354 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:30.046354 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:30.046354 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:30.047383 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:30.047383 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:30.047383 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:30.047383 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:30.047383 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:30.047383 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:30.047383 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:30.047383 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:30.047383 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:30.047383 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:30.047383 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 03:30:30.047383 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:30:30.050541 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 186/367] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jul 21 03:30:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:30.051622 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6326a-6ebf-4853-82b6-fbded9595cfe None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:30.071019 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef1118-f80c-47a4-97c1-b3caaac6b4aa None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:30.120474 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7381365-3975-47a5-b65b-5487b79fd0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:30.120840 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7381365-3975-47a5-b65b-5487b79fd0e7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:30.121013 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7381365-3975-47a5-b65b-5487b79fd0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:30.121276 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7381365-3975-47a5-b65b-5487b79fd0e7 None admin] PATH_INFO: `/v3/projects/4243c37e3bcb48b0a62103a25160eb80` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:30.123017 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7381365-3975-47a5-b65b-5487b79fd0e7 None admin] RBAC: Authorizing `identity:get_project(project_id=4243c37e3bcb48b0a62103a25160eb80)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:30.124014 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7381365-3975-47a5-b65b-5487b79fd0e7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:30.126155 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 182/368] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:30:29 2022] GET /identity/v3/projects/4243c37e3bcb48b0a62103a25160eb80 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:30.131644 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7381365-3975-47a5-b65b-5487b79fd0e7 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:30.197333 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:30.229373 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa6326a-6ebf-4853-82b6-fbded9595cfe None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:30.242322 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:30.264732 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7381365-3975-47a5-b65b-5487b79fd0e7 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:30.277001 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db04d77f-6b33-4370-a3d0-cb7359dc59c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:30.278483 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04d77f-6b33-4370-a3d0-cb7359dc59c8 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:30.279058 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04d77f-6b33-4370-a3d0-cb7359dc59c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:30.279486 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04d77f-6b33-4370-a3d0-cb7359dc59c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:30.280670 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db04d77f-6b33-4370-a3d0-cb7359dc59c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:30.281126 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db04d77f-6b33-4370-a3d0-cb7359dc59c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:30.283424 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db04d77f-6b33-4370-a3d0-cb7359dc59c8 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:30.296224 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 187/369] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:30:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:30.297554 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db04d77f-6b33-4370-a3d0-cb7359dc59c8 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:30.305640 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7571a-236b-431c-80fb-1977cd2fe96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:30.306451 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7571a-236b-431c-80fb-1977cd2fe96c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:30.306874 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7571a-236b-431c-80fb-1977cd2fe96c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:30.307253 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a7571a-236b-431c-80fb-1977cd2fe96c None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:30.308115 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7571a-236b-431c-80fb-1977cd2fe96c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:30.308527 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7571a-236b-431c-80fb-1977cd2fe96c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:30.310069 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a7571a-236b-431c-80fb-1977cd2fe96c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:30.324258 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 183/370] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:30:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:30.329935 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7571a-236b-431c-80fb-1977cd2fe96c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:30.493107 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db04d77f-6b33-4370-a3d0-cb7359dc59c8 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:30.498623 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a7571a-236b-431c-80fb-1977cd2fe96c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:30.522503 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:30.561139 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3df50-5aa4-456e-85cf-a57f485b946a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:30.561817 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3df50-5aa4-456e-85cf-a57f485b946a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:30.562106 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3df50-5aa4-456e-85cf-a57f485b946a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:30.562373 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c3df50-5aa4-456e-85cf-a57f485b946a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:30.590490 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a488202-fd32-4549-9405-bc0032541eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:30.590490 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a488202-fd32-4549-9405-bc0032541eb6 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:30.590490 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a488202-fd32-4549-9405-bc0032541eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:30.590490 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a488202-fd32-4549-9405-bc0032541eb6 None admin] PATH_INFO: `/v3/groups/06910a0fcb0d4deabe947999059f5f6d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:30.594281 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a488202-fd32-4549-9405-bc0032541eb6 None admin] RBAC: Authorizing `identity:get_group(group_id=06910a0fcb0d4deabe947999059f5f6d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:30.594281 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a488202-fd32-4549-9405-bc0032541eb6 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:30.594281 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 188/371] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jul 21 03:30:30 2022] GET /identity/v3/groups/06910a0fcb0d4deabe947999059f5f6d => generated 226 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:30.596433 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a488202-fd32-4549-9405-bc0032541eb6 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:30.659318 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:30.691682 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c3df50-5aa4-456e-85cf-a57f485b946a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:30.694526 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c3df50-5aa4-456e-85cf-a57f485b946a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:30.752797 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a488202-fd32-4549-9405-bc0032541eb6 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:30.803805 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58bd3b-175d-4ff4-9d33-721704459ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:30.805083 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58bd3b-175d-4ff4-9d33-721704459ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:30.805369 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58bd3b-175d-4ff4-9d33-721704459ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:30.805648 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58bd3b-175d-4ff4-9d33-721704459ea9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:30.885291 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 184/372] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:30:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 03:30:30.886017 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3df50-5aa4-456e-85cf-a57f485b946a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:30.903331 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:30.906314 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a58bd3b-175d-4ff4-9d33-721704459ea9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:30.908038 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a58bd3b-175d-4ff4-9d33-721704459ea9 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:30.961124 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:31.047554 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 189/373] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:30:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 03:30:31.048294 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58bd3b-175d-4ff4-9d33-721704459ea9 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:31.069079 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c3df50-5aa4-456e-85cf-a57f485b946a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:31.134054 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01184683-28fc-49d3-b2ae-8872f80ff69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:31.136579 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01184683-28fc-49d3-b2ae-8872f80ff69a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:31.137075 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01184683-28fc-49d3-b2ae-8872f80ff69a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:31.137571 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01184683-28fc-49d3-b2ae-8872f80ff69a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:31.139889 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01184683-28fc-49d3-b2ae-8872f80ff69a None admin] RBAC: Adding query filter params (group.id=06910a0fcb0d4deabe947999059f5f6d, role.id=1ac721157e9b40f18cbbc76f5a6b0d3d, scope.project.id=4243c37e3bcb48b0a62103a25160eb80) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:31.140457 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01184683-28fc-49d3-b2ae-8872f80ff69a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:31.143440 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01184683-28fc-49d3-b2ae-8872f80ff69a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:31.150723 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 185/374] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Jul 21 03:30:30 2022] GET /identity/v3/role_assignments?group.id=06910a0fcb0d4deabe947999059f5f6d&scope.project.id=4243c37e3bcb48b0a62103a25160eb80&role.id=1ac721157e9b40f18cbbc76f5a6b0d3d => generated 260 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:31.153134 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01184683-28fc-49d3-b2ae-8872f80ff69a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:31.178147 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58bd3b-175d-4ff4-9d33-721704459ea9 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:31.233590 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d92b8c-5930-42a2-83ae-f0bd8643d76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:31.235515 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d92b8c-5930-42a2-83ae-f0bd8643d76e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:31.236226 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d92b8c-5930-42a2-83ae-f0bd8643d76e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:31.236703 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d92b8c-5930-42a2-83ae-f0bd8643d76e None admin] PATH_INFO: `/v3/projects/c64654fdd0e44100a98ee66278a10b0e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:31.238226 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d92b8c-5930-42a2-83ae-f0bd8643d76e None admin] RBAC: Authorizing `identity:get_project(project_id=c64654fdd0e44100a98ee66278a10b0e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:31.240807 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d92b8c-5930-42a2-83ae-f0bd8643d76e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:31.245855 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 190/375] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:30:31 2022] GET /identity/v3/projects/c64654fdd0e44100a98ee66278a10b0e => generated 344 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:31.254422 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d92b8c-5930-42a2-83ae-f0bd8643d76e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:31.274072 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:31.288246 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:31.348548 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01184683-28fc-49d3-b2ae-8872f80ff69a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:31.417936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43e497-7754-42c1-bc0d-d1bc5eecb36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:31.418282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43e497-7754-42c1-bc0d-d1bc5eecb36d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:31.418584 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43e497-7754-42c1-bc0d-d1bc5eecb36d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:31.418865 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43e497-7754-42c1-bc0d-d1bc5eecb36d None admin] PATH_INFO: `/v3/projects/4243c37e3bcb48b0a62103a25160eb80` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:31.423325 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43e497-7754-42c1-bc0d-d1bc5eecb36d None admin] RBAC: Authorizing `identity:get_project(project_id=4243c37e3bcb48b0a62103a25160eb80)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:31.428048 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43e497-7754-42c1-bc0d-d1bc5eecb36d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:31.432852 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 186/376] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:30:31 2022] GET /identity/v3/projects/4243c37e3bcb48b0a62103a25160eb80 => generated 302 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:31.435806 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43e497-7754-42c1-bc0d-d1bc5eecb36d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:31.483162 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d92b8c-5930-42a2-83ae-f0bd8643d76e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:31.559756 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7824349-46fe-4e84-8061-be644b2a2f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:31.560637 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7824349-46fe-4e84-8061-be644b2a2f5f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:31.560921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7824349-46fe-4e84-8061-be644b2a2f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:31.561194 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7824349-46fe-4e84-8061-be644b2a2f5f None admin] PATH_INFO: `/v3/groups/c0afcedd4440465abcd4deae17867f99` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:31.577512 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7824349-46fe-4e84-8061-be644b2a2f5f None admin] RBAC: Authorizing `identity:get_group(group_id=c0afcedd4440465abcd4deae17867f99)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:31.579013 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7824349-46fe-4e84-8061-be644b2a2f5f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:31.580740 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 191/377] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jul 21 03:30:31 2022] GET /identity/v3/groups/c0afcedd4440465abcd4deae17867f99 => generated 229 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:31.592966 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7824349-46fe-4e84-8061-be644b2a2f5f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:31.647237 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43e497-7754-42c1-bc0d-d1bc5eecb36d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:31.702527 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:31.728155 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b09b03-6064-4a76-9a62-cdf07ad19a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:31.729386 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b09b03-6064-4a76-9a62-cdf07ad19a3f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:31.729889 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b09b03-6064-4a76-9a62-cdf07ad19a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:31.730431 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b09b03-6064-4a76-9a62-cdf07ad19a3f None admin] PATH_INFO: `/v3/groups/06910a0fcb0d4deabe947999059f5f6d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:31.736101 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b09b03-6064-4a76-9a62-cdf07ad19a3f None admin] RBAC: Authorizing `identity:get_group(group_id=06910a0fcb0d4deabe947999059f5f6d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:31.737817 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b09b03-6064-4a76-9a62-cdf07ad19a3f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:31.740295 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 187/378] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jul 21 03:30:31 2022] GET /identity/v3/groups/06910a0fcb0d4deabe947999059f5f6d => generated 226 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:31.742334 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f0bc34-265b-445f-955f-554a703a848a None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:31.743134 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f0bc34-265b-445f-955f-554a703a848a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:31.743608 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f0bc34-265b-445f-955f-554a703a848a None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:31.745389 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 188/379] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:31.747387 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f0bc34-265b-445f-955f-554a703a848a None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:31.761702 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7824349-46fe-4e84-8061-be644b2a2f5f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:31.784384 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:31.824700 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0054414-59cf-4c8d-9b39-c80ae845a7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:31.825374 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0054414-59cf-4c8d-9b39-c80ae845a7ac None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:31.825649 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0054414-59cf-4c8d-9b39-c80ae845a7ac None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:31.825922 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0054414-59cf-4c8d-9b39-c80ae845a7ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:31.827506 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0054414-59cf-4c8d-9b39-c80ae845a7ac None admin] RBAC: Adding query filter params (group.id=c0afcedd4440465abcd4deae17867f99, role.id=27e53d6c56f24c25a8c8057bfd36bcf1, scope.project.id=c64654fdd0e44100a98ee66278a10b0e) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:31.827506 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0054414-59cf-4c8d-9b39-c80ae845a7ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:31.828557 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0054414-59cf-4c8d-9b39-c80ae845a7ac None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:31.843436 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 192/380] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Jul 21 03:30:31 2022] GET /identity/v3/role_assignments?group.id=c0afcedd4440465abcd4deae17867f99&scope.project.id=c64654fdd0e44100a98ee66278a10b0e&role.id=27e53d6c56f24c25a8c8057bfd36bcf1 => generated 260 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:31.845401 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ab8ff-2743-4cc6-8e69-64f3c69d329a None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:31.847149 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ab8ff-2743-4cc6-8e69-64f3c69d329a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:31.847720 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ab8ff-2743-4cc6-8e69-64f3c69d329a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:31.888246 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-139ab8ff-2743-4cc6-8e69-64f3c69d329a None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:31.889459 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-139ab8ff-2743-4cc6-8e69-64f3c69d329a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:31.927483 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f0bc34-265b-445f-955f-554a703a848a None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:31.998488 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6e71a-53db-4ec7-a3e1-34f6a77ef912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:31.998488 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6e71a-53db-4ec7-a3e1-34f6a77ef912 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:31.998488 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6e71a-53db-4ec7-a3e1-34f6a77ef912 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:31.998488 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6e71a-53db-4ec7-a3e1-34f6a77ef912 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:31.999276 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a6e71a-53db-4ec7-a3e1-34f6a77ef912 None admin] RBAC: Adding query filter params (group.id=06910a0fcb0d4deabe947999059f5f6d, role.id=76578c4e1dbb4559b293fb93830ed5b2, scope.project.id=4243c37e3bcb48b0a62103a25160eb80) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:31.999597 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a6e71a-53db-4ec7-a3e1-34f6a77ef912 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:32.005369 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a6e71a-53db-4ec7-a3e1-34f6a77ef912 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:32.023420 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 189/381] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Jul 21 03:30:31 2022] GET /identity/v3/role_assignments?group.id=06910a0fcb0d4deabe947999059f5f6d&scope.project.id=4243c37e3bcb48b0a62103a25160eb80&role.id=76578c4e1dbb4559b293fb93830ed5b2 => generated 260 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:32.097697 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 193/382] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:30:32.147922 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6e71a-53db-4ec7-a3e1-34f6a77ef912 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:32.160344 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37962590-c6b5-4487-9bd6-4f9b2b154bec None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:32.160655 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37962590-c6b5-4487-9bd6-4f9b2b154bec None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:32.160912 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37962590-c6b5-4487-9bd6-4f9b2b154bec None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:32.162593 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 194/383] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:32.172160 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2210fd-3530-4360-b294-19e614ab0816 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:32.172588 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2210fd-3530-4360-b294-19e614ab0816 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:32.173568 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2210fd-3530-4360-b294-19e614ab0816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:32.194165 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-fa2210fd-3530-4360-b294-19e614ab0816 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:32.195424 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fa2210fd-3530-4360-b294-19e614ab0816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:32.278487 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:32.285388 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 195/384] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 03:30:32.293346 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:32.330740 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2210fd-3530-4360-b294-19e614ab0816 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:32.361040 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6e71a-53db-4ec7-a3e1-34f6a77ef912 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:32.410789 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2efcf-acf2-4489-aa1c-91bceed118c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:32.411626 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2efcf-acf2-4489-aa1c-91bceed118c4 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:32.411915 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2efcf-acf2-4489-aa1c-91bceed118c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:32.412192 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2efcf-acf2-4489-aa1c-91bceed118c4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:32.438486 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db2efcf-acf2-4489-aa1c-91bceed118c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:32.439390 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-5db2efcf-acf2-4489-aa1c-91bceed118c4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 03:30:32.439390 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:32.439390 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:32.439390 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:32.439390 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:32.439390 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:32.439390 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:32.439390 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:32.439390 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:32.439390 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:32.439390 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:32.439390 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:32.439390 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:32.439390 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:32.439390 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:32.439390 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:32.440232 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:32.440232 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:32.440232 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:32.440232 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:32.440232 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:32.440232 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:32.440232 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:32.440232 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:32.440232 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:32.440232 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:32.440232 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:32.440232 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:32.440232 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:32.440232 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:32.440232 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:32.440232 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:32.441196 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:32.441196 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:32.441196 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:32.441196 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:32.441196 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:32.441196 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:32.441196 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:32.441196 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:32.441196 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:32.441196 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:32.441196 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 03:30:32.441196 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:32.441196 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 190/385] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jul 21 03:30:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:32.454619 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2efcf-acf2-4489-aa1c-91bceed118c4 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:32.569571 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2210fd-3530-4360-b294-19e614ab0816 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:32.650358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06aa286-1584-48e5-bc37-f0ae57eb533f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:32.651430 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06aa286-1584-48e5-bc37-f0ae57eb533f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:32.651852 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06aa286-1584-48e5-bc37-f0ae57eb533f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:32.652261 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06aa286-1584-48e5-bc37-f0ae57eb533f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:32.665045 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2efcf-acf2-4489-aa1c-91bceed118c4 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:32.679394 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06aa286-1584-48e5-bc37-f0ae57eb533f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:32.691314 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-b06aa286-1584-48e5-bc37-f0ae57eb533f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 03:30:32.691314 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:32.691314 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:32.691314 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:32.691314 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:32.691314 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:32.691314 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:32.691314 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:32.691314 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:32.691314 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:32.691314 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:32.691314 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:32.691314 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:32.691314 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:32.691314 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:32.691314 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:32.692285 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:32.692285 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:32.692285 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:32.692285 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:32.692285 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:32.692285 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:32.692285 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:32.692285 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:32.692285 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:32.692285 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:32.692285 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:32.692285 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:32.692285 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:32.692285 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:32.692285 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:32.692285 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:32.693090 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:32.693090 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:32.693090 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:32.693090 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:32.693090 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:32.693090 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:32.693090 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:32.693090 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:32.693090 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:32.693090 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:32.693090 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 03:30:32.693090 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:30:32.705559 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 196/386] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:30:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:30:32.714537 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06aa286-1584-48e5-bc37-f0ae57eb533f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:32.749216 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3a12f-85f5-46c5-8b87-52843756b785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:32.751578 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3a12f-85f5-46c5-8b87-52843756b785 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:32.753378 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3a12f-85f5-46c5-8b87-52843756b785 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:32.753655 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef3a12f-85f5-46c5-8b87-52843756b785 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:32.754417 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3a12f-85f5-46c5-8b87-52843756b785 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:32.754751 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3a12f-85f5-46c5-8b87-52843756b785 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:32.756136 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef3a12f-85f5-46c5-8b87-52843756b785 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:32.765677 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:32.783030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 191/387] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:30:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:30:32.785697 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3a12f-85f5-46c5-8b87-52843756b785 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:32.840842 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:32.948410 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06aa286-1584-48e5-bc37-f0ae57eb533f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:32.997748 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef3a12f-85f5-46c5-8b87-52843756b785 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:33.022644 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46af60-e243-47eb-b809-4fd27bae92c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:33.023488 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46af60-e243-47eb-b809-4fd27bae92c0 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:33.023771 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46af60-e243-47eb-b809-4fd27bae92c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:33.024051 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46af60-e243-47eb-b809-4fd27bae92c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:33.026571 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e46af60-e243-47eb-b809-4fd27bae92c0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:33.026571 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e46af60-e243-47eb-b809-4fd27bae92c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:33.027039 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e46af60-e243-47eb-b809-4fd27bae92c0 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:33.044088 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 197/388] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 03:30:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:33.045739 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46af60-e243-47eb-b809-4fd27bae92c0 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:33.123164 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b88eeb-c545-4189-866b-f5c4db5bf188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:33.125097 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b88eeb-c545-4189-866b-f5c4db5bf188 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:33.125097 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b88eeb-c545-4189-866b-f5c4db5bf188 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:33.125097 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b88eeb-c545-4189-866b-f5c4db5bf188 None admin] PATH_INFO: `/v3/groups/06910a0fcb0d4deabe947999059f5f6d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:33.131178 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b88eeb-c545-4189-866b-f5c4db5bf188 None admin] RBAC: Authorizing `identity:get_group(group_id=06910a0fcb0d4deabe947999059f5f6d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:33.132768 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b88eeb-c545-4189-866b-f5c4db5bf188 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:33.134677 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 192/389] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jul 21 03:30:32 2022] GET /identity/v3/groups/06910a0fcb0d4deabe947999059f5f6d => generated 226 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:33.142950 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b88eeb-c545-4189-866b-f5c4db5bf188 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:33.160890 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46af60-e243-47eb-b809-4fd27bae92c0 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:33.180875 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:33.217903 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5f224-76fb-4f44-87b8-fdf9a891f09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:33.220959 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5f224-76fb-4f44-87b8-fdf9a891f09e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:33.221251 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5f224-76fb-4f44-87b8-fdf9a891f09e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:33.221529 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e5f224-76fb-4f44-87b8-fdf9a891f09e None admin] PATH_INFO: `/v3/groups/06910a0fcb0d4deabe947999059f5f6d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:33.223529 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e5f224-76fb-4f44-87b8-fdf9a891f09e None admin] RBAC: Authorizing `identity:get_group(group_id=06910a0fcb0d4deabe947999059f5f6d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:33.231819 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e5f224-76fb-4f44-87b8-fdf9a891f09e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:33.235768 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 198/390] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jul 21 03:30:33 2022] GET /identity/v3/groups/06910a0fcb0d4deabe947999059f5f6d => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:33.241552 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5f224-76fb-4f44-87b8-fdf9a891f09e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:33.284000 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:33.354974 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b88eeb-c545-4189-866b-f5c4db5bf188 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:33.433407 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e5f224-76fb-4f44-87b8-fdf9a891f09e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:33.455388 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de079b16-e60e-47c9-80d2-d161c0377078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:33.456651 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de079b16-e60e-47c9-80d2-d161c0377078 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:33.457135 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de079b16-e60e-47c9-80d2-d161c0377078 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:33.457686 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de079b16-e60e-47c9-80d2-d161c0377078 None admin] PATH_INFO: `/v3/projects/e7eff2725d90448aaf1b1dc5e791bd90` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:33.459229 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de079b16-e60e-47c9-80d2-d161c0377078 None admin] RBAC: Authorizing `identity:get_project(project_id=e7eff2725d90448aaf1b1dc5e791bd90)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:33.461444 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de079b16-e60e-47c9-80d2-d161c0377078 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:33.463750 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 193/391] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:30:33 2022] GET /identity/v3/projects/e7eff2725d90448aaf1b1dc5e791bd90 => generated 298 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:33.471732 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de079b16-e60e-47c9-80d2-d161c0377078 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:33.494015 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3de46-a7d5-482a-ace8-bdb0afd9402c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:33.494948 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3de46-a7d5-482a-ace8-bdb0afd9402c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:33.495225 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3de46-a7d5-482a-ace8-bdb0afd9402c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:33.496179 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3de46-a7d5-482a-ace8-bdb0afd9402c None admin] PATH_INFO: `/v3/projects/e7eff2725d90448aaf1b1dc5e791bd90` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:33.496711 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d3de46-a7d5-482a-ace8-bdb0afd9402c None admin] RBAC: Authorizing `identity:get_project(project_id=e7eff2725d90448aaf1b1dc5e791bd90)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:33.498156 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d3de46-a7d5-482a-ace8-bdb0afd9402c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:33.506953 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 199/392] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:30:33 2022] GET /identity/v3/projects/e7eff2725d90448aaf1b1dc5e791bd90 => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:33.519545 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3de46-a7d5-482a-ace8-bdb0afd9402c None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:33.620422 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:33.656433 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de079b16-e60e-47c9-80d2-d161c0377078 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:33.718352 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3de46-a7d5-482a-ace8-bdb0afd9402c None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:33.731137 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6868b6-8d11-427b-8e97-b14b2b94d94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:33.732040 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6868b6-8d11-427b-8e97-b14b2b94d94d None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:33.732326 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6868b6-8d11-427b-8e97-b14b2b94d94d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:33.732604 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6868b6-8d11-427b-8e97-b14b2b94d94d None admin] PATH_INFO: `/v3/projects/e7eff2725d90448aaf1b1dc5e791bd90/groups/06910a0fcb0d4deabe947999059f5f6d/roles/76578c4e1dbb4559b293fb93830ed5b2` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:33.737454 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6868b6-8d11-427b-8e97-b14b2b94d94d None admin] RBAC: Authorizing `identity:create_grant(project_id=e7eff2725d90448aaf1b1dc5e791bd90, group_id=06910a0fcb0d4deabe947999059f5f6d, role_id=76578c4e1dbb4559b293fb93830ed5b2)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:33.738930 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6868b6-8d11-427b-8e97-b14b2b94d94d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:33.741504 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:33.768311 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 194/393] 10.222.0.20 () {58 vars in 1442 bytes} [Thu Jul 21 03:30:33 2022] PUT /identity/v3/projects/e7eff2725d90448aaf1b1dc5e791bd90/groups/06910a0fcb0d4deabe947999059f5f6d/roles/76578c4e1dbb4559b293fb93830ed5b2 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:30:33.793300 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66df6f-2c52-4c4e-b680-ce74d9e61c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:33.794265 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66df6f-2c52-4c4e-b680-ce74d9e61c6e None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:33.794579 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66df6f-2c52-4c4e-b680-ce74d9e61c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:33.794861 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66df6f-2c52-4c4e-b680-ce74d9e61c6e None admin] PATH_INFO: `/v3/projects/e7eff2725d90448aaf1b1dc5e791bd90/groups/06910a0fcb0d4deabe947999059f5f6d/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:33.799736 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b66df6f-2c52-4c4e-b680-ce74d9e61c6e None admin] RBAC: Authorizing `identity:create_grant(project_id=e7eff2725d90448aaf1b1dc5e791bd90, group_id=06910a0fcb0d4deabe947999059f5f6d, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:33.801260 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b66df6f-2c52-4c4e-b680-ce74d9e61c6e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:33.833346 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 200/394] 10.222.0.20 () {58 vars in 1442 bytes} [Thu Jul 21 03:30:33 2022] PUT /identity/v3/projects/e7eff2725d90448aaf1b1dc5e791bd90/groups/06910a0fcb0d4deabe947999059f5f6d/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:30:33.938973 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a18ba6-0dfb-49e4-8176-397830c5bf94 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:33.939271 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a18ba6-0dfb-49e4-8176-397830c5bf94 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:33.939486 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a18ba6-0dfb-49e4-8176-397830c5bf94 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:33.941334 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 195/395] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:33.947329 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7183311-bf1a-4067-8bf6-63e1d9c8d1b8 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:33.947832 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7183311-bf1a-4067-8bf6-63e1d9c8d1b8 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:33.947926 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7183311-bf1a-4067-8bf6-63e1d9c8d1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:33.979832 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-e7183311-bf1a-4067-8bf6-63e1d9c8d1b8 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:33.981143 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e7183311-bf1a-4067-8bf6-63e1d9c8d1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:34.105756 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 201/396] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:30:34.130842 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a18ba6-0dfb-49e4-8176-397830c5bf94 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:34.362205 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a18ba6-0dfb-49e4-8176-397830c5bf94 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:34.427198 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1216c-9ae9-44da-9cc4-0c5fde1cb13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:34.428256 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1216c-9ae9-44da-9cc4-0c5fde1cb13e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:34.428686 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1216c-9ae9-44da-9cc4-0c5fde1cb13e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:34.429157 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1216c-9ae9-44da-9cc4-0c5fde1cb13e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:34.455651 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab1216c-9ae9-44da-9cc4-0c5fde1cb13e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:34.463848 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-bab1216c-9ae9-44da-9cc4-0c5fde1cb13e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 03:30:34.463848 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:34.463848 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:34.463848 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:34.463848 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:34.463848 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:34.463848 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:34.463848 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:34.463848 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:34.463848 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:34.463848 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:34.463848 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:34.463848 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:34.463848 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:34.463848 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:34.463848 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:34.464828 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:34.464828 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:34.464828 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:34.464828 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:34.464828 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:34.464828 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:34.464828 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:34.464828 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:34.464828 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:34.464828 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:34.464828 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:34.464828 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:34.464828 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:34.464828 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:34.464828 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:34.464828 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:34.465643 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:34.465643 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:34.465643 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:34.465643 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:34.465643 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:34.465643 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:34.465643 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:34.465643 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:34.465643 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:34.465643 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:34.465643 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 03:30:34.465643 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:34.476712 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 196/397] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:30:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:34.482347 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7183311-bf1a-4067-8bf6-63e1d9c8d1b8 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:34.569219 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814c149-7c3e-4c50-9be7-d9a78f16e9e2 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:34.569771 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814c149-7c3e-4c50-9be7-d9a78f16e9e2 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:34.570203 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3814c149-7c3e-4c50-9be7-d9a78f16e9e2 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:34.571749 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 197/398] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 03:30:34.577563 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502a647-5926-411b-a1f9-24a689cae9c5 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:34.577932 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502a647-5926-411b-a1f9-24a689cae9c5 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:34.578310 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502a647-5926-411b-a1f9-24a689cae9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:34.595910 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:34.607468 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-8502a647-5926-411b-a1f9-24a689cae9c5 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:34.609583 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8502a647-5926-411b-a1f9-24a689cae9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:34.706899 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:34.747136 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 198/399] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:30:34.766048 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e625cd-2496-40b3-a8e3-6ac1da42bcca None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:34.766766 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e625cd-2496-40b3-a8e3-6ac1da42bcca None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:34.767243 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e625cd-2496-40b3-a8e3-6ac1da42bcca None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:34.769051 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 199/400] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 03:30:34.780011 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58c92e-ce1c-47d2-a83c-0b14c5e2b1fd None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:34.780595 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58c92e-ce1c-47d2-a83c-0b14c5e2b1fd None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:34.781088 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58c92e-ce1c-47d2-a83c-0b14c5e2b1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:34.781300 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7183311-bf1a-4067-8bf6-63e1d9c8d1b8 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:34.817192 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-de58c92e-ce1c-47d2-a83c-0b14c5e2b1fd None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:34.818325 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-de58c92e-ce1c-47d2-a83c-0b14c5e2b1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:34.833198 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7fdb26-744d-422c-8593-a2cf8e73a010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:34.833770 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7fdb26-744d-422c-8593-a2cf8e73a010 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:34.834249 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7fdb26-744d-422c-8593-a2cf8e73a010 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:34.834589 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7fdb26-744d-422c-8593-a2cf8e73a010 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:34.837959 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7fdb26-744d-422c-8593-a2cf8e73a010 None admin] RBAC: Adding query filter params (name=member) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:34.838348 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7fdb26-744d-422c-8593-a2cf8e73a010 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:34.844136 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7fdb26-744d-422c-8593-a2cf8e73a010 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:34.862485 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 202/401] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 03:30:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:34.862485 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7fdb26-744d-422c-8593-a2cf8e73a010 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:34.950482 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 200/402] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:30:34.950482 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58c92e-ce1c-47d2-a83c-0b14c5e2b1fd None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:35.023876 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7fdb26-744d-422c-8593-a2cf8e73a010 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:35.026808 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:35.062936 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b285a3a-a936-4b5a-b8ec-455d937a6cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:35.064160 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b285a3a-a936-4b5a-b8ec-455d937a6cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:35.064667 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b285a3a-a936-4b5a-b8ec-455d937a6cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:35.065225 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b285a3a-a936-4b5a-b8ec-455d937a6cb3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:35.076765 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b285a3a-a936-4b5a-b8ec-455d937a6cb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:35.090445 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-6b285a3a-a936-4b5a-b8ec-455d937a6cb3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:30:35.090445 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:35.090445 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:35.090445 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:35.090445 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:35.090445 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:35.090445 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:35.090445 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:35.090445 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:35.090445 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:35.090445 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:35.090445 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:35.090445 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:35.090445 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:35.090445 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:35.090445 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:35.091341 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:35.091341 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:35.091341 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:35.091341 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:35.091341 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:35.091341 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:35.091341 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:35.091341 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:35.091341 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:35.091341 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:35.091341 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:35.091341 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:35.091341 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:35.091341 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:35.091341 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:35.091341 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:35.092148 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:35.092148 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:35.092148 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:35.092148 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:35.092148 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:35.092148 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:35.092148 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:35.092148 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:35.092148 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:35.092148 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:35.092148 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:30:35.092148 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:30:35.096268 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 203/403] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 03:30:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:35.097291 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b285a3a-a936-4b5a-b8ec-455d937a6cb3 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:35.110279 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58c92e-ce1c-47d2-a83c-0b14c5e2b1fd None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:35.131628 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:35.176842 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffc158-d6b1-443c-9e87-95e2b4198b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:35.177918 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffc158-d6b1-443c-9e87-95e2b4198b9d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:35.178113 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffc158-d6b1-443c-9e87-95e2b4198b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:35.178379 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffc158-d6b1-443c-9e87-95e2b4198b9d None admin] PATH_INFO: `/v3/groups/06910a0fcb0d4deabe947999059f5f6d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:35.180335 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbffc158-d6b1-443c-9e87-95e2b4198b9d None admin] RBAC: Authorizing `identity:get_group(group_id=06910a0fcb0d4deabe947999059f5f6d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:35.181782 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbffc158-d6b1-443c-9e87-95e2b4198b9d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:35.184898 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 201/404] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jul 21 03:30:34 2022] GET /identity/v3/groups/06910a0fcb0d4deabe947999059f5f6d => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:35.185639 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffc158-d6b1-443c-9e87-95e2b4198b9d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:35.227115 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b285a3a-a936-4b5a-b8ec-455d937a6cb3 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:35.275142 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac357ad6-ad16-4073-9a20-f625f4693872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:35.276628 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac357ad6-ad16-4073-9a20-f625f4693872 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:35.277129 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac357ad6-ad16-4073-9a20-f625f4693872 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:35.277614 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac357ad6-ad16-4073-9a20-f625f4693872 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:35.291377 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac357ad6-ad16-4073-9a20-f625f4693872 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:35.300531 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-ac357ad6-ad16-4073-9a20-f625f4693872 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 03:30:35.300531 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:35.300531 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:35.300531 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:35.300531 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:35.300531 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:35.300531 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:35.300531 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:35.300531 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:35.300531 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:35.300531 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:35.300531 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:35.300531 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:35.300531 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:35.300531 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:35.300531 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:35.301421 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:35.301421 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:35.301421 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:35.301421 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:35.301421 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:35.301421 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:35.301421 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:35.301421 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:35.301421 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:35.301421 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:35.301421 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:35.301421 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:35.301421 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:35.301421 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:35.301421 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:35.301421 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:35.302216 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:35.302216 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:35.302216 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:35.302216 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:35.302216 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:35.302216 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:35.302216 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:35.302216 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:35.302216 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:35.302216 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:35.302216 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 03:30:35.302216 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:30:35.304665 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 204/405] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jul 21 03:30:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:35.305246 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac357ad6-ad16-4073-9a20-f625f4693872 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:35.348604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:35.376129 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffc158-d6b1-443c-9e87-95e2b4198b9d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:35.421982 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d235294-2e73-49bb-bbf1-22732762ae7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:35.422653 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d235294-2e73-49bb-bbf1-22732762ae7e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:35.422937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d235294-2e73-49bb-bbf1-22732762ae7e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:35.423209 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d235294-2e73-49bb-bbf1-22732762ae7e None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:35.424017 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d235294-2e73-49bb-bbf1-22732762ae7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:35.424586 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d235294-2e73-49bb-bbf1-22732762ae7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:35.426282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d235294-2e73-49bb-bbf1-22732762ae7e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:35.442620 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 202/406] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:30:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:35.443292 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d235294-2e73-49bb-bbf1-22732762ae7e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:35.446241 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac357ad6-ad16-4073-9a20-f625f4693872 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:35.494112 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301117c-71aa-45ed-bba7-1ea186d61a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:35.500119 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301117c-71aa-45ed-bba7-1ea186d61a1e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:35.500635 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301117c-71aa-45ed-bba7-1ea186d61a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:35.501110 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301117c-71aa-45ed-bba7-1ea186d61a1e None admin] PATH_INFO: `/v3/projects/4243c37e3bcb48b0a62103a25160eb80` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:35.504179 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8301117c-71aa-45ed-bba7-1ea186d61a1e None admin] RBAC: Authorizing `identity:get_project(project_id=4243c37e3bcb48b0a62103a25160eb80)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:35.505884 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8301117c-71aa-45ed-bba7-1ea186d61a1e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:35.508868 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 205/407] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:30:35 2022] GET /identity/v3/projects/4243c37e3bcb48b0a62103a25160eb80 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:35.509899 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301117c-71aa-45ed-bba7-1ea186d61a1e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:35.525043 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:35.608479 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d235294-2e73-49bb-bbf1-22732762ae7e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:35.619980 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:35.630529 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301117c-71aa-45ed-bba7-1ea186d61a1e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:35.672189 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7562258-35a2-490c-9f33-077b3d0a41fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:35.672399 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda21be0-ba82-456d-a31b-16f36239d57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:35.673231 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda21be0-ba82-456d-a31b-16f36239d57d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:35.673381 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7562258-35a2-490c-9f33-077b3d0a41fb None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:35.673553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda21be0-ba82-456d-a31b-16f36239d57d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:35.673662 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7562258-35a2-490c-9f33-077b3d0a41fb None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:35.673818 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda21be0-ba82-456d-a31b-16f36239d57d None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:35.673907 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7562258-35a2-490c-9f33-077b3d0a41fb None admin] PATH_INFO: `/v3/groups/c0afcedd4440465abcd4deae17867f99` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:35.682890 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda21be0-ba82-456d-a31b-16f36239d57d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:35.683039 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7562258-35a2-490c-9f33-077b3d0a41fb None admin] RBAC: Authorizing `identity:get_group(group_id=c0afcedd4440465abcd4deae17867f99)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:35.683039 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7562258-35a2-490c-9f33-077b3d0a41fb None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:35.683170 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda21be0-ba82-456d-a31b-16f36239d57d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:35.683170 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda21be0-ba82-456d-a31b-16f36239d57d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:35.683324 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 206/408] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jul 21 03:30:35 2022] GET /identity/v3/groups/c0afcedd4440465abcd4deae17867f99 => generated 229 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:35.683324 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7562258-35a2-490c-9f33-077b3d0a41fb None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:35.703569 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 203/409] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:30:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:35.704440 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda21be0-ba82-456d-a31b-16f36239d57d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:35.800898 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7562258-35a2-490c-9f33-077b3d0a41fb None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:35.838850 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb67744-ed0c-4ef5-981f-f8630c68204a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:35.840147 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb67744-ed0c-4ef5-981f-f8630c68204a None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:35.840750 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb67744-ed0c-4ef5-981f-f8630c68204a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:35.841164 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb67744-ed0c-4ef5-981f-f8630c68204a None admin] PATH_INFO: `/v3/projects/4243c37e3bcb48b0a62103a25160eb80/groups/06910a0fcb0d4deabe947999059f5f6d/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:35.843455 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb67744-ed0c-4ef5-981f-f8630c68204a None admin] RBAC: Authorizing `identity:create_grant(project_id=4243c37e3bcb48b0a62103a25160eb80, group_id=06910a0fcb0d4deabe947999059f5f6d, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:35.845254 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb67744-ed0c-4ef5-981f-f8630c68204a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:35.869170 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 207/410] 10.222.0.20 () {58 vars in 1442 bytes} [Thu Jul 21 03:30:35 2022] PUT /identity/v3/projects/4243c37e3bcb48b0a62103a25160eb80/groups/06910a0fcb0d4deabe947999059f5f6d/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:30:35.870713 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb67744-ed0c-4ef5-981f-f8630c68204a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:35.922067 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:35.950831 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda21be0-ba82-456d-a31b-16f36239d57d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:35.959982 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:36.033726 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f9fff-43c1-45bf-a7b7-93361eee27a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:36.035001 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f9fff-43c1-45bf-a7b7-93361eee27a3 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:36.035557 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f9fff-43c1-45bf-a7b7-93361eee27a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:36.036048 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f9fff-43c1-45bf-a7b7-93361eee27a3 None admin] PATH_INFO: `/v3/projects/c64654fdd0e44100a98ee66278a10b0e` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:36.039636 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f9fff-43c1-45bf-a7b7-93361eee27a3 None admin] RBAC: Authorizing `identity:get_project(project_id=c64654fdd0e44100a98ee66278a10b0e)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:36.045409 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f9fff-43c1-45bf-a7b7-93361eee27a3 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:36.051299 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 204/411] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:30:35 2022] GET /identity/v3/projects/c64654fdd0e44100a98ee66278a10b0e => generated 344 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:36.053898 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f9fff-43c1-45bf-a7b7-93361eee27a3 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:36.104000 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb67744-ed0c-4ef5-981f-f8630c68204a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:36.149519 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8bb65-8165-40e8-9fa1-48063b104dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:36.150990 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8bb65-8165-40e8-9fa1-48063b104dce None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:36.151565 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8bb65-8165-40e8-9fa1-48063b104dce None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:36.152252 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8bb65-8165-40e8-9fa1-48063b104dce None admin] PATH_INFO: `/v3/groups/06910a0fcb0d4deabe947999059f5f6d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:36.154830 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b8bb65-8165-40e8-9fa1-48063b104dce None admin] RBAC: Authorizing `identity:get_group(group_id=06910a0fcb0d4deabe947999059f5f6d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:36.156506 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b8bb65-8165-40e8-9fa1-48063b104dce None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:36.158428 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 208/412] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jul 21 03:30:35 2022] GET /identity/v3/groups/06910a0fcb0d4deabe947999059f5f6d => generated 226 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:36.166933 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8bb65-8165-40e8-9fa1-48063b104dce None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:36.202690 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f9fff-43c1-45bf-a7b7-93361eee27a3 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:36.261609 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5866cf9c-9755-47f3-88b4-0570a811f585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:36.262710 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866cf9c-9755-47f3-88b4-0570a811f585 None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:36.262998 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866cf9c-9755-47f3-88b4-0570a811f585 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:36.263277 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5866cf9c-9755-47f3-88b4-0570a811f585 None admin] PATH_INFO: `/v3/projects/c64654fdd0e44100a98ee66278a10b0e/groups/c0afcedd4440465abcd4deae17867f99/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:36.265688 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866cf9c-9755-47f3-88b4-0570a811f585 None admin] RBAC: Authorizing `identity:create_grant(project_id=c64654fdd0e44100a98ee66278a10b0e, group_id=c0afcedd4440465abcd4deae17867f99, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:36.267491 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5866cf9c-9755-47f3-88b4-0570a811f585 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:36.294438 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 205/413] 10.222.0.20 () {58 vars in 1442 bytes} [Thu Jul 21 03:30:36 2022] PUT /identity/v3/projects/c64654fdd0e44100a98ee66278a10b0e/groups/c0afcedd4440465abcd4deae17867f99/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:30:36.295205 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89244980-d6d2-4a93-8c5a-e4f1ce1444d7 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:36.295543 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89244980-d6d2-4a93-8c5a-e4f1ce1444d7 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:36.295828 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89244980-d6d2-4a93-8c5a-e4f1ce1444d7 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:36.302860 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 206/414] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:36.304418 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2c84d-aa7d-4850-9ba3-06f6447f0dd9 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:36.304724 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2c84d-aa7d-4850-9ba3-06f6447f0dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:36.305186 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2c84d-aa7d-4850-9ba3-06f6447f0dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:36.327614 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-17e2c84d-aa7d-4850-9ba3-06f6447f0dd9 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:36.329226 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-17e2c84d-aa7d-4850-9ba3-06f6447f0dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:36.342672 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:36.361217 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8bb65-8165-40e8-9fa1-48063b104dce None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:36.406438 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5b8e7-d2f4-493d-971b-3ce28a78a44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:36.408062 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5b8e7-d2f4-493d-971b-3ce28a78a44a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:36.408525 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5b8e7-d2f4-493d-971b-3ce28a78a44a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:36.408948 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5b8e7-d2f4-493d-971b-3ce28a78a44a None admin] PATH_INFO: `/v3/projects/4243c37e3bcb48b0a62103a25160eb80` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:36.410432 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d5b8e7-d2f4-493d-971b-3ce28a78a44a None admin] RBAC: Authorizing `identity:get_project(project_id=4243c37e3bcb48b0a62103a25160eb80)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:36.412288 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d5b8e7-d2f4-493d-971b-3ce28a78a44a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:36.422731 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 209/415] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:30:36 2022] GET /identity/v3/projects/4243c37e3bcb48b0a62103a25160eb80 => generated 302 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:36.424613 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881049d3-9564-43cd-a8bc-b314f2662bb5 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:36.425061 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881049d3-9564-43cd-a8bc-b314f2662bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:36.425776 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881049d3-9564-43cd-a8bc-b314f2662bb5 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:36.428140 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:36.428858 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 210/416] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:36.430624 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881049d3-9564-43cd-a8bc-b314f2662bb5 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:36.547467 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 207/417] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:30:36.547467 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc15fb-e911-4046-9611-6e30037fa185 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:36.547467 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc15fb-e911-4046-9611-6e30037fa185 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:36.547467 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cc15fb-e911-4046-9611-6e30037fa185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:36.568263 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f8cc15fb-e911-4046-9611-6e30037fa185 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:36.570427 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f8cc15fb-e911-4046-9611-6e30037fa185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:36.598482 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881049d3-9564-43cd-a8bc-b314f2662bb5 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:36.633469 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b00cc-2f58-4a52-8882-268a3a5f0968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:36.634370 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b00cc-2f58-4a52-8882-268a3a5f0968 None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:36.634701 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b00cc-2f58-4a52-8882-268a3a5f0968 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:36.634980 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b00cc-2f58-4a52-8882-268a3a5f0968 None admin] PATH_INFO: `/v3/projects/4243c37e3bcb48b0a62103a25160eb80/groups/06910a0fcb0d4deabe947999059f5f6d/roles/76578c4e1dbb4559b293fb93830ed5b2` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:36.638030 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99b00cc-2f58-4a52-8882-268a3a5f0968 None admin] RBAC: Authorizing `identity:create_grant(project_id=4243c37e3bcb48b0a62103a25160eb80, group_id=06910a0fcb0d4deabe947999059f5f6d, role_id=76578c4e1dbb4559b293fb93830ed5b2)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:36.638817 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99b00cc-2f58-4a52-8882-268a3a5f0968 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:36.659091 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 208/418] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:30:36.659900 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cc15fb-e911-4046-9611-6e30037fa185 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:36.664813 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 211/419] 10.222.0.20 () {58 vars in 1442 bytes} [Thu Jul 21 03:30:36 2022] PUT /identity/v3/projects/4243c37e3bcb48b0a62103a25160eb80/groups/06910a0fcb0d4deabe947999059f5f6d/roles/76578c4e1dbb4559b293fb93830ed5b2 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:30:36.703197 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b00cc-2f58-4a52-8882-268a3a5f0968 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:36.761455 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:36.884278 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:36.895170 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cc15fb-e911-4046-9611-6e30037fa185 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:36.932054 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788be095-720d-4611-a52a-ac6f69542c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:36.937848 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788be095-720d-4611-a52a-ac6f69542c53 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:36.937848 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788be095-720d-4611-a52a-ac6f69542c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:36.937848 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788be095-720d-4611-a52a-ac6f69542c53 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:36.948992 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788be095-720d-4611-a52a-ac6f69542c53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:36.959691 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-788be095-720d-4611-a52a-ac6f69542c53 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 03:30:36.959691 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:36.959691 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:36.959691 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:36.959691 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:36.959691 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:36.959691 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:36.959691 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:36.959691 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:36.959691 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:36.959691 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:36.959691 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:36.959691 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:36.959691 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:36.959691 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:36.959691 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:36.960615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:36.960615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:36.960615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:36.960615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:36.960615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:36.960615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:36.960615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:36.960615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:36.960615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:36.960615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:36.960615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:36.960615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:36.960615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:36.960615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:36.960615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:36.960615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:36.961428 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:36.961428 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:36.961428 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:36.961428 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:36.961428 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:36.961428 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:36.961428 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:36.961428 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:36.961428 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:36.961428 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:36.961428 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 03:30:36.961428 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:36.961428 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 209/420] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:30:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:36.967789 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788be095-720d-4611-a52a-ac6f69542c53 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:37.044359 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b00cc-2f58-4a52-8882-268a3a5f0968 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:37.080574 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788be095-720d-4611-a52a-ac6f69542c53 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:37.133523 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388aafee-6f2f-47b4-9312-ea99802ecf79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:37.134214 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388aafee-6f2f-47b4-9312-ea99802ecf79 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:37.134545 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388aafee-6f2f-47b4-9312-ea99802ecf79 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:37.134995 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388aafee-6f2f-47b4-9312-ea99802ecf79 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:37.135763 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388aafee-6f2f-47b4-9312-ea99802ecf79 None admin] RBAC: Adding query filter params (name=member) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:37.136077 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388aafee-6f2f-47b4-9312-ea99802ecf79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:37.138730 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388aafee-6f2f-47b4-9312-ea99802ecf79 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:37.150562 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 210/421] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 03:30:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:37.156960 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388aafee-6f2f-47b4-9312-ea99802ecf79 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:37.175860 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85798a5-4231-496c-ae2e-71a8241b7503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:37.176697 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85798a5-4231-496c-ae2e-71a8241b7503 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:37.176979 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85798a5-4231-496c-ae2e-71a8241b7503 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:37.177606 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85798a5-4231-496c-ae2e-71a8241b7503 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:37.177709 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:37.210352 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85798a5-4231-496c-ae2e-71a8241b7503 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:37.223587 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-c85798a5-4231-496c-ae2e-71a8241b7503 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 03:30:37.223587 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:37.223587 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:37.223587 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:37.223587 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:37.223587 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:37.223587 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:37.223587 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:37.223587 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:37.223587 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:37.223587 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:37.223587 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:37.223587 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:37.223587 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:37.223587 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:37.223587 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:37.224544 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:37.224544 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:37.224544 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:37.224544 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:37.224544 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:37.224544 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:37.224544 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:37.224544 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:37.224544 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:37.224544 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:37.224544 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:37.224544 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:37.224544 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:37.224544 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:37.224544 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:37.224544 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:37.225333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:37.225333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:37.225333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:37.225333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:37.225333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:37.225333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:37.225333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:37.225333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:37.225333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:37.225333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:37.225333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 03:30:37.225333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:30:37.234506 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 212/422] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jul 21 03:30:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 532 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:37.237761 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85798a5-4231-496c-ae2e-71a8241b7503 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:37.350678 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388aafee-6f2f-47b4-9312-ea99802ecf79 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:37.393668 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:37.435324 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85798a5-4231-496c-ae2e-71a8241b7503 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:37.438757 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc192fd-ba27-42ce-9a37-e6bdb96182bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:37.439650 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc192fd-ba27-42ce-9a37-e6bdb96182bd None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:37.440154 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc192fd-ba27-42ce-9a37-e6bdb96182bd None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:37.440661 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc192fd-ba27-42ce-9a37-e6bdb96182bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:37.555574 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc192fd-ba27-42ce-9a37-e6bdb96182bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:37.557353 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc192fd-ba27-42ce-9a37-e6bdb96182bd None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:37.575221 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc0394-fc3e-462c-b67c-63c1596f4daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:37.575923 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc0394-fc3e-462c-b67c-63c1596f4daa None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:37.576291 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc0394-fc3e-462c-b67c-63c1596f4daa None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:37.576479 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbc0394-fc3e-462c-b67c-63c1596f4daa None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:37.577289 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc0394-fc3e-462c-b67c-63c1596f4daa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:37.577596 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc0394-fc3e-462c-b67c-63c1596f4daa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:37.580223 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbc0394-fc3e-462c-b67c-63c1596f4daa None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:37.580963 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:37.612436 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 213/423] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:30:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:30:37.621969 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc0394-fc3e-462c-b67c-63c1596f4daa None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:37.689961 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 211/424] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:30:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 03:30:37.707588 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc192fd-ba27-42ce-9a37-e6bdb96182bd None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:37.891030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc192fd-ba27-42ce-9a37-e6bdb96182bd None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:37.909370 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:37.931241 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1725fb-37c7-41d6-aea6-82ab5342140c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:37.932395 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1725fb-37c7-41d6-aea6-82ab5342140c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:37.932657 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1725fb-37c7-41d6-aea6-82ab5342140c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:37.932933 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1725fb-37c7-41d6-aea6-82ab5342140c None admin] PATH_INFO: `/v3/projects/e7eff2725d90448aaf1b1dc5e791bd90` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:37.934155 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1725fb-37c7-41d6-aea6-82ab5342140c None admin] RBAC: Authorizing `identity:get_project(project_id=e7eff2725d90448aaf1b1dc5e791bd90)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:37.935846 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1725fb-37c7-41d6-aea6-82ab5342140c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:37.942481 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 212/425] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:30:37 2022] GET /identity/v3/projects/e7eff2725d90448aaf1b1dc5e791bd90 => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:37.951810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1725fb-37c7-41d6-aea6-82ab5342140c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:37.990506 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbc0394-fc3e-462c-b67c-63c1596f4daa None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:38.032683 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2690a37-dac8-427f-902c-4835da35450e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:38.033353 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2690a37-dac8-427f-902c-4835da35450e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:38.033641 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2690a37-dac8-427f-902c-4835da35450e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:38.034161 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2690a37-dac8-427f-902c-4835da35450e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:38.049123 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:38.188337 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1725fb-37c7-41d6-aea6-82ab5342140c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:38.189256 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2690a37-dac8-427f-902c-4835da35450e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:38.191529 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2690a37-dac8-427f-902c-4835da35450e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:38.261459 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b10cd-63fd-499c-b47b-6c231ef687e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:38.262339 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b10cd-63fd-499c-b47b-6c231ef687e5 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:38.262651 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b10cd-63fd-499c-b47b-6c231ef687e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:38.262929 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b10cd-63fd-499c-b47b-6c231ef687e5 None admin] PATH_INFO: `/v3/groups/06910a0fcb0d4deabe947999059f5f6d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:38.267314 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b10cd-63fd-499c-b47b-6c231ef687e5 None admin] RBAC: Authorizing `identity:get_group(group_id=06910a0fcb0d4deabe947999059f5f6d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:38.268759 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b10cd-63fd-499c-b47b-6c231ef687e5 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:38.275189 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 213/426] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jul 21 03:30:37 2022] GET /identity/v3/groups/06910a0fcb0d4deabe947999059f5f6d => generated 226 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:38.280963 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b10cd-63fd-499c-b47b-6c231ef687e5 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:38.405051 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 214/427] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:30:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 784 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 03:30:38.410880 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2690a37-dac8-427f-902c-4835da35450e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:38.414909 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:38.476694 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:38.533344 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b10cd-63fd-499c-b47b-6c231ef687e5 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:38.581077 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2690a37-dac8-427f-902c-4835da35450e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:38.582868 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0943de89-fdcb-4196-817d-4b8533eefcfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:38.583904 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943de89-fdcb-4196-817d-4b8533eefcfa None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:38.584382 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943de89-fdcb-4196-817d-4b8533eefcfa None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:38.584860 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0943de89-fdcb-4196-817d-4b8533eefcfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:38.585929 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0943de89-fdcb-4196-817d-4b8533eefcfa None admin] RBAC: Adding query filter params (group.id=06910a0fcb0d4deabe947999059f5f6d, role.id=1ac721157e9b40f18cbbc76f5a6b0d3d, scope.project.id=e7eff2725d90448aaf1b1dc5e791bd90) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:38.586703 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0943de89-fdcb-4196-817d-4b8533eefcfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:38.588349 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0943de89-fdcb-4196-817d-4b8533eefcfa None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:38.596918 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 214/428] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Jul 21 03:30:38 2022] GET /identity/v3/role_assignments?group.id=06910a0fcb0d4deabe947999059f5f6d&scope.project.id=e7eff2725d90448aaf1b1dc5e791bd90&role.id=1ac721157e9b40f18cbbc76f5a6b0d3d => generated 611 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:38.598631 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d404d6-681b-4305-9385-fad217ccf7b7 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:38.599126 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d404d6-681b-4305-9385-fad217ccf7b7 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:38.599596 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d404d6-681b-4305-9385-fad217ccf7b7 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:38.605424 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 215/429] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:38.611600 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5aacc-bdc9-4414-9f1c-0557528675ea None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:38.612230 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5aacc-bdc9-4414-9f1c-0557528675ea None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:38.612701 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5aacc-bdc9-4414-9f1c-0557528675ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:38.655726 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-7af5aacc-bdc9-4414-9f1c-0557528675ea None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:38.657665 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7af5aacc-bdc9-4414-9f1c-0557528675ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:38.670231 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f0083-5357-4efb-8098-4dbd66f86d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:38.671515 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f0083-5357-4efb-8098-4dbd66f86d0d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:38.671994 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f0083-5357-4efb-8098-4dbd66f86d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:38.672466 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f0083-5357-4efb-8098-4dbd66f86d0d None admin] PATH_INFO: `/v3/projects/e7eff2725d90448aaf1b1dc5e791bd90` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:38.674189 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f0083-5357-4efb-8098-4dbd66f86d0d None admin] RBAC: Authorizing `identity:get_project(project_id=e7eff2725d90448aaf1b1dc5e791bd90)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:38.675948 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f0083-5357-4efb-8098-4dbd66f86d0d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:38.678286 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 215/430] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:30:38 2022] GET /identity/v3/projects/e7eff2725d90448aaf1b1dc5e791bd90 => generated 298 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:38.684345 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f0083-5357-4efb-8098-4dbd66f86d0d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:38.793059 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 216/431] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 03:30:38.795476 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488d38c-8e1f-456a-87e7-3a104f5c3620 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:38.796019 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488d38c-8e1f-456a-87e7-3a104f5c3620 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:38.796522 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488d38c-8e1f-456a-87e7-3a104f5c3620 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:38.808232 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 217/432] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:38.820633 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ed7ad-31ab-4048-a02b-c181c53f0953 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:38.820931 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ed7ad-31ab-4048-a02b-c181c53f0953 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:38.821196 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ed7ad-31ab-4048-a02b-c181c53f0953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:38.854377 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-8b9ed7ad-31ab-4048-a02b-c181c53f0953 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:38.855627 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8b9ed7ad-31ab-4048-a02b-c181c53f0953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:38.909643 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f0083-5357-4efb-8098-4dbd66f86d0d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:38.922593 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:38.927303 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:38.969305 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa3acb-a984-45e2-9ea1-7d64845c4b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:38.971637 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa3acb-a984-45e2-9ea1-7d64845c4b0f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:38.973200 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa3acb-a984-45e2-9ea1-7d64845c4b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:38.973613 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa3acb-a984-45e2-9ea1-7d64845c4b0f None admin] PATH_INFO: `/v3/groups/06910a0fcb0d4deabe947999059f5f6d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:38.976823 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa3acb-a984-45e2-9ea1-7d64845c4b0f None admin] RBAC: Authorizing `identity:get_group(group_id=06910a0fcb0d4deabe947999059f5f6d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:38.978279 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 218/433] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:30:38.980044 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa3acb-a984-45e2-9ea1-7d64845c4b0f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:38.980305 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ed7ad-31ab-4048-a02b-c181c53f0953 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:38.982376 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 216/434] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jul 21 03:30:38 2022] GET /identity/v3/groups/06910a0fcb0d4deabe947999059f5f6d => generated 226 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:30:38.988567 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa3acb-a984-45e2-9ea1-7d64845c4b0f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:39.132486 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa3acb-a984-45e2-9ea1-7d64845c4b0f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:39.138776 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ed7ad-31ab-4048-a02b-c181c53f0953 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:39.186401 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003dafd-cd6c-47fc-8605-45a013c64027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:39.187375 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003dafd-cd6c-47fc-8605-45a013c64027 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:39.188774 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003dafd-cd6c-47fc-8605-45a013c64027 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:39.189263 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003dafd-cd6c-47fc-8605-45a013c64027 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:39.190978 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003dafd-cd6c-47fc-8605-45a013c64027 None admin] RBAC: Adding query filter params (group.id=06910a0fcb0d4deabe947999059f5f6d, role.id=76578c4e1dbb4559b293fb93830ed5b2, scope.project.id=e7eff2725d90448aaf1b1dc5e791bd90) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:39.191473 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003dafd-cd6c-47fc-8605-45a013c64027 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:39.193061 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003dafd-cd6c-47fc-8605-45a013c64027 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:39.193880 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc8347-427b-4855-a251-3b7a0149982c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:39.194768 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc8347-427b-4855-a251-3b7a0149982c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:39.195182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc8347-427b-4855-a251-3b7a0149982c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:39.195467 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc8347-427b-4855-a251-3b7a0149982c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:39.201123 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 217/435] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Jul 21 03:30:38 2022] GET /identity/v3/role_assignments?group.id=06910a0fcb0d4deabe947999059f5f6d&scope.project.id=e7eff2725d90448aaf1b1dc5e791bd90&role.id=76578c4e1dbb4559b293fb93830ed5b2 => generated 611 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:39.201936 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003dafd-cd6c-47fc-8605-45a013c64027 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:39.214381 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafc8347-427b-4855-a251-3b7a0149982c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:39.227030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-cafc8347-427b-4855-a251-3b7a0149982c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 03:30:39.227030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:39.227030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:39.227030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:39.227030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:39.227030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:39.227030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:39.227030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:39.227030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:39.227030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:39.227030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:39.227030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:39.227030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:39.227030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:39.227030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:39.227030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:39.228013 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:39.228013 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:39.228013 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:39.228013 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:39.228013 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:39.228013 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:39.228013 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:39.228013 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:39.228013 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:39.228013 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:39.228013 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:39.228013 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:39.228013 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:39.228013 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:39.228013 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:39.228013 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:39.228823 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:39.228823 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:39.228823 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:39.228823 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:39.228823 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:39.228823 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:39.228823 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:39.228823 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:39.228823 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:39.228823 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:39.228823 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 03:30:39.228823 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:39.228823 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 219/436] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:30:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:39.228823 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89dde11-6fdb-4c47-9d2b-797b477b2008 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:39.229532 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89dde11-6fdb-4c47-9d2b-797b477b2008 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:39.229532 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89dde11-6fdb-4c47-9d2b-797b477b2008 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:39.229532 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 220/437] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:39.231017 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89dde11-6fdb-4c47-9d2b-797b477b2008 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:39.253874 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:39.276785 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:39.339328 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003dafd-cd6c-47fc-8605-45a013c64027 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:39.363655 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89dde11-6fdb-4c47-9d2b-797b477b2008 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:39.388577 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ef0a3-02d9-4607-ad29-6d0f1c873bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:39.390815 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ef0a3-02d9-4607-ad29-6d0f1c873bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:39.391110 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ef0a3-02d9-4607-ad29-6d0f1c873bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:39.391400 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ef0a3-02d9-4607-ad29-6d0f1c873bd4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:39.416033 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0ef0a3-02d9-4607-ad29-6d0f1c873bd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:39.416212 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0538d-37e3-4e3f-8dd7-9cd94b70545a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:39.417033 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0538d-37e3-4e3f-8dd7-9cd94b70545a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:39.417642 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0538d-37e3-4e3f-8dd7-9cd94b70545a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:39.417642 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0538d-37e3-4e3f-8dd7-9cd94b70545a None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:39.418690 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d0538d-37e3-4e3f-8dd7-9cd94b70545a None admin] RBAC: Adding query filter params (name=member) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:39.418690 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d0538d-37e3-4e3f-8dd7-9cd94b70545a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:39.420035 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d0538d-37e3-4e3f-8dd7-9cd94b70545a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:39.428032 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-ef0ef0a3-02d9-4607-ad29-6d0f1c873bd4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:30:39.428032 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:39.428032 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:39.428032 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:39.428032 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:39.428032 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:39.428032 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:39.428032 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:39.428032 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:39.428032 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:39.428032 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:39.428032 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:39.428032 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:39.428032 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:39.428032 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:39.428032 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:39.429073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:39.429073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:39.429073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:39.429073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:39.429073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:39.429073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:39.429073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:39.429073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:39.429073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:39.429073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:39.429073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:39.429073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:39.429073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:39.429073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:39.429073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:39.429073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:39.430128 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:39.430128 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:39.430128 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:39.430128 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:39.430128 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:39.430128 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:39.430128 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:39.430128 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:39.430128 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:39.430128 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:39.430128 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:30:39.430128 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:30:39.432548 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 218/438] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 03:30:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:39.435049 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc398fda-d12f-46a3-81b9-5a95a0b6156f None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:39.435512 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc398fda-d12f-46a3-81b9-5a95a0b6156f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:39.435800 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc398fda-d12f-46a3-81b9-5a95a0b6156f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:39.437534 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 221/439] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 03:30:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:39.438441 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0538d-37e3-4e3f-8dd7-9cd94b70545a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:39.459399 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-fc398fda-d12f-46a3-81b9-5a95a0b6156f None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:39.461171 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fc398fda-d12f-46a3-81b9-5a95a0b6156f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:39.572912 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 219/440] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:30:39.574303 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:39.575551 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc398fda-d12f-46a3-81b9-5a95a0b6156f None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:39.578773 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0538d-37e3-4e3f-8dd7-9cd94b70545a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:39.608175 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:39.629211 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb47b37-fc37-40e9-9311-d75eadbc717f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:39.630045 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb47b37-fc37-40e9-9311-d75eadbc717f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:39.630175 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb47b37-fc37-40e9-9311-d75eadbc717f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:39.630437 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb47b37-fc37-40e9-9311-d75eadbc717f None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:39.631291 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb47b37-fc37-40e9-9311-d75eadbc717f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:39.631571 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb47b37-fc37-40e9-9311-d75eadbc717f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:39.633494 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb47b37-fc37-40e9-9311-d75eadbc717f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:39.642689 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 222/441] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:30:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:39.643478 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb47b37-fc37-40e9-9311-d75eadbc717f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:39.695945 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc398fda-d12f-46a3-81b9-5a95a0b6156f None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:39.733403 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153a68d-953e-41e6-b51a-20ad7064eb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:39.734065 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153a68d-953e-41e6-b51a-20ad7064eb24 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:39.734357 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153a68d-953e-41e6-b51a-20ad7064eb24 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:39.734671 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153a68d-953e-41e6-b51a-20ad7064eb24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:39.767458 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb47b37-fc37-40e9-9311-d75eadbc717f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:39.808608 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f153a68d-953e-41e6-b51a-20ad7064eb24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:39.809910 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21be778-a939-4b21-a4fc-dd500a198b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:39.810179 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f153a68d-953e-41e6-b51a-20ad7064eb24 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:39.810671 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21be778-a939-4b21-a4fc-dd500a198b5e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:39.810963 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21be778-a939-4b21-a4fc-dd500a198b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:39.811250 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21be778-a939-4b21-a4fc-dd500a198b5e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:39.824475 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21be778-a939-4b21-a4fc-dd500a198b5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:39.832553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-a21be778-a939-4b21-a4fc-dd500a198b5e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 03:30:39.832553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:39.832553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:39.832553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:39.832553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:39.832553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:39.832553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:39.832553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:39.832553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:39.832553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:39.832553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:39.832553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:39.832553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:39.832553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:39.832553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:39.832553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:39.833450 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:39.833450 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:39.833450 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:39.833450 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:39.833450 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:39.833450 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:39.833450 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:39.833450 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:39.833450 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:39.833450 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:39.833450 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:39.833450 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:39.833450 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:39.833450 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:39.833450 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:39.833450 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:39.834252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:39.834252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:39.834252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:39.834252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:39.834252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:39.834252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:39.834252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:39.834252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:39.834252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:39.834252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:39.834252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 03:30:39.834252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:39.834252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 223/442] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jul 21 03:30:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:39.834943 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21be778-a939-4b21-a4fc-dd500a198b5e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:39.842561 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:39.864061 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:39.920442 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 220/443] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:30:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 03:30:39.921394 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153a68d-953e-41e6-b51a-20ad7064eb24 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:39.955293 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21be778-a939-4b21-a4fc-dd500a198b5e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:39.992264 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626cc122-fa9c-4fbc-8a31-70f6da945476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:39.992954 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626cc122-fa9c-4fbc-8a31-70f6da945476 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:39.993346 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626cc122-fa9c-4fbc-8a31-70f6da945476 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:39.993634 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626cc122-fa9c-4fbc-8a31-70f6da945476 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:40.035077 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153a68d-953e-41e6-b51a-20ad7064eb24 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:40.065360 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:40.073725 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b7068-44ff-4241-a971-922c29549c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:40.074553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626cc122-fa9c-4fbc-8a31-70f6da945476 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:40.074683 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b7068-44ff-4241-a971-922c29549c1c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:40.074947 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b7068-44ff-4241-a971-922c29549c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:40.075231 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061b7068-44ff-4241-a971-922c29549c1c None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:40.076025 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b7068-44ff-4241-a971-922c29549c1c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:40.076166 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626cc122-fa9c-4fbc-8a31-70f6da945476 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:40.076335 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b7068-44ff-4241-a971-922c29549c1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:40.077721 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061b7068-44ff-4241-a971-922c29549c1c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:40.086773 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 221/444] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:30:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:40.087501 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b7068-44ff-4241-a971-922c29549c1c None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:40.106504 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:40.196914 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 224/445] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:30:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 03:30:40.197682 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626cc122-fa9c-4fbc-8a31-70f6da945476 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:40.199275 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061b7068-44ff-4241-a971-922c29549c1c None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:40.238150 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8b31e-46b9-4fa4-9d95-2791633a3ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:40.239093 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8b31e-46b9-4fa4-9d95-2791633a3ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:40.239377 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8b31e-46b9-4fa4-9d95-2791633a3ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:40.239650 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8b31e-46b9-4fa4-9d95-2791633a3ad6 None admin] PATH_INFO: `/v3/projects/4243c37e3bcb48b0a62103a25160eb80` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:40.240837 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8b31e-46b9-4fa4-9d95-2791633a3ad6 None admin] RBAC: Authorizing `identity:get_project(project_id=4243c37e3bcb48b0a62103a25160eb80)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:40.242338 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8b31e-46b9-4fa4-9d95-2791633a3ad6 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:40.244073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 222/446] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:30:40 2022] GET /identity/v3/projects/4243c37e3bcb48b0a62103a25160eb80 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:40.244832 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8b31e-46b9-4fa4-9d95-2791633a3ad6 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:40.306069 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:40.311246 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626cc122-fa9c-4fbc-8a31-70f6da945476 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:40.335008 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:40.350356 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8b31e-46b9-4fa4-9d95-2791633a3ad6 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:40.351434 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9515c3bb-ffbc-4b86-bd57-a8cb9a32308a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:40.352088 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515c3bb-ffbc-4b86-bd57-a8cb9a32308a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:40.352374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515c3bb-ffbc-4b86-bd57-a8cb9a32308a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:40.352646 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515c3bb-ffbc-4b86-bd57-a8cb9a32308a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:40.386554 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328d1d2-4a4c-4950-ab41-80b843c4cb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:40.387405 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328d1d2-4a4c-4950-ab41-80b843c4cb24 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:40.387699 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328d1d2-4a4c-4950-ab41-80b843c4cb24 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:40.387979 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2328d1d2-4a4c-4950-ab41-80b843c4cb24 None admin] PATH_INFO: `/v3/projects/c64654fdd0e44100a98ee66278a10b0e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:40.389329 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2328d1d2-4a4c-4950-ab41-80b843c4cb24 None admin] RBAC: Authorizing `identity:get_project(project_id=c64654fdd0e44100a98ee66278a10b0e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:40.392117 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2328d1d2-4a4c-4950-ab41-80b843c4cb24 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:40.394205 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 223/447] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:30:40 2022] GET /identity/v3/projects/c64654fdd0e44100a98ee66278a10b0e => generated 344 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:40.394818 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328d1d2-4a4c-4950-ab41-80b843c4cb24 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:40.437597 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9515c3bb-ffbc-4b86-bd57-a8cb9a32308a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:40.439103 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9515c3bb-ffbc-4b86-bd57-a8cb9a32308a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:40.516342 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2328d1d2-4a4c-4950-ab41-80b843c4cb24 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:40.543121 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:40.553080 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318d9e4-bc5b-4537-b462-b88887e2dc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:40.554073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318d9e4-bc5b-4537-b462-b88887e2dc0c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:40.554434 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318d9e4-bc5b-4537-b462-b88887e2dc0c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:40.554795 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318d9e4-bc5b-4537-b462-b88887e2dc0c None admin] PATH_INFO: `/v3/groups/06910a0fcb0d4deabe947999059f5f6d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:40.555994 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9318d9e4-bc5b-4537-b462-b88887e2dc0c None admin] RBAC: Authorizing `identity:get_group(group_id=06910a0fcb0d4deabe947999059f5f6d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:40.557563 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9318d9e4-bc5b-4537-b462-b88887e2dc0c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:40.558009 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 225/448] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:30:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 03:30:40.558762 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9515c3bb-ffbc-4b86-bd57-a8cb9a32308a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:40.564837 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 224/449] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jul 21 03:30:40 2022] GET /identity/v3/groups/06910a0fcb0d4deabe947999059f5f6d => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:40.564837 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318d9e4-bc5b-4537-b462-b88887e2dc0c None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:40.587125 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:40.670367 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9515c3bb-ffbc-4b86-bd57-a8cb9a32308a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:40.689946 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318d9e4-bc5b-4537-b462-b88887e2dc0c None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:40.706580 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad64a9-3099-4059-bc57-d03a2ea795e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:40.707460 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad64a9-3099-4059-bc57-d03a2ea795e0 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:40.707775 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad64a9-3099-4059-bc57-d03a2ea795e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:40.708087 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad64a9-3099-4059-bc57-d03a2ea795e0 None admin] PATH_INFO: `/v3/groups/c0afcedd4440465abcd4deae17867f99` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:40.711251 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad64a9-3099-4059-bc57-d03a2ea795e0 None admin] RBAC: Authorizing `identity:get_group(group_id=c0afcedd4440465abcd4deae17867f99)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:40.712987 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad64a9-3099-4059-bc57-d03a2ea795e0 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:40.714729 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 226/450] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jul 21 03:30:40 2022] GET /identity/v3/groups/c0afcedd4440465abcd4deae17867f99 => generated 229 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:40.715300 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad64a9-3099-4059-bc57-d03a2ea795e0 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:40.735665 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df26ef-dc4e-430f-8c81-3bc1ca8918d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:40.736616 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df26ef-dc4e-430f-8c81-3bc1ca8918d9 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:40.736977 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df26ef-dc4e-430f-8c81-3bc1ca8918d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:40.737405 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df26ef-dc4e-430f-8c81-3bc1ca8918d9 None admin] PATH_INFO: `/v3/projects/4243c37e3bcb48b0a62103a25160eb80` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:40.738621 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49df26ef-dc4e-430f-8c81-3bc1ca8918d9 None admin] RBAC: Authorizing `identity:get_project(project_id=4243c37e3bcb48b0a62103a25160eb80)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:40.740080 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49df26ef-dc4e-430f-8c81-3bc1ca8918d9 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:40.742598 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 225/451] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:30:40 2022] GET /identity/v3/projects/4243c37e3bcb48b0a62103a25160eb80 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:30:40.743241 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df26ef-dc4e-430f-8c81-3bc1ca8918d9 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:40.810775 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:40.811110 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:40.828284 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad64a9-3099-4059-bc57-d03a2ea795e0 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:40.854805 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df26ef-dc4e-430f-8c81-3bc1ca8918d9 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:40.866371 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716bef3a-2678-4a9e-811b-792b4e765af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:40.867650 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716bef3a-2678-4a9e-811b-792b4e765af0 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:40.867936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716bef3a-2678-4a9e-811b-792b4e765af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:40.868214 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716bef3a-2678-4a9e-811b-792b4e765af0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:40.869052 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716bef3a-2678-4a9e-811b-792b4e765af0 None admin] RBAC: Adding query filter params (group.id=06910a0fcb0d4deabe947999059f5f6d, role.id=1ac721157e9b40f18cbbc76f5a6b0d3d, scope.project.id=4243c37e3bcb48b0a62103a25160eb80) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:40.869386 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716bef3a-2678-4a9e-811b-792b4e765af0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:40.870825 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716bef3a-2678-4a9e-811b-792b4e765af0 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:40.876996 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 227/452] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Jul 21 03:30:40 2022] GET /identity/v3/role_assignments?group.id=06910a0fcb0d4deabe947999059f5f6d&scope.project.id=4243c37e3bcb48b0a62103a25160eb80&role.id=1ac721157e9b40f18cbbc76f5a6b0d3d => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:40.883704 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716bef3a-2678-4a9e-811b-792b4e765af0 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:40.893385 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee9e14-5006-4cf9-bcd7-23069ce12bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:40.894327 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee9e14-5006-4cf9-bcd7-23069ce12bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:40.894842 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee9e14-5006-4cf9-bcd7-23069ce12bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:40.895269 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ee9e14-5006-4cf9-bcd7-23069ce12bf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:40.896437 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee9e14-5006-4cf9-bcd7-23069ce12bf9 None admin] RBAC: Adding query filter params (group.id=c0afcedd4440465abcd4deae17867f99, role.id=27e53d6c56f24c25a8c8057bfd36bcf1, scope.project.id=c64654fdd0e44100a98ee66278a10b0e) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:40.896920 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee9e14-5006-4cf9-bcd7-23069ce12bf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:40.899035 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ee9e14-5006-4cf9-bcd7-23069ce12bf9 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:40.907998 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 226/453] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Jul 21 03:30:40 2022] GET /identity/v3/role_assignments?group.id=c0afcedd4440465abcd4deae17867f99&scope.project.id=c64654fdd0e44100a98ee66278a10b0e&role.id=27e53d6c56f24c25a8c8057bfd36bcf1 => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:41.013822 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716bef3a-2678-4a9e-811b-792b4e765af0 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:41.062108 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff39114-6c78-4612-94a7-ab24d4ae68f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:41.062703 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff39114-6c78-4612-94a7-ab24d4ae68f0 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:41.062828 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff39114-6c78-4612-94a7-ab24d4ae68f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:41.063069 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff39114-6c78-4612-94a7-ab24d4ae68f0 None admin] PATH_INFO: `/v3/groups/06910a0fcb0d4deabe947999059f5f6d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:41.064320 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff39114-6c78-4612-94a7-ab24d4ae68f0 None admin] RBAC: Authorizing `identity:get_group(group_id=06910a0fcb0d4deabe947999059f5f6d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:41.065782 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff39114-6c78-4612-94a7-ab24d4ae68f0 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:41.072335 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 228/454] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jul 21 03:30:40 2022] GET /identity/v3/groups/06910a0fcb0d4deabe947999059f5f6d => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:41.074633 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee9e14-5006-4cf9-bcd7-23069ce12bf9 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:41.203718 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ee9e14-5006-4cf9-bcd7-23069ce12bf9 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:41.231665 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:41.242617 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1afee0-a9da-4bb9-91c3-7db6b5807d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:41.243492 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1afee0-a9da-4bb9-91c3-7db6b5807d19 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:41.244057 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1afee0-a9da-4bb9-91c3-7db6b5807d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:41.244245 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1afee0-a9da-4bb9-91c3-7db6b5807d19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:41.245072 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1afee0-a9da-4bb9-91c3-7db6b5807d19 None admin] RBAC: Adding query filter params (group.id=06910a0fcb0d4deabe947999059f5f6d, role.id=76578c4e1dbb4559b293fb93830ed5b2, scope.project.id=4243c37e3bcb48b0a62103a25160eb80) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:41.245393 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1afee0-a9da-4bb9-91c3-7db6b5807d19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:41.246937 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1afee0-a9da-4bb9-91c3-7db6b5807d19 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:41.253588 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 227/455] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Jul 21 03:30:41 2022] GET /identity/v3/role_assignments?group.id=06910a0fcb0d4deabe947999059f5f6d&scope.project.id=4243c37e3bcb48b0a62103a25160eb80&role.id=76578c4e1dbb4559b293fb93830ed5b2 => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:44.209441 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0c8fd-f886-4237-9599-00826eb3a8ea None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:44.209982 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0c8fd-f886-4237-9599-00826eb3a8ea None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:44.209982 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0c8fd-f886-4237-9599-00826eb3a8ea None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:44.211652 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 229/456] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:44.224112 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486db69-2336-4c19-8118-caf961c87ea1 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:44.224629 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486db69-2336-4c19-8118-caf961c87ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:44.224706 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486db69-2336-4c19-8118-caf961c87ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:44.247956 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d486db69-2336-4c19-8118-caf961c87ea1 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:44.249197 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d486db69-2336-4c19-8118-caf961c87ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:44.280389 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5fd6f1-e59a-4cc0-8f06-39a57789a06d None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:44.281009 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5fd6f1-e59a-4cc0-8f06-39a57789a06d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:44.281489 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5fd6f1-e59a-4cc0-8f06-39a57789a06d None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:44.283328 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 230/457] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:44.289258 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42017d-3cc0-44fd-ae7d-817b72a05f02 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:44.289791 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42017d-3cc0-44fd-ae7d-817b72a05f02 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:44.290265 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42017d-3cc0-44fd-ae7d-817b72a05f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:44.320194 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-7d42017d-3cc0-44fd-ae7d-817b72a05f02 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:44.321405 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7d42017d-3cc0-44fd-ae7d-817b72a05f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:44.348298 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:44.363288 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 228/458] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:30:44.387292 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486db69-2336-4c19-8118-caf961c87ea1 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:44.422703 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 231/459] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 03:30:44.424418 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a63e79-1ffd-48bd-a65f-b4cabbd2cc35 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:44.424882 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a63e79-1ffd-48bd-a65f-b4cabbd2cc35 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:44.425354 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a63e79-1ffd-48bd-a65f-b4cabbd2cc35 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:44.427012 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 232/460] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:44.432495 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e06355-894d-4076-82e6-8a943816ffc8 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:44.432931 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e06355-894d-4076-82e6-8a943816ffc8 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:44.433354 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e06355-894d-4076-82e6-8a943816ffc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:44.453737 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-81e06355-894d-4076-82e6-8a943816ffc8 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:44.455125 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-81e06355-894d-4076-82e6-8a943816ffc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:44.531319 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486db69-2336-4c19-8118-caf961c87ea1 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:44.553982 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 233/461] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 03:30:44.554984 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e06355-894d-4076-82e6-8a943816ffc8 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:44.567630 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:44.607889 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e547a7f-2860-4b52-a116-ed3d1ec4866d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:44.609207 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e547a7f-2860-4b52-a116-ed3d1ec4866d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:44.609633 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e547a7f-2860-4b52-a116-ed3d1ec4866d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:44.610033 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e547a7f-2860-4b52-a116-ed3d1ec4866d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:44.633275 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e547a7f-2860-4b52-a116-ed3d1ec4866d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:44.635777 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e547a7f-2860-4b52-a116-ed3d1ec4866d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:44.670238 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-9e547a7f-2860-4b52-a116-ed3d1ec4866d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:30:44.670238 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:44.670238 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:44.670238 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:44.670238 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:44.670238 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:44.670238 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:44.670238 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:44.670238 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:44.670238 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:44.670238 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:44.670238 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:44.670238 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:30:44.670238 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:30:44.670238 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:30:44.671372 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:30:44.671372 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:44.671372 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:44.671372 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:44.671372 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:44.671372 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:44.671372 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:44.671372 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:44.671372 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:44.671372 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:44.671372 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:44.671372 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:44.671372 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:44.671372 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:44.671372 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:44.671372 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:44.671372 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:44.672348 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:30:44.672348 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:30:44.672348 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:30:44.672348 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:30:44.676718 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 229/462] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:30:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:30:44.680037 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e547a7f-2860-4b52-a116-ed3d1ec4866d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:44.717446 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:44.755096 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e06355-894d-4076-82e6-8a943816ffc8 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:44.808345 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf25b4-d1ab-4df6-967f-7b7d808425ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:44.809162 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf25b4-d1ab-4df6-967f-7b7d808425ad None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:44.809527 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf25b4-d1ab-4df6-967f-7b7d808425ad None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:44.809901 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf25b4-d1ab-4df6-967f-7b7d808425ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:44.831628 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf25b4-d1ab-4df6-967f-7b7d808425ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:44.833383 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccf25b4-d1ab-4df6-967f-7b7d808425ad None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:44.862006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-bccf25b4-d1ab-4df6-967f-7b7d808425ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:30:44.862006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:44.862006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:44.862006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:44.862006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:44.862006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:44.862006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:44.862006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:44.862006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:44.862006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:44.862006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:44.862006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:44.862006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:30:44.862006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:30:44.862006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:30:44.862929 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:30:44.862929 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:44.862929 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:44.862929 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:44.862929 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:44.862929 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:44.862929 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:44.862929 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:44.862929 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:44.862929 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:44.862929 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:44.862929 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:44.862929 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:44.862929 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:44.862929 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:44.862929 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:44.862929 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:44.863748 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:30:44.863748 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:30:44.863748 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:30:44.863748 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:44.872935 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 234/463] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:30:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:44.874040 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf25b4-d1ab-4df6-967f-7b7d808425ad None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:44.883229 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e547a7f-2860-4b52-a116-ed3d1ec4866d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:44.934494 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95631804-b3f7-4a79-9f22-a876647c9d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:44.935417 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95631804-b3f7-4a79-9f22-a876647c9d29 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:44.935772 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95631804-b3f7-4a79-9f22-a876647c9d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:44.936126 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95631804-b3f7-4a79-9f22-a876647c9d29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:44.950357 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95631804-b3f7-4a79-9f22-a876647c9d29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:44.952460 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95631804-b3f7-4a79-9f22-a876647c9d29 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:44.976198 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-95631804-b3f7-4a79-9f22-a876647c9d29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:30:44.976198 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:44.976198 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:44.976198 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:44.976198 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:44.976198 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:44.976198 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:44.976198 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:44.976198 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:44.976198 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:44.976198 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:44.976198 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:44.976198 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:30:44.976198 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:30:44.976198 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:30:44.977090 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:30:44.977090 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:44.977090 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:44.977090 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:44.977090 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:44.977090 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:44.977090 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:44.977090 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:44.977090 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:44.977090 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:44.977090 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:44.977090 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:44.977090 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:44.977090 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:44.977090 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:44.977090 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:44.977090 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:44.977926 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:30:44.977926 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:30:44.977926 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:30:44.977926 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:30:44.977926 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 230/464] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:30:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:44.978960 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95631804-b3f7-4a79-9f22-a876647c9d29 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:45.002575 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf25b4-d1ab-4df6-967f-7b7d808425ad None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:45.010339 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:45.037415 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:45.045996 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a969c55c-4c7f-466a-bc9a-3a002018af1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:45.047128 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969c55c-4c7f-466a-bc9a-3a002018af1d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:45.047421 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969c55c-4c7f-466a-bc9a-3a002018af1d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:45.047702 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969c55c-4c7f-466a-bc9a-3a002018af1d None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:45.048727 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a969c55c-4c7f-466a-bc9a-3a002018af1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:45.049049 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a969c55c-4c7f-466a-bc9a-3a002018af1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:45.050622 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a969c55c-4c7f-466a-bc9a-3a002018af1d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:45.070609 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 235/465] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:30:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:45.071742 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a969c55c-4c7f-466a-bc9a-3a002018af1d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:45.097881 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95631804-b3f7-4a79-9f22-a876647c9d29 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:45.134287 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ccf90-2204-408c-8ec1-9334e4a34160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:45.135396 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ccf90-2204-408c-8ec1-9334e4a34160 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:45.135923 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ccf90-2204-408c-8ec1-9334e4a34160 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:45.136411 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ccf90-2204-408c-8ec1-9334e4a34160 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:45.137335 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3ccf90-2204-408c-8ec1-9334e4a34160 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:45.137846 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3ccf90-2204-408c-8ec1-9334e4a34160 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:45.139715 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3ccf90-2204-408c-8ec1-9334e4a34160 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:45.152539 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 231/466] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:30:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:45.153670 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ccf90-2204-408c-8ec1-9334e4a34160 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:45.201970 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a969c55c-4c7f-466a-bc9a-3a002018af1d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:45.236022 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59206fda-a268-4ed4-b2ba-aae888b242d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:45.236771 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59206fda-a268-4ed4-b2ba-aae888b242d7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:45.236975 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59206fda-a268-4ed4-b2ba-aae888b242d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:45.237259 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59206fda-a268-4ed4-b2ba-aae888b242d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:45.238318 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59206fda-a268-4ed4-b2ba-aae888b242d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:45.238669 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59206fda-a268-4ed4-b2ba-aae888b242d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:45.240043 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59206fda-a268-4ed4-b2ba-aae888b242d7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:45.247873 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:45.258889 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 236/467] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:30:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:45.258889 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59206fda-a268-4ed4-b2ba-aae888b242d7 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:45.269632 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ccf90-2204-408c-8ec1-9334e4a34160 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:45.306160 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae33c58-6ea6-4aef-bf26-c2870154b06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:45.307344 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae33c58-6ea6-4aef-bf26-c2870154b06f None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:45.307810 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae33c58-6ea6-4aef-bf26-c2870154b06f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:45.308086 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae33c58-6ea6-4aef-bf26-c2870154b06f None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:45.308793 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae33c58-6ea6-4aef-bf26-c2870154b06f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:45.310238 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae33c58-6ea6-4aef-bf26-c2870154b06f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:45.316980 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:45.332789 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 232/468] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jul 21 03:30:45 2022] POST /identity/v3/users => generated 248 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:30:45.333998 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b28b99-55d0-4f9c-9208-3bdc2ef1cac2 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:45.334293 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b28b99-55d0-4f9c-9208-3bdc2ef1cac2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:45.334610 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b28b99-55d0-4f9c-9208-3bdc2ef1cac2 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:45.340342 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 233/469] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:45.340342 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b28b99-55d0-4f9c-9208-3bdc2ef1cac2 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:45.392602 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59206fda-a268-4ed4-b2ba-aae888b242d7 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:45.438036 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be51cf-2c6a-42aa-bc47-129a3bfce6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:45.439292 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be51cf-2c6a-42aa-bc47-129a3bfce6a2 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:45.439789 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be51cf-2c6a-42aa-bc47-129a3bfce6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:45.440288 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be51cf-2c6a-42aa-bc47-129a3bfce6a2 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:45.441457 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be51cf-2c6a-42aa-bc47-129a3bfce6a2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:45.443417 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be51cf-2c6a-42aa-bc47-129a3bfce6a2 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:45.468528 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 237/470] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jul 21 03:30:45 2022] POST /identity/v3/users => generated 246 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:30:45.470649 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e986cc9-9953-4fa4-b6ac-184470ca9741 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:45.471300 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e986cc9-9953-4fa4-b6ac-184470ca9741 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:45.471818 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e986cc9-9953-4fa4-b6ac-184470ca9741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:45.494716 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-8e986cc9-9953-4fa4-b6ac-184470ca9741 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:45.496409 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8e986cc9-9953-4fa4-b6ac-184470ca9741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:45.502487 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b28b99-55d0-4f9c-9208-3bdc2ef1cac2 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:45.551254 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d090e06d-fdda-4e42-8f2c-876a27f02931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:45.551952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090e06d-fdda-4e42-8f2c-876a27f02931 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:45.552279 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090e06d-fdda-4e42-8f2c-876a27f02931 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:45.552571 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d090e06d-fdda-4e42-8f2c-876a27f02931 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:45.553366 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d090e06d-fdda-4e42-8f2c-876a27f02931 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:45.555956 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d090e06d-fdda-4e42-8f2c-876a27f02931 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:45.568964 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:45.583368 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 238/471] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:30:45.584901 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 234/472] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jul 21 03:30:45 2022] POST /identity/v3/users => generated 248 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:30:45.627229 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e986cc9-9953-4fa4-b6ac-184470ca9741 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:45.679920 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:45.759648 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e986cc9-9953-4fa4-b6ac-184470ca9741 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:45.798420 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188dd998-6d79-481e-b42b-a84f1f1e2b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:45.799243 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188dd998-6d79-481e-b42b-a84f1f1e2b0f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:45.799525 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188dd998-6d79-481e-b42b-a84f1f1e2b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:45.799797 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188dd998-6d79-481e-b42b-a84f1f1e2b0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:45.810742 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188dd998-6d79-481e-b42b-a84f1f1e2b0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:45.812206 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188dd998-6d79-481e-b42b-a84f1f1e2b0f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:45.830327 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-188dd998-6d79-481e-b42b-a84f1f1e2b0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:30:45.830327 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:45.830327 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:45.830327 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:45.830327 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:45.830327 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:45.830327 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:45.830327 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:45.830327 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:45.830327 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:45.830327 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:45.830327 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:45.830327 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:30:45.830327 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:30:45.830327 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:30:45.831252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:30:45.831252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:45.831252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:45.831252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:45.831252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:45.831252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:45.831252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:45.831252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:45.831252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:45.831252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:45.831252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:45.831252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:45.831252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:45.831252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:45.831252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:45.831252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:45.831252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:45.832226 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:30:45.832226 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:30:45.832226 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:30:45.832226 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:45.832226 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 239/473] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:30:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:45.839112 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d090e06d-fdda-4e42-8f2c-876a27f02931 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:45.885925 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098c514-cc7a-43f6-bce9-174a089be3e7 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:45.886441 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098c514-cc7a-43f6-bce9-174a089be3e7 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:45.886915 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098c514-cc7a-43f6-bce9-174a089be3e7 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:45.888807 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 240/474] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 03:30:45.894046 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5e336-cb5a-4749-80b7-f448ec64e65b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:45.894624 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5e336-cb5a-4749-80b7-f448ec64e65b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:45.895043 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e5e336-cb5a-4749-80b7-f448ec64e65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:45.916905 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e2e5e336-cb5a-4749-80b7-f448ec64e65b None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:45.918352 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e2e5e336-cb5a-4749-80b7-f448ec64e65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:45.966718 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d090e06d-fdda-4e42-8f2c-876a27f02931 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:46.023339 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f13ff5-27ca-4faf-ba7a-fd74be1c274a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:46.024017 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f13ff5-27ca-4faf-ba7a-fd74be1c274a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:46.024426 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f13ff5-27ca-4faf-ba7a-fd74be1c274a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:46.024710 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f13ff5-27ca-4faf-ba7a-fd74be1c274a None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:46.025456 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f13ff5-27ca-4faf-ba7a-fd74be1c274a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:46.025769 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f13ff5-27ca-4faf-ba7a-fd74be1c274a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:46.027199 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f13ff5-27ca-4faf-ba7a-fd74be1c274a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:46.041270 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 235/475] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:30:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:30:46.047496 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f13ff5-27ca-4faf-ba7a-fd74be1c274a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:46.054821 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 241/476] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 03:30:46.090269 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5e336-cb5a-4749-80b7-f448ec64e65b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:46.123106 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:46.131399 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:46.175374 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f13ff5-27ca-4faf-ba7a-fd74be1c274a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:46.223370 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc62e55-0f18-4ef9-8816-02f15e082430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:46.224051 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc62e55-0f18-4ef9-8816-02f15e082430 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:46.224339 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc62e55-0f18-4ef9-8816-02f15e082430 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:46.224617 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc62e55-0f18-4ef9-8816-02f15e082430 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:46.225339 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc62e55-0f18-4ef9-8816-02f15e082430 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:46.226855 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc62e55-0f18-4ef9-8816-02f15e082430 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:46.268242 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 236/477] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jul 21 03:30:46 2022] POST /identity/v3/users => generated 249 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:30:46.306720 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e5e336-cb5a-4749-80b7-f448ec64e65b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:46.359490 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03423ba2-d7d3-4cc0-a5ee-23903d8cf67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:46.360610 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03423ba2-d7d3-4cc0-a5ee-23903d8cf67e None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:46.361092 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03423ba2-d7d3-4cc0-a5ee-23903d8cf67e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:46.361562 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03423ba2-d7d3-4cc0-a5ee-23903d8cf67e None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:46.362564 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03423ba2-d7d3-4cc0-a5ee-23903d8cf67e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:46.364195 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03423ba2-d7d3-4cc0-a5ee-23903d8cf67e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:46.384092 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.sql.core [None req-03423ba2-d7d3-4cc0-a5ee-23903d8cf67e None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 21 03:30:46.384092 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 21 03:30:46.384092 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [parameters: {'id': '3ebb0e9e9a9641039f6bb8f551501c2a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 21 03:30:46.384092 dv-cinder-850318-2-smb devstack@keystone.service[80332]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80332) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 21 03:30:46.402920 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-03423ba2-d7d3-4cc0-a5ee-23903d8cf67e None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 21 03:30:46.402920 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:46.402920 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 03:30:46.402920 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 03:30:46.402920 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 03:30:46.402920 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 03:30:46.402920 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 03:30:46.402920 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 03:30:46.402920 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 03:30:46.402920 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application conn.query(q) Jul 21 03:30:46.402920 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 03:30:46.402920 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 03:30:46.402920 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 03:30:46.402920 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application result.read() Jul 21 03:30:46.402920 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 03:30:46.403879 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 03:30:46.403879 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 03:30:46.403879 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 03:30:46.403879 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 03:30:46.403879 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 03:30:46.403879 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 03:30:46.403879 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 03:30:46.403879 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 21 03:30:46.403879 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:46.403879 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 21 03:30:46.403879 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:46.403879 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:46.403879 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 21 03:30:46.403879 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 21 03:30:46.403879 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 21 03:30:46.403879 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return ref.to_dict() Jul 21 03:30:46.403879 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 03:30:46.403879 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application next(self.gen) Jul 21 03:30:46.404775 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 21 03:30:46.404775 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application yield resource Jul 21 03:30:46.404775 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 03:30:46.404775 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application next(self.gen) Jul 21 03:30:46.404775 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 21 03:30:46.404775 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self.session.rollback() Jul 21 03:30:46.404775 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 21 03:30:46.404775 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self.force_reraise() Jul 21 03:30:46.404775 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 21 03:30:46.404775 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise self.value Jul 21 03:30:46.404775 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 21 03:30:46.404775 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 21 03:30:46.404775 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 21 03:30:46.404775 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application session.commit() Jul 21 03:30:46.404775 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 21 03:30:46.404775 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 21 03:30:46.404775 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 21 03:30:46.405615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._prepare_impl() Jul 21 03:30:46.405615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 21 03:30:46.405615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self.session.flush() Jul 21 03:30:46.405615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 21 03:30:46.405615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._flush(objects) Jul 21 03:30:46.405615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 21 03:30:46.405615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 21 03:30:46.405615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 21 03:30:46.405615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application compat.raise_( Jul 21 03:30:46.405615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 03:30:46.405615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception Jul 21 03:30:46.405615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 21 03:30:46.405615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application flush_context.execute() Jul 21 03:30:46.405615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 21 03:30:46.405615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rec.execute(self) Jul 21 03:30:46.405615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 21 03:30:46.405615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 21 03:30:46.407282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 21 03:30:46.407282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 21 03:30:46.407282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 21 03:30:46.407282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 21 03:30:46.407282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 21 03:30:46.407282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 21 03:30:46.407282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 21 03:30:46.407282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 21 03:30:46.407282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 21 03:30:46.407282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 21 03:30:46.407282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 21 03:30:46.407282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 21 03:30:46.407282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 21 03:30:46.407282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 21 03:30:46.407282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 03:30:46.407282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception Jul 21 03:30:46.408101 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 03:30:46.408101 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 03:30:46.408101 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 03:30:46.408101 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 03:30:46.408101 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 03:30:46.408101 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 03:30:46.408101 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 03:30:46.408101 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application conn.query(q) Jul 21 03:30:46.408101 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 03:30:46.408101 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 03:30:46.408101 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 03:30:46.408101 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application result.read() Jul 21 03:30:46.408101 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 03:30:46.408101 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 03:30:46.408101 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 03:30:46.408101 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 03:30:46.408876 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 03:30:46.408876 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 03:30:46.408876 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 03:30:46.408876 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 03:30:46.408876 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 21 03:30:46.408876 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 21 03:30:46.408876 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [parameters: {'id': '3ebb0e9e9a9641039f6bb8f551501c2a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 21 03:30:46.408876 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 21 03:30:46.408876 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:46.408876 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 03:30:46.408876 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:46.408876 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:46.408876 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:46.408876 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:46.408876 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:46.408876 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:46.409732 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:46.409732 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:46.409732 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:46.409732 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:46.409732 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:46.409732 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:46.409732 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 21 03:30:46.409732 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 21 03:30:46.409732 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:46.409732 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:46.409732 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 21 03:30:46.409732 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 21 03:30:46.409732 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 21 03:30:46.409732 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 21 03:30:46.409732 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 21 03:30:46.409732 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:46.413089 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 242/478] 10.222.0.20 () {60 vars in 1131 bytes} [Thu Jul 21 03:30:46 2022] POST /identity/v3/roles => generated 144 bytes in 323 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:30:46.419736 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc62e55-0f18-4ef9-8816-02f15e082430 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:46.558857 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc62e55-0f18-4ef9-8816-02f15e082430 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:46.577199 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:46.605699 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14621729-4eeb-4ac9-9614-e30b43895054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:46.606551 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14621729-4eeb-4ac9-9614-e30b43895054 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:46.606846 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14621729-4eeb-4ac9-9614-e30b43895054 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:46.607127 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14621729-4eeb-4ac9-9614-e30b43895054 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:46.618199 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14621729-4eeb-4ac9-9614-e30b43895054 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:46.626409 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-14621729-4eeb-4ac9-9614-e30b43895054 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 03:30:46.626409 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:46.626409 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:46.626409 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:46.626409 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:46.626409 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:46.626409 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:46.626409 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:46.626409 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:46.626409 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:46.626409 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:46.626409 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:46.626409 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:46.626409 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:46.626409 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:46.626409 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:46.628456 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:46.628456 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:46.628456 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:46.628456 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:46.628456 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:46.628456 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:46.628456 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:46.628456 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:46.628456 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:46.628456 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:46.628456 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:46.628456 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:46.628456 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:46.628456 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:46.628456 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:46.628456 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:46.630347 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:46.630347 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:46.630347 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:46.630347 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:46.630347 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:46.630347 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:46.630347 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:46.630347 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:46.630347 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:46.630347 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:46.630347 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 03:30:46.630347 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:30:46.630347 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 237/479] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jul 21 03:30:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:46.638496 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03423ba2-d7d3-4cc0-a5ee-23903d8cf67e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:46.727536 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:46.744555 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03423ba2-d7d3-4cc0-a5ee-23903d8cf67e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:46.780998 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f62f5cc-874c-4db5-99b8-0742365aa1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:46.781677 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62f5cc-874c-4db5-99b8-0742365aa1cf None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:46.782067 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62f5cc-874c-4db5-99b8-0742365aa1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:46.782351 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f62f5cc-874c-4db5-99b8-0742365aa1cf None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:46.783136 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f62f5cc-874c-4db5-99b8-0742365aa1cf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:46.783446 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f62f5cc-874c-4db5-99b8-0742365aa1cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:46.784817 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f62f5cc-874c-4db5-99b8-0742365aa1cf None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:46.793910 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 243/480] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:30:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:30:47.813348 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99838d-e53f-4498-92c6-f6d651a43d62 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:47.813866 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99838d-e53f-4498-92c6-f6d651a43d62 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:47.814153 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99838d-e53f-4498-92c6-f6d651a43d62 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:47.815902 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 238/481] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:47.821561 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180ace2-887b-4618-a1a7-b40ba5d91855 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:47.821955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180ace2-887b-4618-a1a7-b40ba5d91855 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:47.822298 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180ace2-887b-4618-a1a7-b40ba5d91855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:47.839553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f180ace2-887b-4618-a1a7-b40ba5d91855 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:47.840726 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f180ace2-887b-4618-a1a7-b40ba5d91855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:47.935118 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 244/482] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:30:47.970639 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99838d-e53f-4498-92c6-f6d651a43d62 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:48.080488 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbad55-c543-4797-9867-d22be2fe4aa2 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:48.080829 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbad55-c543-4797-9867-d22be2fe4aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:48.081050 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dbad55-c543-4797-9867-d22be2fe4aa2 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:48.082684 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 245/483] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 03:30:48.088764 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1b2b1-3284-4bc5-9263-14927a2c6976 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:48.089061 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1b2b1-3284-4bc5-9263-14927a2c6976 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:48.089348 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a1b2b1-3284-4bc5-9263-14927a2c6976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:48.107991 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-82a1b2b1-3284-4bc5-9263-14927a2c6976 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:48.109566 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-82a1b2b1-3284-4bc5-9263-14927a2c6976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:48.117751 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99838d-e53f-4498-92c6-f6d651a43d62 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:48.184586 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090fba5f-556e-4fe9-929b-d436590d5344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:48.185756 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fba5f-556e-4fe9-929b-d436590d5344 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:48.186240 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fba5f-556e-4fe9-929b-d436590d5344 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:48.186771 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fba5f-556e-4fe9-929b-d436590d5344 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:48.205607 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090fba5f-556e-4fe9-929b-d436590d5344 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:48.217735 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-090fba5f-556e-4fe9-929b-d436590d5344 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 03:30:48.217735 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:48.217735 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:48.217735 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:48.217735 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:48.217735 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:48.217735 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:48.217735 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:48.217735 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:48.217735 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:48.217735 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:48.217735 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:48.217735 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:48.217735 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:48.217735 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:48.217735 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:48.218681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:48.218681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:48.218681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:48.218681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:48.218681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:48.218681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:48.218681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:48.218681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:48.218681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:48.218681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:48.218681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:48.218681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:48.218681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:48.218681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:48.218681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:48.218681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:48.219481 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:48.219481 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:48.219481 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:48.219481 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:48.219481 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:48.219481 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:48.219481 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:48.219481 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:48.219481 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:48.219481 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:48.219481 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 03:30:48.219481 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:30:48.226695 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 239/484] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jul 21 03:30:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:48.230206 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090fba5f-556e-4fe9-929b-d436590d5344 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:48.235659 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 246/485] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 03:30:48.263350 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4165e-2fc9-4b87-8ff8-69c8e9a32d3f None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:48.263947 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4165e-2fc9-4b87-8ff8-69c8e9a32d3f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:48.264424 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4165e-2fc9-4b87-8ff8-69c8e9a32d3f None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:48.266207 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 247/486] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:48.273161 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae4165e-2fc9-4b87-8ff8-69c8e9a32d3f None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:48.275608 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:48.284576 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:48.341038 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090fba5f-556e-4fe9-929b-d436590d5344 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:48.378645 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5884716-1220-4ce4-aec1-9a64f8b0e45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:48.379318 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5884716-1220-4ce4-aec1-9a64f8b0e45f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:48.379661 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5884716-1220-4ce4-aec1-9a64f8b0e45f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:48.379947 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5884716-1220-4ce4-aec1-9a64f8b0e45f None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:48.380697 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5884716-1220-4ce4-aec1-9a64f8b0e45f None admin] RBAC: Adding query filter params (name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:48.381007 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5884716-1220-4ce4-aec1-9a64f8b0e45f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:48.382996 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5884716-1220-4ce4-aec1-9a64f8b0e45f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:48.391665 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 240/487] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jul 21 03:30:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:48.392985 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dcc648-3029-4dd6-855b-1c44040cfe62 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:48.393281 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dcc648-3029-4dd6-855b-1c44040cfe62 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:48.393565 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dcc648-3029-4dd6-855b-1c44040cfe62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:48.398011 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae4165e-2fc9-4b87-8ff8-69c8e9a32d3f None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:48.410371 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-78dcc648-3029-4dd6-855b-1c44040cfe62 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:48.411623 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-78dcc648-3029-4dd6-855b-1c44040cfe62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:48.440454 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd26f4f-8fcd-422f-b6d6-24ee8cb4fc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:48.441871 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd26f4f-8fcd-422f-b6d6-24ee8cb4fc31 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:48.442699 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd26f4f-8fcd-422f-b6d6-24ee8cb4fc31 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:48.443416 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd26f4f-8fcd-422f-b6d6-24ee8cb4fc31 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:48.457560 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd26f4f-8fcd-422f-b6d6-24ee8cb4fc31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:48.467269 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-bbd26f4f-8fcd-422f-b6d6-24ee8cb4fc31 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 03:30:48.467269 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:48.467269 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:48.467269 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:48.467269 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:48.467269 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:48.467269 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:48.467269 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:48.467269 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:48.467269 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:48.467269 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:48.467269 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:48.467269 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:48.467269 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:48.467269 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:48.467269 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:48.468136 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:48.468136 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:48.468136 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:48.468136 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:48.468136 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:48.468136 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:48.468136 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:48.468136 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:48.468136 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:48.468136 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:48.468136 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:48.468136 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:48.468136 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:48.468136 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:48.468136 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:48.468136 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:48.468929 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:48.468929 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:48.468929 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:48.468929 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:48.468929 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:48.468929 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:48.468929 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:48.468929 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:48.468929 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:48.468929 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:48.468929 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 03:30:48.468929 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:48.474614 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 248/488] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jul 21 03:30:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:48.474614 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd26f4f-8fcd-422f-b6d6-24ee8cb4fc31 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:48.509330 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 241/489] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:30:48.509330 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dcc648-3029-4dd6-855b-1c44040cfe62 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:48.544663 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:48.579670 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:48.629782 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd26f4f-8fcd-422f-b6d6-24ee8cb4fc31 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:48.635729 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dcc648-3029-4dd6-855b-1c44040cfe62 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:48.667502 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243472e-948e-46b7-b5ac-fea3926eb4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:48.668454 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243472e-948e-46b7-b5ac-fea3926eb4aa None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:48.668853 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243472e-948e-46b7-b5ac-fea3926eb4aa None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:48.669203 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243472e-948e-46b7-b5ac-fea3926eb4aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:48.681437 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243472e-948e-46b7-b5ac-fea3926eb4aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:48.682451 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a3d9f-b4dd-4688-8752-0532f599097d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:48.683152 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a3d9f-b4dd-4688-8752-0532f599097d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:48.683263 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243472e-948e-46b7-b5ac-fea3926eb4aa None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:48.683435 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a3d9f-b4dd-4688-8752-0532f599097d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:48.683717 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a3d9f-b4dd-4688-8752-0532f599097d None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:48.684461 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a3d9f-b4dd-4688-8752-0532f599097d None admin] RBAC: Adding query filter params (name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:48.684767 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a3d9f-b4dd-4688-8752-0532f599097d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:48.686891 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a3d9f-b4dd-4688-8752-0532f599097d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:48.706374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-9243472e-948e-46b7-b5ac-fea3926eb4aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:30:48.706374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:48.706374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:48.706374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:48.706374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:48.706374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:48.706374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:48.706374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:48.706374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:48.706374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:48.706374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:48.706374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:48.706374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:30:48.706374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:30:48.706374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:30:48.707538 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:30:48.707538 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:48.707538 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:48.707538 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:48.707538 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:48.707538 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:48.707538 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:48.707538 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:48.707538 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:48.707538 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:48.707538 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:48.707538 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:48.707538 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:48.707538 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:48.707538 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:48.707538 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:48.707538 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:48.709184 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:30:48.709184 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:30:48.709184 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:30:48.709184 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:48.709687 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 242/490] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jul 21 03:30:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:48.709687 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a3d9f-b4dd-4688-8752-0532f599097d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:48.709947 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 249/491] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:30:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:48.710118 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243472e-948e-46b7-b5ac-fea3926eb4aa None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:48.806617 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:48.826109 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a3d9f-b4dd-4688-8752-0532f599097d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:48.842324 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243472e-948e-46b7-b5ac-fea3926eb4aa None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:48.862026 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:48.872294 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db96cc-c1e8-4c1a-8a88-06a28503d00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:48.873359 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db96cc-c1e8-4c1a-8a88-06a28503d00e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:48.873644 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db96cc-c1e8-4c1a-8a88-06a28503d00e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:48.873922 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db96cc-c1e8-4c1a-8a88-06a28503d00e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:48.883736 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b62e7-4630-4de1-ab04-2dd0195d9bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:48.884872 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b62e7-4630-4de1-ab04-2dd0195d9bdf None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:48.885396 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b62e7-4630-4de1-ab04-2dd0195d9bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:48.885938 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4b62e7-4630-4de1-ab04-2dd0195d9bdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:48.886969 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db96cc-c1e8-4c1a-8a88-06a28503d00e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:48.896357 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-e1db96cc-c1e8-4c1a-8a88-06a28503d00e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 03:30:48.896357 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:48.896357 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:48.896357 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:48.896357 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:48.896357 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:48.896357 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:48.896357 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:48.896357 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:48.896357 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:48.896357 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:48.896357 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:48.896357 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:48.896357 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:48.896357 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:48.896357 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:48.898031 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:48.898031 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:48.898031 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:48.898031 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:48.898031 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:48.898031 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:48.898031 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:48.898031 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:48.898031 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:48.898031 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:48.898031 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:48.898031 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:48.898031 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:48.898031 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:48.898031 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:48.898031 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:48.898868 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:48.898868 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:48.898868 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:48.898868 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:48.898868 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:48.898868 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:48.898868 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:48.898868 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:48.898868 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:48.898868 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:48.898868 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 03:30:48.898868 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:30:48.902604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 243/492] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jul 21 03:30:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:48.904019 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db96cc-c1e8-4c1a-8a88-06a28503d00e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:48.905103 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b62e7-4630-4de1-ab04-2dd0195d9bdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:48.906624 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4b62e7-4630-4de1-ab04-2dd0195d9bdf None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:48.925932 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-cf4b62e7-4630-4de1-ab04-2dd0195d9bdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:30:48.925932 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:48.925932 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:48.925932 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:48.925932 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:48.925932 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:48.925932 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:48.925932 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:48.925932 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:48.925932 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:48.925932 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:48.925932 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:48.925932 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:30:48.925932 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:30:48.925932 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:30:48.926852 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:30:48.926852 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:48.926852 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:48.926852 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:48.926852 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:48.926852 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:48.926852 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:48.926852 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:48.926852 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:48.926852 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:48.926852 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:48.926852 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:48.926852 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:48.926852 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:48.926852 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:48.926852 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:48.926852 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:48.927674 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:30:48.927674 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:30:48.927674 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:30:48.927674 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:48.930847 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 250/493] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:30:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:48.931588 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b62e7-4630-4de1-ab04-2dd0195d9bdf None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:49.028226 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db96cc-c1e8-4c1a-8a88-06a28503d00e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:49.040942 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4b62e7-4630-4de1-ab04-2dd0195d9bdf None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:49.062971 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db511e67-0104-4c04-a4ef-76bea8b685f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:49.063606 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db511e67-0104-4c04-a4ef-76bea8b685f8 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:49.063905 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db511e67-0104-4c04-a4ef-76bea8b685f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:49.064182 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db511e67-0104-4c04-a4ef-76bea8b685f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:49.064907 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db511e67-0104-4c04-a4ef-76bea8b685f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:49.065212 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db511e67-0104-4c04-a4ef-76bea8b685f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:49.066611 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db511e67-0104-4c04-a4ef-76bea8b685f8 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:49.076922 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5bef50-975d-4be7-81a3-f05941cf5f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:49.077620 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5bef50-975d-4be7-81a3-f05941cf5f74 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:49.077913 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5bef50-975d-4be7-81a3-f05941cf5f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:49.082678 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5bef50-975d-4be7-81a3-f05941cf5f74 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:49.082810 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 244/494] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:49.082901 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5bef50-975d-4be7-81a3-f05941cf5f74 None admin] RBAC: Adding query filter params (name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:49.082982 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db511e67-0104-4c04-a4ef-76bea8b685f8 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:49.083063 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5bef50-975d-4be7-81a3-f05941cf5f74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:49.083063 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5bef50-975d-4be7-81a3-f05941cf5f74 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:49.089878 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:49.094624 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 251/495] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jul 21 03:30:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:49.096020 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee178bc7-23c0-440c-9cb6-b591e7652e13 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:49.096318 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee178bc7-23c0-440c-9cb6-b591e7652e13 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:49.096645 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee178bc7-23c0-440c-9cb6-b591e7652e13 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:49.101386 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 252/496] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:49.102165 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee178bc7-23c0-440c-9cb6-b591e7652e13 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:49.137815 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:49.193435 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db511e67-0104-4c04-a4ef-76bea8b685f8 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:49.215326 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee178bc7-23c0-440c-9cb6-b591e7652e13 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:49.229510 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe0beb-c9ef-4547-afff-c77dae352fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:49.230182 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe0beb-c9ef-4547-afff-c77dae352fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:49.230478 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe0beb-c9ef-4547-afff-c77dae352fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:49.230780 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebe0beb-c9ef-4547-afff-c77dae352fb6 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:49.231515 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe0beb-c9ef-4547-afff-c77dae352fb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:49.231829 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe0beb-c9ef-4547-afff-c77dae352fb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:49.233240 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebe0beb-c9ef-4547-afff-c77dae352fb6 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:49.244348 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 245/497] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:30:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:49.245142 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe0beb-c9ef-4547-afff-c77dae352fb6 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:49.256119 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12108cad-d84b-4c6a-abe7-e5db4874dbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:49.257755 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12108cad-d84b-4c6a-abe7-e5db4874dbf0 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:49.258210 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12108cad-d84b-4c6a-abe7-e5db4874dbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:49.258692 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12108cad-d84b-4c6a-abe7-e5db4874dbf0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:49.266953 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12108cad-d84b-4c6a-abe7-e5db4874dbf0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:49.268678 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12108cad-d84b-4c6a-abe7-e5db4874dbf0 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:49.286065 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-12108cad-d84b-4c6a-abe7-e5db4874dbf0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 21 03:30:49.286065 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:49.286065 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:49.286065 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:49.286065 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:49.286065 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:49.286065 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:49.286065 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:49.286065 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:49.286065 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:49.286065 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:49.286065 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:49.286065 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 03:30:49.286065 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 03:30:49.286065 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 03:30:49.286065 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 03:30:49.287110 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:49.287110 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:49.287110 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 03:30:49.287110 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:30:49.287110 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 03:30:49.287110 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:30:49.287110 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:49.287110 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:49.287110 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:49.287110 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:49.287110 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:49.287110 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:49.287110 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:49.287110 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:49.287110 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:49.287110 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:49.287110 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:49.287110 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:49.292937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:49.292937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:49.292937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 03:30:49.292937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 03:30:49.292937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 03:30:49.292937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 03:30:49.292937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 03:30:49.292937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 03:30:49.292937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 21 03:30:49.292937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:49.292937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 253/498] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:30:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:49.292937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563cc74-be29-4661-ab1b-ab9f5e763354 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:49.292937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563cc74-be29-4661-ab1b-ab9f5e763354 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:49.293637 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563cc74-be29-4661-ab1b-ab9f5e763354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:49.306556 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-2563cc74-be29-4661-ab1b-ab9f5e763354 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:49.307735 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2563cc74-be29-4661-ab1b-ab9f5e763354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:49.317042 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:49.361969 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebe0beb-c9ef-4547-afff-c77dae352fb6 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:49.375845 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 254/499] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:30:49.376483 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2563cc74-be29-4661-ab1b-ab9f5e763354 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:49.403774 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06aecd-10a1-4343-94e0-99beacde6a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:49.404563 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06aecd-10a1-4343-94e0-99beacde6a75 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:49.404848 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06aecd-10a1-4343-94e0-99beacde6a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:49.405245 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06aecd-10a1-4343-94e0-99beacde6a75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:49.412792 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:49.417136 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba06aecd-10a1-4343-94e0-99beacde6a75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:49.418705 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba06aecd-10a1-4343-94e0-99beacde6a75 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:49.437857 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-ba06aecd-10a1-4343-94e0-99beacde6a75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:30:49.437857 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:49.437857 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:49.437857 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:49.437857 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:49.437857 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:49.437857 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:49.437857 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:49.437857 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:49.437857 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:49.437857 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:49.437857 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:49.437857 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:30:49.437857 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:30:49.437857 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:30:49.438827 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:30:49.438827 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:49.438827 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:49.438827 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:49.438827 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:49.438827 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:49.438827 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:49.438827 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:49.438827 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:49.438827 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:49.438827 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:49.438827 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:49.438827 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:49.438827 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:49.438827 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:49.438827 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:49.438827 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:49.439644 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:30:49.439644 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:30:49.439644 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:30:49.439644 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:30:49.439644 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 246/500] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:30:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:49.439909 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06aecd-10a1-4343-94e0-99beacde6a75 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:49.504347 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2563cc74-be29-4661-ab1b-ab9f5e763354 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:49.541409 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386bfa1-ec8f-4380-bbf5-bcc99fc788be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:49.542219 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386bfa1-ec8f-4380-bbf5-bcc99fc788be None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:49.542539 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386bfa1-ec8f-4380-bbf5-bcc99fc788be None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:49.542821 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386bfa1-ec8f-4380-bbf5-bcc99fc788be None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:49.549846 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386bfa1-ec8f-4380-bbf5-bcc99fc788be None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:49.551320 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5386bfa1-ec8f-4380-bbf5-bcc99fc788be None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:49.552226 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06aecd-10a1-4343-94e0-99beacde6a75 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:49.565480 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-5386bfa1-ec8f-4380-bbf5-bcc99fc788be None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 03:30:49.565480 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:49.565480 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:49.565480 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:49.565480 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:49.565480 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:49.565480 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:49.565480 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:49.565480 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:49.565480 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:49.565480 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:49.565480 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:49.565480 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 03:30:49.565480 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 03:30:49.565480 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 03:30:49.565480 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 03:30:49.566354 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:49.566354 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:49.566354 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 03:30:49.566354 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:30:49.566354 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 03:30:49.566354 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:30:49.566354 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:49.566354 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:49.566354 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:49.566354 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:49.566354 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:49.566354 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:49.566354 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:49.566354 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:49.566354 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:49.566354 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:49.566354 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:49.566354 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:49.567323 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:49.567323 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:49.567323 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 03:30:49.567323 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 03:30:49.567323 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 03:30:49.567323 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 03:30:49.567323 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 03:30:49.567323 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 03:30:49.567323 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 03:30:49.567323 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:49.567323 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 255/501] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:30:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:49.568085 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386bfa1-ec8f-4380-bbf5-bcc99fc788be None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:49.572901 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:49.590419 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09384096-3cc4-4967-a0c9-8f2f1733584f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:49.591109 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09384096-3cc4-4967-a0c9-8f2f1733584f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:49.591403 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09384096-3cc4-4967-a0c9-8f2f1733584f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:49.591676 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09384096-3cc4-4967-a0c9-8f2f1733584f None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:49.592516 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09384096-3cc4-4967-a0c9-8f2f1733584f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:49.592824 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09384096-3cc4-4967-a0c9-8f2f1733584f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:49.594294 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09384096-3cc4-4967-a0c9-8f2f1733584f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:49.629876 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 247/502] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Jul 21 03:30:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:49.630706 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09384096-3cc4-4967-a0c9-8f2f1733584f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:49.647622 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:49.665572 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5386bfa1-ec8f-4380-bbf5-bcc99fc788be None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:49.699028 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf244c98-a417-49e1-9791-5a08b7185a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:49.699827 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf244c98-a417-49e1-9791-5a08b7185a18 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:49.700105 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf244c98-a417-49e1-9791-5a08b7185a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:49.700375 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf244c98-a417-49e1-9791-5a08b7185a18 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:49.710393 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf244c98-a417-49e1-9791-5a08b7185a18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:49.718026 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-cf244c98-a417-49e1-9791-5a08b7185a18 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 03:30:49.718026 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:49.718026 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:49.718026 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:49.718026 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:49.718026 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:49.718026 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:49.718026 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:49.718026 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:49.718026 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:49.718026 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:49.718026 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:49.718026 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:49.718026 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:49.718026 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:49.718026 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:49.718945 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:49.718945 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:49.718945 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:49.718945 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:49.718945 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:49.718945 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:49.718945 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:49.718945 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:49.718945 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:49.718945 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:49.718945 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:49.718945 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:49.718945 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:49.718945 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:49.718945 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:49.718945 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:49.719741 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:49.719741 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:49.719741 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:49.719741 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:49.719741 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:49.719741 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:49.719741 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:49.719741 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:49.719741 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:49.719741 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:49.719741 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 03:30:49.719741 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:49.719741 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 256/503] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jul 21 03:30:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:49.720619 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf6313-5d08-4953-8d91-a98792958bba None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:49.720684 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf6313-5d08-4953-8d91-a98792958bba None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:49.720960 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf6313-5d08-4953-8d91-a98792958bba None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:49.722196 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 257/504] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:49.722897 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf6313-5d08-4953-8d91-a98792958bba None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:49.737066 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09384096-3cc4-4967-a0c9-8f2f1733584f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:49.771469 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3eef8-4432-4eb2-ae93-e4e500b10572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:49.772397 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3eef8-4432-4eb2-ae93-e4e500b10572 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:49.772716 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3eef8-4432-4eb2-ae93-e4e500b10572 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:49.772995 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3eef8-4432-4eb2-ae93-e4e500b10572 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:49.773723 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae3eef8-4432-4eb2-ae93-e4e500b10572 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:49.774041 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae3eef8-4432-4eb2-ae93-e4e500b10572 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:49.775481 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae3eef8-4432-4eb2-ae93-e4e500b10572 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:49.786558 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 248/505] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:30:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:49.787421 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3eef8-4432-4eb2-ae93-e4e500b10572 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:49.822970 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:49.826957 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf6313-5d08-4953-8d91-a98792958bba None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:49.859100 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1ed78-5e44-4158-b516-c5d690913419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:49.859765 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1ed78-5e44-4158-b516-c5d690913419 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:49.860051 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1ed78-5e44-4158-b516-c5d690913419 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:49.860327 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe1ed78-5e44-4158-b516-c5d690913419 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:49.861156 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe1ed78-5e44-4158-b516-c5d690913419 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:49.861473 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe1ed78-5e44-4158-b516-c5d690913419 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:49.862918 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe1ed78-5e44-4158-b516-c5d690913419 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:49.885925 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3eef8-4432-4eb2-ae93-e4e500b10572 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:49.895873 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:49.900054 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 258/506] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Jul 21 03:30:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:49.901239 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1ed78-5e44-4158-b516-c5d690913419 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:49.919895 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed257d44-bf97-47ff-a409-364d76338933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:49.920543 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed257d44-bf97-47ff-a409-364d76338933 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:49.920831 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed257d44-bf97-47ff-a409-364d76338933 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:49.921108 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed257d44-bf97-47ff-a409-364d76338933 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:49.987770 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed257d44-bf97-47ff-a409-364d76338933 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:49.989237 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed257d44-bf97-47ff-a409-364d76338933 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:49.998934 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe1ed78-5e44-4158-b516-c5d690913419 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:50.022992 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:50.032057 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e38040-ba02-4aa4-b57b-488837caf484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:50.032720 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e38040-ba02-4aa4-b57b-488837caf484 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:50.033003 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e38040-ba02-4aa4-b57b-488837caf484 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:50.033279 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e38040-ba02-4aa4-b57b-488837caf484 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:50.034018 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e38040-ba02-4aa4-b57b-488837caf484 None admin] RBAC: Adding query filter params (name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:50.034323 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e38040-ba02-4aa4-b57b-488837caf484 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:50.035715 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e38040-ba02-4aa4-b57b-488837caf484 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:50.044620 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 259/507] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jul 21 03:30:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:50.045869 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08e286-304d-48a4-8c28-73a9be46bdb9 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:50.046205 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08e286-304d-48a4-8c28-73a9be46bdb9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:50.046448 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08e286-304d-48a4-8c28-73a9be46bdb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:50.063739 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-7c08e286-304d-48a4-8c28-73a9be46bdb9 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:50.064941 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7c08e286-304d-48a4-8c28-73a9be46bdb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:50.086972 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 249/508] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:30:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 03:30:50.087797 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed257d44-bf97-47ff-a409-364d76338933 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:50.122906 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:50.134173 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 260/509] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:30:50.135008 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c08e286-304d-48a4-8c28-73a9be46bdb9 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:50.189411 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed257d44-bf97-47ff-a409-364d76338933 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:50.222965 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe117b-5d0c-4d59-9ff2-fa3b6581981e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:50.223745 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe117b-5d0c-4d59-9ff2-fa3b6581981e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:50.224024 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe117b-5d0c-4d59-9ff2-fa3b6581981e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:50.224304 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe117b-5d0c-4d59-9ff2-fa3b6581981e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:50.227446 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:50.232418 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffe117b-5d0c-4d59-9ff2-fa3b6581981e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:50.232806 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c08e286-304d-48a4-8c28-73a9be46bdb9 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:50.234224 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffe117b-5d0c-4d59-9ff2-fa3b6581981e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:50.250263 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-2ffe117b-5d0c-4d59-9ff2-fa3b6581981e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 03:30:50.250263 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:50.250263 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:50.250263 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:50.250263 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:50.250263 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:50.250263 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:50.250263 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:50.250263 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:50.250263 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:50.250263 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:50.250263 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:50.250263 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 03:30:50.250263 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 03:30:50.250263 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 03:30:50.250263 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 03:30:50.251226 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:50.251226 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:50.251226 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 03:30:50.251226 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:30:50.251226 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 03:30:50.251226 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:30:50.251226 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:50.251226 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:50.251226 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:50.251226 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:50.251226 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:50.251226 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:50.251226 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:50.251226 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:50.251226 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:50.251226 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:50.251226 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:50.251226 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:50.252106 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:50.252106 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:50.252106 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 03:30:50.252106 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 03:30:50.252106 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 03:30:50.252106 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 03:30:50.252106 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 03:30:50.252106 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 03:30:50.252106 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 03:30:50.252106 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:30:50.252106 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 250/510] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Jul 21 03:30:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:50.252659 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe117b-5d0c-4d59-9ff2-fa3b6581981e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:50.266694 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81287160-4560-492f-8762-a619552b913c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:50.267341 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81287160-4560-492f-8762-a619552b913c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:50.267625 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81287160-4560-492f-8762-a619552b913c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:50.267902 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81287160-4560-492f-8762-a619552b913c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:50.325704 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:50.334899 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81287160-4560-492f-8762-a619552b913c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:50.336832 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81287160-4560-492f-8762-a619552b913c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:50.352308 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe117b-5d0c-4d59-9ff2-fa3b6581981e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:50.384541 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ebcb4e-2c14-453c-986a-1fbe1debfd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:50.385318 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ebcb4e-2c14-453c-986a-1fbe1debfd72 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:50.385606 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ebcb4e-2c14-453c-986a-1fbe1debfd72 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:50.385884 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ebcb4e-2c14-453c-986a-1fbe1debfd72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:50.395861 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ebcb4e-2c14-453c-986a-1fbe1debfd72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:50.398085 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ebcb4e-2c14-453c-986a-1fbe1debfd72 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:50.416433 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-41ebcb4e-2c14-453c-986a-1fbe1debfd72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:30:50.416433 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:50.416433 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:50.416433 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:50.416433 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:50.416433 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:50.416433 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:50.416433 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:50.416433 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:50.416433 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:50.416433 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:50.416433 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:50.416433 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:30:50.416433 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:30:50.416433 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:30:50.417442 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:30:50.417442 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:50.417442 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:50.417442 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:50.417442 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:50.417442 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:50.417442 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:50.417442 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:50.417442 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:50.417442 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:50.417442 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:50.417442 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:50.417442 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:50.417442 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:50.417442 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:50.417442 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:50.417442 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:50.418487 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:30:50.418487 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:30:50.418487 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:30:50.418487 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:30:50.418487 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 251/511] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:30:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:50.418487 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ebcb4e-2c14-453c-986a-1fbe1debfd72 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:50.435595 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 261/512] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:30:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 03:30:50.436279 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81287160-4560-492f-8762-a619552b913c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:50.471343 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:50.521934 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ebcb4e-2c14-453c-986a-1fbe1debfd72 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:50.524661 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:50.533448 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81287160-4560-492f-8762-a619552b913c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:50.556971 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667a641-9aab-404a-8c8a-2a0a5049624c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:50.557758 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667a641-9aab-404a-8c8a-2a0a5049624c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:50.558043 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667a641-9aab-404a-8c8a-2a0a5049624c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:50.558322 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667a641-9aab-404a-8c8a-2a0a5049624c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:50.567511 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564fc743-317b-4602-bd0d-9d2484d4afb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:50.568458 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fc743-317b-4602-bd0d-9d2484d4afb4 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:50.568748 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fc743-317b-4602-bd0d-9d2484d4afb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:50.569027 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fc743-317b-4602-bd0d-9d2484d4afb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:50.569915 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5667a641-9aab-404a-8c8a-2a0a5049624c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:50.571415 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5667a641-9aab-404a-8c8a-2a0a5049624c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:50.579901 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564fc743-317b-4602-bd0d-9d2484d4afb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:50.581323 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564fc743-317b-4602-bd0d-9d2484d4afb4 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:50.588672 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-5667a641-9aab-404a-8c8a-2a0a5049624c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:30:50.588672 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:50.588672 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:50.588672 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:50.588672 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:50.588672 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:50.588672 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:50.588672 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:50.588672 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:50.588672 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:50.588672 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:50.588672 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:50.588672 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:30:50.588672 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:30:50.588672 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:30:50.589653 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:30:50.589653 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:50.589653 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:50.589653 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:50.589653 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:50.589653 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:50.589653 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:50.589653 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:50.589653 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:50.589653 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:50.589653 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:50.589653 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:50.589653 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:50.589653 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:50.589653 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:50.589653 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:50.589653 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:50.590652 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:30:50.590652 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:30:50.590652 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:30:50.590652 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:30:50.590652 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 252/513] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:30:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:50.590971 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667a641-9aab-404a-8c8a-2a0a5049624c None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:50.600459 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-564fc743-317b-4602-bd0d-9d2484d4afb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:30:50.600459 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:50.600459 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:50.600459 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:50.600459 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:50.600459 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:50.600459 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:50.600459 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:50.600459 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:50.600459 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:50.600459 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:50.600459 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:50.600459 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:30:50.600459 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:30:50.600459 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:30:50.601860 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:30:50.601860 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:50.601860 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:50.601860 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:50.601860 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:50.601860 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:50.601860 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:50.601860 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:50.601860 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:50.601860 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:50.601860 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:50.601860 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:50.601860 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:50.601860 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:50.601860 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:50.601860 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:50.601860 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:50.602764 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:30:50.602764 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:30:50.602764 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:30:50.602764 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:50.602764 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 262/514] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:30:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:50.603058 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564fc743-317b-4602-bd0d-9d2484d4afb4 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:50.689363 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:50.692839 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667a641-9aab-404a-8c8a-2a0a5049624c None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:50.700999 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564fc743-317b-4602-bd0d-9d2484d4afb4 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:50.727399 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51bc507-c836-4f8c-b9c7-f1221924c05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:50.728072 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51bc507-c836-4f8c-b9c7-f1221924c05b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:50.728352 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51bc507-c836-4f8c-b9c7-f1221924c05b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:50.728633 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51bc507-c836-4f8c-b9c7-f1221924c05b None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:50.729461 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51bc507-c836-4f8c-b9c7-f1221924c05b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:50.729772 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51bc507-c836-4f8c-b9c7-f1221924c05b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:50.731239 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51bc507-c836-4f8c-b9c7-f1221924c05b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:50.735553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc62d9-4776-4464-828f-265713a0a063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:50.736212 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc62d9-4776-4464-828f-265713a0a063 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:50.736496 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc62d9-4776-4464-828f-265713a0a063 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:50.736772 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc62d9-4776-4464-828f-265713a0a063 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:50.737490 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc62d9-4776-4464-828f-265713a0a063 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:50.737798 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc62d9-4776-4464-828f-265713a0a063 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:50.739185 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc62d9-4776-4464-828f-265713a0a063 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:50.748201 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 253/515] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Jul 21 03:30:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:50.748985 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51bc507-c836-4f8c-b9c7-f1221924c05b None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:50.751976 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 263/516] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:30:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:50.752935 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc62d9-4776-4464-828f-265713a0a063 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:50.758163 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:50.850740 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc62d9-4776-4464-828f-265713a0a063 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:50.851108 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51bc507-c836-4f8c-b9c7-f1221924c05b None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:50.883377 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38bdd9-bdd7-4eb4-a59d-b299e9f73da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:50.883853 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3cdcfb-ea0e-4f18-b93e-a3578fe43fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:50.883974 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38bdd9-bdd7-4eb4-a59d-b299e9f73da5 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:50.884232 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38bdd9-bdd7-4eb4-a59d-b299e9f73da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:50.884483 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cdcfb-ea0e-4f18-b93e-a3578fe43fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:50.884590 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da38bdd9-bdd7-4eb4-a59d-b299e9f73da5 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:50.884769 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cdcfb-ea0e-4f18-b93e-a3578fe43fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:50.885048 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cdcfb-ea0e-4f18-b93e-a3578fe43fa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:50.885202 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da38bdd9-bdd7-4eb4-a59d-b299e9f73da5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:50.885508 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da38bdd9-bdd7-4eb4-a59d-b299e9f73da5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:50.886901 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da38bdd9-bdd7-4eb4-a59d-b299e9f73da5 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:50.895047 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3cdcfb-ea0e-4f18-b93e-a3578fe43fa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:50.896499 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3cdcfb-ea0e-4f18-b93e-a3578fe43fa2 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:50.898526 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 264/517] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:30:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:50.899296 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38bdd9-bdd7-4eb4-a59d-b299e9f73da5 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:50.918832 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-fb3cdcfb-ea0e-4f18-b93e-a3578fe43fa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:30:50.918832 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:50.918832 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:50.918832 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:50.918832 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:50.918832 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:50.918832 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:50.918832 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:50.918832 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:50.918832 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:50.918832 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:50.918832 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:50.918832 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:30:50.918832 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:30:50.918832 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:30:50.919882 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:30:50.919882 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:50.919882 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:50.919882 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:50.919882 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:50.919882 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:50.919882 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:50.919882 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:50.919882 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:50.919882 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:50.919882 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:50.919882 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:50.919882 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:50.919882 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:50.919882 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:50.919882 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:50.919882 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:50.921172 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:30:50.921172 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:30:50.921172 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:30:50.921172 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:30:50.921172 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 254/518] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:30:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:50.921172 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3cdcfb-ea0e-4f18-b93e-a3578fe43fa2 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:50.932113 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:50.963329 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:51.001841 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da38bdd9-bdd7-4eb4-a59d-b299e9f73da5 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:51.021790 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3cdcfb-ea0e-4f18-b93e-a3578fe43fa2 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:51.036002 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38e327-3d00-4872-b0ec-36f590bc71af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:51.036660 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38e327-3d00-4872-b0ec-36f590bc71af None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:51.036946 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38e327-3d00-4872-b0ec-36f590bc71af None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:51.037224 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38e327-3d00-4872-b0ec-36f590bc71af None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:51.037946 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e38e327-3d00-4872-b0ec-36f590bc71af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:51.038305 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e38e327-3d00-4872-b0ec-36f590bc71af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:51.039706 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e38e327-3d00-4872-b0ec-36f590bc71af None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:51.051181 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 265/519] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:30:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:51.051955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38e327-3d00-4872-b0ec-36f590bc71af None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:51.060112 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca4805-452f-4958-ae6a-052b43b9c7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:51.060760 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca4805-452f-4958-ae6a-052b43b9c7fa None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:51.061043 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca4805-452f-4958-ae6a-052b43b9c7fa None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:51.061318 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca4805-452f-4958-ae6a-052b43b9c7fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:51.128769 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca4805-452f-4958-ae6a-052b43b9c7fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:51.130220 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca4805-452f-4958-ae6a-052b43b9c7fa None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:51.141667 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:51.149164 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e38e327-3d00-4872-b0ec-36f590bc71af None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:51.171497 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:51.182468 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd0d2e-ad86-430e-a019-4d320ede787c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:51.183359 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd0d2e-ad86-430e-a019-4d320ede787c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:51.183652 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd0d2e-ad86-430e-a019-4d320ede787c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:51.183934 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd0d2e-ad86-430e-a019-4d320ede787c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:51.190841 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd0d2e-ad86-430e-a019-4d320ede787c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:51.192263 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd0d2e-ad86-430e-a019-4d320ede787c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:51.207156 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-dcdd0d2e-ad86-430e-a019-4d320ede787c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 03:30:51.207156 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:51.207156 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:51.207156 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:51.207156 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:51.207156 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:51.207156 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:51.207156 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:51.207156 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:51.207156 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:51.207156 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:51.207156 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:51.207156 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 03:30:51.207156 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 03:30:51.207156 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 03:30:51.207156 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 03:30:51.208093 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:51.208093 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:51.208093 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 03:30:51.208093 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:30:51.208093 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 03:30:51.208093 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:30:51.208093 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:51.208093 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:51.208093 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:51.208093 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:51.208093 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:51.208093 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:51.208093 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:51.208093 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:51.208093 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:51.208093 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:51.208093 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:51.208093 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:51.208984 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:51.208984 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:51.208984 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 03:30:51.208984 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 03:30:51.208984 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 03:30:51.208984 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 03:30:51.208984 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 03:30:51.208984 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 03:30:51.208984 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 03:30:51.208984 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:51.208984 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 266/520] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jul 21 03:30:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:51.209537 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd0d2e-ad86-430e-a019-4d320ede787c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:51.232787 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 255/521] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:30:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 03:30:51.233606 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca4805-452f-4958-ae6a-052b43b9c7fa None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:51.309502 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd0d2e-ad86-430e-a019-4d320ede787c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:51.332126 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca4805-452f-4958-ae6a-052b43b9c7fa None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:51.342139 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3234ebc6-127d-46ac-8484-433990101ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:51.342589 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:51.342952 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234ebc6-127d-46ac-8484-433990101ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:51.343237 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234ebc6-127d-46ac-8484-433990101ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:51.343511 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3234ebc6-127d-46ac-8484-433990101ff7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:51.350192 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3234ebc6-127d-46ac-8484-433990101ff7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:51.351690 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3234ebc6-127d-46ac-8484-433990101ff7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:51.365804 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-3234ebc6-127d-46ac-8484-433990101ff7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:30:51.365804 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:51.365804 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:51.365804 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:51.365804 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:51.365804 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:51.365804 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:51.365804 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:51.365804 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:51.365804 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:51.365804 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:51.365804 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:51.365804 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 03:30:51.365804 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 03:30:51.365804 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 03:30:51.367360 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 03:30:51.367360 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:51.367360 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:51.367360 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:51.367360 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:51.367360 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:51.367360 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:51.367360 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:51.367360 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:51.367360 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:51.367360 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:51.367360 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:51.367360 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:51.367360 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:51.367360 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:51.367360 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:51.367360 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:51.368547 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 03:30:51.368547 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 03:30:51.368547 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 03:30:51.368547 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 03:30:51.368547 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 03:30:51.368547 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 03:30:51.368547 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:30:51.368547 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:51.369069 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237291cf-1796-4722-b712-b171b77ab9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:51.369069 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237291cf-1796-4722-b712-b171b77ab9a8 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:51.369069 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237291cf-1796-4722-b712-b171b77ab9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:51.369069 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237291cf-1796-4722-b712-b171b77ab9a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:51.369365 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237291cf-1796-4722-b712-b171b77ab9a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:51.369365 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237291cf-1796-4722-b712-b171b77ab9a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:51.370437 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237291cf-1796-4722-b712-b171b77ab9a8 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:51.370795 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 267/522] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:30:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:51.371546 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3234ebc6-127d-46ac-8484-433990101ff7 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:51.381596 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 256/523] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:30:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:51.382951 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237291cf-1796-4722-b712-b171b77ab9a8 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:51.421379 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:51.475326 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3234ebc6-127d-46ac-8484-433990101ff7 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:51.481547 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237291cf-1796-4722-b712-b171b77ab9a8 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:51.508338 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7df82e-d2cc-47cb-b4c4-9edd714a4e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:51.509005 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7df82e-d2cc-47cb-b4c4-9edd714a4e07 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:51.509291 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7df82e-d2cc-47cb-b4c4-9edd714a4e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:51.509563 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7df82e-d2cc-47cb-b4c4-9edd714a4e07 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:51.510259 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7df82e-d2cc-47cb-b4c4-9edd714a4e07 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:51.511737 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7df82e-d2cc-47cb-b4c4-9edd714a4e07 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:51.514354 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85156c81-0f90-4f4a-b7f5-6f22e7fe8a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:51.515043 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85156c81-0f90-4f4a-b7f5-6f22e7fe8a57 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:51.515334 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85156c81-0f90-4f4a-b7f5-6f22e7fe8a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:51.515611 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85156c81-0f90-4f4a-b7f5-6f22e7fe8a57 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:51.516456 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85156c81-0f90-4f4a-b7f5-6f22e7fe8a57 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:51.516770 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85156c81-0f90-4f4a-b7f5-6f22e7fe8a57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:51.518207 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85156c81-0f90-4f4a-b7f5-6f22e7fe8a57 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:51.531801 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 268/524] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jul 21 03:30:51 2022] POST /identity/v3/users => generated 247 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:30:51.532499 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7df82e-d2cc-47cb-b4c4-9edd714a4e07 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:51.536885 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 257/525] 10.222.0.20 () {56 vars in 1139 bytes} [Thu Jul 21 03:30:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:51.537758 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85156c81-0f90-4f4a-b7f5-6f22e7fe8a57 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:51.570645 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:51.648884 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85156c81-0f90-4f4a-b7f5-6f22e7fe8a57 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:51.650592 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:51.654208 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7df82e-d2cc-47cb-b4c4-9edd714a4e07 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:51.696511 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a54def-974b-4b75-9b68-0c69c3a5adcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:51.696799 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e00ff9-6157-4138-bbcf-b8d90fc5b0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:51.697236 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a54def-974b-4b75-9b68-0c69c3a5adcc None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:51.697468 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e00ff9-6157-4138-bbcf-b8d90fc5b0e7 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:51.697557 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a54def-974b-4b75-9b68-0c69c3a5adcc None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:51.697751 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e00ff9-6157-4138-bbcf-b8d90fc5b0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:51.697830 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a54def-974b-4b75-9b68-0c69c3a5adcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:51.698030 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e00ff9-6157-4138-bbcf-b8d90fc5b0e7 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:51.698892 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e00ff9-6157-4138-bbcf-b8d90fc5b0e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:51.699186 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e00ff9-6157-4138-bbcf-b8d90fc5b0e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:51.700622 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e00ff9-6157-4138-bbcf-b8d90fc5b0e7 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:51.713812 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a54def-974b-4b75-9b68-0c69c3a5adcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:51.715290 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a54def-974b-4b75-9b68-0c69c3a5adcc None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:51.718746 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 258/526] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 03:30:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:51.719596 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e00ff9-6157-4138-bbcf-b8d90fc5b0e7 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:51.737318 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-e6a54def-974b-4b75-9b68-0c69c3a5adcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:30:51.737318 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:51.737318 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:51.737318 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:51.737318 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:51.737318 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:51.737318 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:51.737318 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:51.737318 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:51.737318 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:51.737318 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:51.737318 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:51.737318 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:30:51.737318 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:30:51.737318 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:30:51.738675 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:30:51.738675 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:51.738675 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:51.738675 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:51.738675 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:51.738675 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:51.738675 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:51.738675 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:51.738675 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:51.738675 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:51.738675 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:51.738675 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:51.738675 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:51.738675 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:51.738675 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:51.738675 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:51.738675 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:51.739873 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:30:51.739873 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:30:51.739873 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:30:51.739873 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:51.739873 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 269/527] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:30:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:51.739873 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a54def-974b-4b75-9b68-0c69c3a5adcc None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:51.819117 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:51.836808 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e00ff9-6157-4138-bbcf-b8d90fc5b0e7 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:51.855670 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a54def-974b-4b75-9b68-0c69c3a5adcc None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:51.872864 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bfc939-0b7d-4a06-93e0-5ab00e61e7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:51.873677 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfc939-0b7d-4a06-93e0-5ab00e61e7e8 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:51.873970 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfc939-0b7d-4a06-93e0-5ab00e61e7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:51.874253 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bfc939-0b7d-4a06-93e0-5ab00e61e7e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:51.881991 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bfc939-0b7d-4a06-93e0-5ab00e61e7e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:51.883621 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bfc939-0b7d-4a06-93e0-5ab00e61e7e8 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:51.896812 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ddefbd-209e-4482-9db7-ba9dc4183ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:51.898209 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ddefbd-209e-4482-9db7-ba9dc4183ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:51.898528 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ddefbd-209e-4482-9db7-ba9dc4183ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:51.898814 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ddefbd-209e-4482-9db7-ba9dc4183ff6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:51.899122 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-d1bfc939-0b7d-4a06-93e0-5ab00e61e7e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:30:51.899122 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:51.899122 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:51.899122 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:51.899122 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:51.899122 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:51.899122 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:51.899122 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:51.899122 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:51.899122 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:51.899122 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:51.899122 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:51.899122 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 03:30:51.899122 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 03:30:51.899122 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 03:30:51.900356 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 03:30:51.900356 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:51.900356 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:51.900356 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:51.900356 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:51.900356 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:51.900356 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:51.900356 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:51.900356 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:51.900356 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:51.900356 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:51.900356 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:51.900356 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:51.900356 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:51.900356 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:51.900356 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:51.900356 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:51.901238 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 03:30:51.901238 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 03:30:51.901238 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 03:30:51.901238 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 03:30:51.901238 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 03:30:51.901238 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 03:30:51.901238 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:30:51.901238 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:30:51.901238 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 259/528] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:30:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:51.901692 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bfc939-0b7d-4a06-93e0-5ab00e61e7e8 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:51.929859 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:51.979261 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ddefbd-209e-4482-9db7-ba9dc4183ff6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:51.980632 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ddefbd-209e-4482-9db7-ba9dc4183ff6 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:52.006381 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bfc939-0b7d-4a06-93e0-5ab00e61e7e8 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:52.043832 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83bac6b-a308-4c17-8f04-490980333cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:52.044644 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83bac6b-a308-4c17-8f04-490980333cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:52.045230 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83bac6b-a308-4c17-8f04-490980333cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:52.045518 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83bac6b-a308-4c17-8f04-490980333cb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:52.046534 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83bac6b-a308-4c17-8f04-490980333cb8 None admin] RBAC: Adding query filter params (role.id=3d204e16b7214bf29bde33739ca9006a, scope.project.id=0432303daa8b4304a8e07032d6a80781, user.id=a567cddc98164bd39317a245626d0f5d) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:52.046849 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83bac6b-a308-4c17-8f04-490980333cb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:52.048312 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83bac6b-a308-4c17-8f04-490980333cb8 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:52.054501 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 260/529] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:30:51 2022] GET /identity/v3/role_assignments?user.id=a567cddc98164bd39317a245626d0f5d&scope.project.id=0432303daa8b4304a8e07032d6a80781&role.id=3d204e16b7214bf29bde33739ca9006a => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:52.054501 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83bac6b-a308-4c17-8f04-490980333cb8 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:52.078891 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:52.105040 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 270/530] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:30:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 03:30:52.106016 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ddefbd-209e-4482-9db7-ba9dc4183ff6 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:52.181740 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:52.200474 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83bac6b-a308-4c17-8f04-490980333cb8 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:52.244366 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20dfb9-cd5d-47bd-b419-10955da9822c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:52.245251 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20dfb9-cd5d-47bd-b419-10955da9822c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:52.245723 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20dfb9-cd5d-47bd-b419-10955da9822c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:52.246110 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec20dfb9-cd5d-47bd-b419-10955da9822c None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:52.246980 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20dfb9-cd5d-47bd-b419-10955da9822c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:52.247388 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20dfb9-cd5d-47bd-b419-10955da9822c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:52.248876 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec20dfb9-cd5d-47bd-b419-10955da9822c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:52.251980 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ddefbd-209e-4482-9db7-ba9dc4183ff6 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:52.266648 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 261/531] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:52.267704 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20dfb9-cd5d-47bd-b419-10955da9822c None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:52.296550 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5db6e3-d90c-4f5b-bd0d-047cb00823c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:52.297885 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5db6e3-d90c-4f5b-bd0d-047cb00823c7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:52.298637 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5db6e3-d90c-4f5b-bd0d-047cb00823c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:52.299068 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5db6e3-d90c-4f5b-bd0d-047cb00823c7 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:52.300265 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5db6e3-d90c-4f5b-bd0d-047cb00823c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:52.301151 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5db6e3-d90c-4f5b-bd0d-047cb00823c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:52.303067 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5db6e3-d90c-4f5b-bd0d-047cb00823c7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:52.333498 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 271/532] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 03:30:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:52.333498 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5db6e3-d90c-4f5b-bd0d-047cb00823c7 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:52.355468 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:52.392396 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec20dfb9-cd5d-47bd-b419-10955da9822c None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:52.440427 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbe9f2-f975-456d-8fa9-bd10dc85d887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:52.441612 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbe9f2-f975-456d-8fa9-bd10dc85d887 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:52.441957 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbe9f2-f975-456d-8fa9-bd10dc85d887 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:52.442334 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fbe9f2-f975-456d-8fa9-bd10dc85d887 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:52.453172 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5db6e3-d90c-4f5b-bd0d-047cb00823c7 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:52.457358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fbe9f2-f975-456d-8fa9-bd10dc85d887 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:52.459148 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fbe9f2-f975-456d-8fa9-bd10dc85d887 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:52.468090 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:52.484475 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-75fbe9f2-f975-456d-8fa9-bd10dc85d887 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:30:52.484475 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:52.484475 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:52.484475 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:52.484475 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:52.484475 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:52.484475 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:52.484475 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:52.484475 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:52.484475 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:52.484475 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:52.484475 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:52.484475 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:30:52.484475 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:30:52.484475 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:30:52.485562 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:30:52.485562 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:52.485562 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:52.485562 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:52.485562 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:52.485562 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:52.485562 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:52.485562 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:52.485562 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:52.485562 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:52.485562 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:52.485562 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:52.485562 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:52.485562 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:52.485562 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:52.485562 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:52.485562 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:52.486664 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:30:52.486664 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:30:52.486664 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:30:52.486664 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:30:52.487472 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 262/533] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:30:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:52.488677 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbe9f2-f975-456d-8fa9-bd10dc85d887 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:52.495526 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d0ec9-0a04-4952-8386-362c89311830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:52.496639 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d0ec9-0a04-4952-8386-362c89311830 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:52.497130 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d0ec9-0a04-4952-8386-362c89311830 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:52.497633 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d0ec9-0a04-4952-8386-362c89311830 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:52.505557 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988d0ec9-0a04-4952-8386-362c89311830 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:52.507829 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988d0ec9-0a04-4952-8386-362c89311830 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:52.529170 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-988d0ec9-0a04-4952-8386-362c89311830 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:30:52.529170 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:52.529170 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:52.529170 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:52.529170 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:52.529170 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:52.529170 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:52.529170 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:52.529170 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:52.529170 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:52.529170 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:52.529170 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:52.529170 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 03:30:52.529170 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 03:30:52.529170 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 03:30:52.530194 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 03:30:52.530194 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:52.530194 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:52.530194 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:52.530194 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:52.530194 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:52.530194 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:52.530194 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:52.530194 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:52.530194 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:52.530194 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:52.530194 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:52.530194 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:52.530194 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:52.530194 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:52.530194 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:52.530194 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:52.531093 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 03:30:52.531093 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 03:30:52.531093 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 03:30:52.531093 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 03:30:52.531093 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 03:30:52.531093 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 03:30:52.531093 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:30:52.531093 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:52.533564 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 272/534] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:30:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:52.534612 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d0ec9-0a04-4952-8386-362c89311830 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:52.606640 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fbe9f2-f975-456d-8fa9-bd10dc85d887 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:52.631351 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:52.643572 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d0ec9-0a04-4952-8386-362c89311830 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:52.644815 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9e0f4-233a-4f6e-a4c6-89018a3e9103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:52.645654 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9e0f4-233a-4f6e-a4c6-89018a3e9103 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:52.646078 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9e0f4-233a-4f6e-a4c6-89018a3e9103 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:52.646532 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9e0f4-233a-4f6e-a4c6-89018a3e9103 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:52.647810 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add9e0f4-233a-4f6e-a4c6-89018a3e9103 None admin] RBAC: Adding query filter params (role.id=3d204e16b7214bf29bde33739ca9006a, scope.project.id=0432303daa8b4304a8e07032d6a80781, user.id=03f2ad420185421c97d5bc06be965bd9) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:52.648260 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add9e0f4-233a-4f6e-a4c6-89018a3e9103 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:52.649854 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add9e0f4-233a-4f6e-a4c6-89018a3e9103 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:52.656200 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 263/535] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:30:52 2022] GET /identity/v3/role_assignments?user.id=03f2ad420185421c97d5bc06be965bd9&scope.project.id=0432303daa8b4304a8e07032d6a80781&role.id=3d204e16b7214bf29bde33739ca9006a => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:52.657271 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9e0f4-233a-4f6e-a4c6-89018a3e9103 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:52.683754 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc4a04-e082-42bb-98fb-972c1088d747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:52.684231 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc4a04-e082-42bb-98fb-972c1088d747 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:52.684519 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc4a04-e082-42bb-98fb-972c1088d747 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:52.684795 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc4a04-e082-42bb-98fb-972c1088d747 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:52.685601 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dc4a04-e082-42bb-98fb-972c1088d747 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:52.685964 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dc4a04-e082-42bb-98fb-972c1088d747 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:52.687521 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dc4a04-e082-42bb-98fb-972c1088d747 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:52.703726 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 273/536] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:52.713391 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc4a04-e082-42bb-98fb-972c1088d747 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:52.793162 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:52.873628 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9e0f4-233a-4f6e-a4c6-89018a3e9103 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:52.898245 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc4a04-e082-42bb-98fb-972c1088d747 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:52.935488 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6acbc-b4ed-4fc0-ae54-e0d4ff077d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:52.936674 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6acbc-b4ed-4fc0-ae54-e0d4ff077d96 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:52.937164 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6acbc-b4ed-4fc0-ae54-e0d4ff077d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:52.937677 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6acbc-b4ed-4fc0-ae54-e0d4ff077d96 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:52.946154 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e6acbc-b4ed-4fc0-ae54-e0d4ff077d96 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:52.947981 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e6acbc-b4ed-4fc0-ae54-e0d4ff077d96 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:52.962491 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-c8e6acbc-b4ed-4fc0-ae54-e0d4ff077d96 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:30:52.962491 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:52.962491 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:52.962491 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:52.962491 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:52.962491 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:52.962491 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:52.962491 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:52.962491 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:52.962491 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:52.962491 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:52.962491 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:52.962491 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 03:30:52.962491 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 03:30:52.962491 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 03:30:52.963317 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 03:30:52.963317 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:52.963317 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:52.963317 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:52.963317 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:52.963317 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:52.963317 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:52.963317 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:52.963317 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:52.963317 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:52.963317 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:52.963317 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:52.963317 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:52.963317 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:52.963317 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:52.963317 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:52.963317 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:52.964164 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 03:30:52.964164 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 03:30:52.964164 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 03:30:52.964164 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 03:30:52.964164 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 03:30:52.964164 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 03:30:52.964164 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:30:52.964164 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:52.964596 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61baac99-81b5-4988-9643-5587a340233a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:52.964596 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61baac99-81b5-4988-9643-5587a340233a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:52.964596 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61baac99-81b5-4988-9643-5587a340233a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:52.965113 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61baac99-81b5-4988-9643-5587a340233a None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:52.965720 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61baac99-81b5-4988-9643-5587a340233a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:52.965980 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61baac99-81b5-4988-9643-5587a340233a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:52.967440 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61baac99-81b5-4988-9643-5587a340233a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:52.967895 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 274/537] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:30:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:52.976904 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6acbc-b4ed-4fc0-ae54-e0d4ff077d96 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:53.008904 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 264/538] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 03:30:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:53.019485 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61baac99-81b5-4988-9643-5587a340233a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:53.086824 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:53.095009 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6acbc-b4ed-4fc0-ae54-e0d4ff077d96 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:53.136665 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:53.193356 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61baac99-81b5-4988-9643-5587a340233a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:53.216088 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35ec466-5cf4-44d7-9704-dcd8511cf750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:53.216932 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ec466-5cf4-44d7-9704-dcd8511cf750 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:53.217043 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ec466-5cf4-44d7-9704-dcd8511cf750 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:53.217294 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35ec466-5cf4-44d7-9704-dcd8511cf750 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:53.218088 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35ec466-5cf4-44d7-9704-dcd8511cf750 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:53.218400 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35ec466-5cf4-44d7-9704-dcd8511cf750 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:53.219949 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35ec466-5cf4-44d7-9704-dcd8511cf750 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:53.238434 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 275/539] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 03:30:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:53.240818 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc6828-b467-4edd-82a3-00db02595f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:53.242288 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc6828-b467-4edd-82a3-00db02595f27 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:53.242794 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc6828-b467-4edd-82a3-00db02595f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:53.243294 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc6828-b467-4edd-82a3-00db02595f27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:53.245061 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35ec466-5cf4-44d7-9704-dcd8511cf750 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:53.246387 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc6828-b467-4edd-82a3-00db02595f27 None admin] RBAC: Adding query filter params (role.id=3d204e16b7214bf29bde33739ca9006a, scope.project.id=0432303daa8b4304a8e07032d6a80781, user.id=cefbe2d0c739428ab0d4dfeaed6c37ab) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:53.248716 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc6828-b467-4edd-82a3-00db02595f27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:53.255102 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc6828-b467-4edd-82a3-00db02595f27 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:53.266825 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 265/540] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:30:53 2022] GET /identity/v3/role_assignments?user.id=cefbe2d0c739428ab0d4dfeaed6c37ab&scope.project.id=0432303daa8b4304a8e07032d6a80781&role.id=3d204e16b7214bf29bde33739ca9006a => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:53.389416 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35ec466-5cf4-44d7-9704-dcd8511cf750 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:53.440213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecc0dd7-8e21-492b-876e-d594e8b993fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:53.440892 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc0dd7-8e21-492b-876e-d594e8b993fb None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:53.441301 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc0dd7-8e21-492b-876e-d594e8b993fb None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:53.441586 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecc0dd7-8e21-492b-876e-d594e8b993fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:53.442437 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc0dd7-8e21-492b-876e-d594e8b993fb None admin] RBAC: Adding query filter params (role.id=3d204e16b7214bf29bde33739ca9006a, scope.project.id=0432303daa8b4304a8e07032d6a80781, user.id=b68c257254de483ab65eb5dc5684a704) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:53.442868 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc0dd7-8e21-492b-876e-d594e8b993fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:53.444382 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecc0dd7-8e21-492b-876e-d594e8b993fb None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:53.455275 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 276/541] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:30:53 2022] GET /identity/v3/role_assignments?user.id=b68c257254de483ab65eb5dc5684a704&scope.project.id=0432303daa8b4304a8e07032d6a80781&role.id=3d204e16b7214bf29bde33739ca9006a => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:30:53.795668 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda90555-5879-40bb-84b1-91e9efd2444e None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:53.796306 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda90555-5879-40bb-84b1-91e9efd2444e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:53.796828 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda90555-5879-40bb-84b1-91e9efd2444e None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:53.798418 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 266/542] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:53.812064 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358e9fe-c7fd-4186-9183-8fc409ff81d8 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:53.812655 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358e9fe-c7fd-4186-9183-8fc409ff81d8 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:53.813142 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4358e9fe-c7fd-4186-9183-8fc409ff81d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:53.837327 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-4358e9fe-c7fd-4186-9183-8fc409ff81d8 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:53.838904 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4358e9fe-c7fd-4186-9183-8fc409ff81d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:53.850064 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:53.920789 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 277/543] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:30:53.971516 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda90555-5879-40bb-84b1-91e9efd2444e None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:54.092266 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda90555-5879-40bb-84b1-91e9efd2444e None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:54.110450 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:54.136058 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282af441-4578-46ed-a497-6a033f01f71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:54.136860 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282af441-4578-46ed-a497-6a033f01f71d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:54.137141 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282af441-4578-46ed-a497-6a033f01f71d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:54.137415 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282af441-4578-46ed-a497-6a033f01f71d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:54.158295 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282af441-4578-46ed-a497-6a033f01f71d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:54.166060 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-282af441-4578-46ed-a497-6a033f01f71d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 03:30:54.166060 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:54.166060 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:54.166060 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:54.166060 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:54.166060 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:54.166060 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:54.166060 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:54.166060 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:54.166060 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:54.166060 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:54.166060 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:54.166060 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:54.166060 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:54.166060 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:54.166060 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:54.166940 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:54.166940 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:54.166940 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:54.166940 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:54.166940 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:54.166940 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:54.166940 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:54.166940 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:54.166940 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:54.166940 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:54.166940 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:54.166940 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:54.166940 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:54.166940 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:54.166940 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:54.166940 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:54.168148 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:54.168148 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:54.168148 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:54.168148 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:54.168148 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:54.168148 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:54.168148 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:54.168148 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:54.168148 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:54.168148 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:54.168148 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 03:30:54.168148 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:30:54.168148 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 267/544] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jul 21 03:30:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:54.173123 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358e9fe-c7fd-4186-9183-8fc409ff81d8 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:54.315171 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4358e9fe-c7fd-4186-9183-8fc409ff81d8 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:54.332447 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0aefb-50f8-43b1-8af7-3698201bbbbf None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:54.333032 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0aefb-50f8-43b1-8af7-3698201bbbbf None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:54.333504 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0aefb-50f8-43b1-8af7-3698201bbbbf None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:54.336530 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 268/545] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:54.340840 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecbe86-bc00-4197-861f-b3a6a3406b8c None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:54.341348 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecbe86-bc00-4197-861f-b3a6a3406b8c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:54.341825 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecbe86-bc00-4197-861f-b3a6a3406b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:54.350190 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe74453e-8f17-4a70-95dc-dde6188487b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:54.350977 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74453e-8f17-4a70-95dc-dde6188487b3 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:54.351265 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74453e-8f17-4a70-95dc-dde6188487b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:54.351546 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74453e-8f17-4a70-95dc-dde6188487b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:54.352377 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe74453e-8f17-4a70-95dc-dde6188487b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:54.352691 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe74453e-8f17-4a70-95dc-dde6188487b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:54.358484 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe74453e-8f17-4a70-95dc-dde6188487b3 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:54.362904 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 278/546] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jul 21 03:30:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:54.368787 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe74453e-8f17-4a70-95dc-dde6188487b3 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:54.379657 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:54.384897 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-87ecbe86-bc00-4197-861f-b3a6a3406b8c None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:54.390261 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-87ecbe86-bc00-4197-861f-b3a6a3406b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:54.473682 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe74453e-8f17-4a70-95dc-dde6188487b3 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:54.509253 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0136b16-187d-4baa-8e58-cdf082b2fb5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:54.510056 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0136b16-187d-4baa-8e58-cdf082b2fb5b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:54.510340 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0136b16-187d-4baa-8e58-cdf082b2fb5b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:54.510663 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0136b16-187d-4baa-8e58-cdf082b2fb5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:54.521856 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0136b16-187d-4baa-8e58-cdf082b2fb5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:54.523630 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0136b16-187d-4baa-8e58-cdf082b2fb5b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:54.541422 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-c0136b16-187d-4baa-8e58-cdf082b2fb5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:30:54.541422 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:54.541422 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:54.541422 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:54.541422 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:54.541422 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:54.541422 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:54.541422 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:54.541422 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:54.541422 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:54.541422 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:54.541422 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:54.541422 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:30:54.541422 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:30:54.541422 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:30:54.542297 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:30:54.542297 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:54.542297 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:54.542297 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:54.542297 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:54.542297 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:54.542297 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:54.542297 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:54.542297 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:54.542297 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:54.542297 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:54.542297 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:54.542297 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:54.542297 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:54.542297 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:54.542297 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:54.542297 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:54.543594 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:30:54.543594 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:30:54.543594 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:30:54.543594 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:54.543594 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 279/547] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:30:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:30:54.548311 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0136b16-187d-4baa-8e58-cdf082b2fb5b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:54.564063 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 269/548] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 03:30:54.606933 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ecbe86-bc00-4197-861f-b3a6a3406b8c None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:54.611479 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:54.653429 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0136b16-187d-4baa-8e58-cdf082b2fb5b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:54.688004 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b545c1-0d81-45a4-b1fd-4e2e10c8f0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:54.688667 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b545c1-0d81-45a4-b1fd-4e2e10c8f0fd None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:54.688950 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b545c1-0d81-45a4-b1fd-4e2e10c8f0fd None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:54.689221 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b545c1-0d81-45a4-b1fd-4e2e10c8f0fd None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:54.690251 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b545c1-0d81-45a4-b1fd-4e2e10c8f0fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:54.690251 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b545c1-0d81-45a4-b1fd-4e2e10c8f0fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:54.691636 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b545c1-0d81-45a4-b1fd-4e2e10c8f0fd None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:54.704087 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 280/549] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:30:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:54.709348 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b545c1-0d81-45a4-b1fd-4e2e10c8f0fd None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:54.811996 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b545c1-0d81-45a4-b1fd-4e2e10c8f0fd None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:54.836782 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:54.848012 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ecbe86-bc00-4197-861f-b3a6a3406b8c None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:54.848161 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf118e9-f99c-46e9-a819-03338f301dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:54.848806 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf118e9-f99c-46e9-a819-03338f301dfc None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:54.849143 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf118e9-f99c-46e9-a819-03338f301dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:54.849608 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf118e9-f99c-46e9-a819-03338f301dfc None admin] PATH_INFO: `/v3/users/swift` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:54.849710 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:54.864972 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf118e9-f99c-46e9-a819-03338f301dfc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:54.866397 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf118e9-f99c-46e9-a819-03338f301dfc None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:54.894818 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-daf118e9-f99c-46e9-a819-03338f301dfc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 03:30:54.894818 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:54.894818 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:54.894818 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:54.894818 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:54.894818 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:54.894818 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:54.894818 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:54.894818 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:54.894818 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:54.894818 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:54.894818 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:54.894818 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 03:30:54.894818 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 03:30:54.894818 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 03:30:54.894818 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 03:30:54.896242 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:54.896242 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:54.896242 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 03:30:54.896242 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:30:54.896242 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 03:30:54.896242 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:30:54.896242 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:54.896242 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:54.896242 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:54.896242 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:54.896242 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:54.896242 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:54.896242 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:54.896242 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:54.896242 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:54.896242 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:54.896242 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:54.896242 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:54.898678 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:54.898678 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:54.898678 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 03:30:54.898678 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 03:30:54.898678 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 03:30:54.898678 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 03:30:54.898678 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 03:30:54.898678 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 03:30:54.898678 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 03:30:54.898678 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:54.898678 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 281/550] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 03:30:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:30:54.902907 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf118e9-f99c-46e9-a819-03338f301dfc None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:54.951172 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74fb985-f59f-4438-989a-44332d718cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:54.951991 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74fb985-f59f-4438-989a-44332d718cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:54.952274 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74fb985-f59f-4438-989a-44332d718cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:54.952547 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74fb985-f59f-4438-989a-44332d718cf1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:55.005722 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf118e9-f99c-46e9-a819-03338f301dfc None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:55.011314 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74fb985-f59f-4438-989a-44332d718cf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:55.019354 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-b74fb985-f59f-4438-989a-44332d718cf1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 03:30:55.019354 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:55.019354 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:55.019354 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:55.019354 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:55.019354 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:55.019354 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:55.019354 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:55.019354 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:55.019354 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:55.019354 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:55.019354 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:55.019354 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:55.019354 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:55.019354 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:55.019354 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:55.020310 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:55.020310 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:55.020310 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:55.020310 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:55.020310 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:55.020310 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:55.020310 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:55.020310 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:55.020310 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:55.020310 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:55.020310 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:55.020310 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:55.020310 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:55.020310 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:55.020310 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:55.020310 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:55.021284 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:55.021284 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:55.021284 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:55.021284 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:55.021284 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:55.021284 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:55.021284 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:55.021284 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:55.021284 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:55.021284 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:55.021284 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 03:30:55.021284 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:30:55.023573 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 270/551] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jul 21 03:30:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 417 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:30:55.039652 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74fb985-f59f-4438-989a-44332d718cf1 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:55.043834 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a61caf1-8bed-403a-8a1c-37ddb10c752b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:55.044672 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61caf1-8bed-403a-8a1c-37ddb10c752b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:55.044965 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61caf1-8bed-403a-8a1c-37ddb10c752b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:55.045241 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a61caf1-8bed-403a-8a1c-37ddb10c752b None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:55.046099 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a61caf1-8bed-403a-8a1c-37ddb10c752b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:55.050524 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a61caf1-8bed-403a-8a1c-37ddb10c752b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:55.050524 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a61caf1-8bed-403a-8a1c-37ddb10c752b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:55.067537 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 282/552] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Jul 21 03:30:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:55.073116 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a61caf1-8bed-403a-8a1c-37ddb10c752b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:55.113004 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:55.174845 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74fb985-f59f-4438-989a-44332d718cf1 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:55.185426 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a61caf1-8bed-403a-8a1c-37ddb10c752b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:55.207739 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b988995a-4c3c-4420-b0ce-116de4f07e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:55.208518 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988995a-4c3c-4420-b0ce-116de4f07e1c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:55.208926 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988995a-4c3c-4420-b0ce-116de4f07e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:55.209272 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988995a-4c3c-4420-b0ce-116de4f07e1c None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:55.210710 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b988995a-4c3c-4420-b0ce-116de4f07e1c None admin] RBAC: Adding query filter params (name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:55.211089 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b988995a-4c3c-4420-b0ce-116de4f07e1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:55.212620 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b988995a-4c3c-4420-b0ce-116de4f07e1c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:55.220978 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 271/553] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jul 21 03:30:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:55.222392 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e3d19-10f8-4f70-8345-5f7e0e5ed3d1 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:55.222787 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e3d19-10f8-4f70-8345-5f7e0e5ed3d1 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:55.223234 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e3d19-10f8-4f70-8345-5f7e0e5ed3d1 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:55.224862 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 272/554] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:55.227083 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e3d19-10f8-4f70-8345-5f7e0e5ed3d1 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:55.230096 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd4641-2755-4962-b0b0-b9c2b241992a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:55.230789 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd4641-2755-4962-b0b0-b9c2b241992a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:55.231077 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd4641-2755-4962-b0b0-b9c2b241992a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:55.231546 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd4641-2755-4962-b0b0-b9c2b241992a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:55.286900 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:55.317602 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd4641-2755-4962-b0b0-b9c2b241992a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:55.320173 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd4641-2755-4962-b0b0-b9c2b241992a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:55.332026 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e3d19-10f8-4f70-8345-5f7e0e5ed3d1 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:55.366437 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b97513-7e79-4d83-9532-0938e5ecfee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:55.367407 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b97513-7e79-4d83-9532-0938e5ecfee2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:55.367792 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b97513-7e79-4d83-9532-0938e5ecfee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:55.368167 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b97513-7e79-4d83-9532-0938e5ecfee2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:55.368717 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:55.381486 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b97513-7e79-4d83-9532-0938e5ecfee2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:55.383777 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b97513-7e79-4d83-9532-0938e5ecfee2 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:55.403951 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-b2b97513-7e79-4d83-9532-0938e5ecfee2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:30:55.403951 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:55.403951 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:55.403951 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:55.403951 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:55.403951 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:55.403951 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:55.403951 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:55.403951 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:55.403951 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:55.403951 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:55.403951 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:55.403951 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:30:55.403951 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:30:55.403951 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:30:55.404888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:30:55.404888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:55.404888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:55.404888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:55.404888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:55.404888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:55.404888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:55.404888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:55.404888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:55.404888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:55.404888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:55.404888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:55.404888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:55.404888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:55.404888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:55.404888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:55.404888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:55.405748 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:30:55.405748 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:30:55.405748 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:30:55.405748 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:30:55.408034 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 273/555] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:30:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:55.409719 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e8150-02bd-4599-9a1a-cfdb37024184 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:55.410207 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e8150-02bd-4599-9a1a-cfdb37024184 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:55.410699 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e8150-02bd-4599-9a1a-cfdb37024184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:55.428796 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-223e8150-02bd-4599-9a1a-cfdb37024184 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:55.430900 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-223e8150-02bd-4599-9a1a-cfdb37024184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:55.442502 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 283/556] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:30:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 03:30:55.442502 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd4641-2755-4962-b0b0-b9c2b241992a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:55.510276 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 274/557] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:30:55.511548 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e8150-02bd-4599-9a1a-cfdb37024184 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:55.527814 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:55.586082 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd4641-2755-4962-b0b0-b9c2b241992a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:55.631294 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e4df0-7ab6-42d7-bf1e-57c842e0f9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:55.633365 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e4df0-7ab6-42d7-bf1e-57c842e0f9a7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:55.633971 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e4df0-7ab6-42d7-bf1e-57c842e0f9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:55.634448 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e4df0-7ab6-42d7-bf1e-57c842e0f9a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:55.635932 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e4df0-7ab6-42d7-bf1e-57c842e0f9a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:55.636465 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e4df0-7ab6-42d7-bf1e-57c842e0f9a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:55.638572 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e4df0-7ab6-42d7-bf1e-57c842e0f9a7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:55.648346 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e8150-02bd-4599-9a1a-cfdb37024184 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:55.648828 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:55.656485 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 284/558] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:30:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:55.658119 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e4df0-7ab6-42d7-bf1e-57c842e0f9a7 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:55.688379 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed6ef3-c856-4e10-a554-697d9bd8dbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:55.689148 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed6ef3-c856-4e10-a554-697d9bd8dbdb None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:55.689480 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed6ef3-c856-4e10-a554-697d9bd8dbdb None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:55.689808 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed6ef3-c856-4e10-a554-697d9bd8dbdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:55.706760 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed6ef3-c856-4e10-a554-697d9bd8dbdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:55.710879 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed6ef3-c856-4e10-a554-697d9bd8dbdb None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:55.729378 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-f9ed6ef3-c856-4e10-a554-697d9bd8dbdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:30:55.729378 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:55.729378 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:55.729378 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:55.729378 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:55.729378 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:55.729378 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:55.729378 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:55.729378 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:55.729378 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:55.729378 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:55.729378 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:55.729378 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:30:55.729378 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:30:55.729378 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:30:55.730802 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:30:55.730802 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:55.730802 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:55.730802 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:55.730802 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:55.730802 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:55.730802 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:55.730802 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:55.730802 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:55.730802 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:55.730802 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:55.730802 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:55.730802 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:55.730802 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:55.730802 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:55.730802 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:55.730802 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:55.731690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:30:55.731690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:30:55.731690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:30:55.731690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:30:55.734543 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 275/559] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:30:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:55.736040 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed6ef3-c856-4e10-a554-697d9bd8dbdb None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:55.781521 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e4df0-7ab6-42d7-bf1e-57c842e0f9a7 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:55.801232 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:55.816615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043bfd17-4d5b-4666-8be8-46724d8bb3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:55.817400 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043bfd17-4d5b-4666-8be8-46724d8bb3a2 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:55.817683 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043bfd17-4d5b-4666-8be8-46724d8bb3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:55.817952 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043bfd17-4d5b-4666-8be8-46724d8bb3a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:55.828950 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043bfd17-4d5b-4666-8be8-46724d8bb3a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:55.836878 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-043bfd17-4d5b-4666-8be8-46724d8bb3a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 03:30:55.836878 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:55.836878 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:55.836878 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:55.836878 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:55.836878 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:55.836878 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:55.836878 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:55.836878 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:55.836878 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:55.836878 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:55.836878 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:55.836878 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:55.836878 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:55.836878 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:55.836878 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:55.837810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:55.837810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:55.837810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:55.837810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:55.837810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:55.837810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:55.837810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:55.837810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:55.837810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:55.837810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:55.837810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:55.837810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:55.837810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:55.837810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:55.837810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:55.837810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:55.838771 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:55.838771 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:55.838771 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:55.838771 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:55.838771 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:55.838771 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:55.838771 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:55.838771 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:55.838771 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:55.838771 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:55.838771 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 03:30:55.838771 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:55.838771 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 285/560] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jul 21 03:30:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:55.839466 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f9ff4-58ab-47da-8c05-62dcfb6c36a4 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:55.839543 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f9ff4-58ab-47da-8c05-62dcfb6c36a4 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:55.839974 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f9ff4-58ab-47da-8c05-62dcfb6c36a4 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:55.841175 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 286/561] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:55.841702 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f9ff4-58ab-47da-8c05-62dcfb6c36a4 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:55.857914 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed6ef3-c856-4e10-a554-697d9bd8dbdb None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:55.894866 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a7735-29a2-45b4-b3e9-6ad46c791292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:55.895666 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a7735-29a2-45b4-b3e9-6ad46c791292 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:55.895948 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a7735-29a2-45b4-b3e9-6ad46c791292 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:55.896227 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a7735-29a2-45b4-b3e9-6ad46c791292 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:55.903538 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a7735-29a2-45b4-b3e9-6ad46c791292 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:55.904995 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a7735-29a2-45b4-b3e9-6ad46c791292 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:55.910291 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:55.919983 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-570a7735-29a2-45b4-b3e9-6ad46c791292 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 21 03:30:55.919983 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:55.919983 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:55.919983 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:55.919983 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:55.919983 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:55.919983 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:55.919983 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:55.919983 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:55.919983 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:55.919983 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:55.919983 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:55.919983 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 03:30:55.919983 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 03:30:55.919983 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 03:30:55.919983 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 03:30:55.920967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:55.920967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:55.920967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 03:30:55.920967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:30:55.920967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 03:30:55.920967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:30:55.920967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:55.920967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:55.920967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:55.920967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:55.920967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:55.920967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:55.920967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:55.920967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:55.920967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:55.920967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:55.920967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:55.920967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:55.922002 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:55.922002 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:55.922002 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 03:30:55.922002 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 03:30:55.922002 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 03:30:55.922002 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 03:30:55.922002 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 03:30:55.922002 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 03:30:55.922002 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 21 03:30:55.922002 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:30:55.922002 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 276/562] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:30:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:55.922623 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90131e38-7129-46a8-a613-3aabf4a83ece None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:55.922623 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90131e38-7129-46a8-a613-3aabf4a83ece None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:55.923097 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90131e38-7129-46a8-a613-3aabf4a83ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:55.939775 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-90131e38-7129-46a8-a613-3aabf4a83ece None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:55.940870 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-90131e38-7129-46a8-a613-3aabf4a83ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:55.965218 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f9ff4-58ab-47da-8c05-62dcfb6c36a4 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:56.002632 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd5a5a-68a6-489c-92da-62b232f2b078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:56.003199 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd5a5a-68a6-489c-92da-62b232f2b078 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:56.003587 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd5a5a-68a6-489c-92da-62b232f2b078 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:56.003831 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd5a5a-68a6-489c-92da-62b232f2b078 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:56.004473 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd5a5a-68a6-489c-92da-62b232f2b078 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:56.004780 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd5a5a-68a6-489c-92da-62b232f2b078 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:56.006200 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd5a5a-68a6-489c-92da-62b232f2b078 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:56.007393 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 277/563] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:30:56.008336 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90131e38-7129-46a8-a613-3aabf4a83ece None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:56.032036 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 287/564] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:30:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:56.032854 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd5a5a-68a6-489c-92da-62b232f2b078 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:56.057882 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:56.108122 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90131e38-7129-46a8-a613-3aabf4a83ece None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:56.130743 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd5a5a-68a6-489c-92da-62b232f2b078 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:56.141102 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f32f9-8aeb-4e8c-9997-844c0d6fd908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:56.141770 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f32f9-8aeb-4e8c-9997-844c0d6fd908 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:56.142052 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f32f9-8aeb-4e8c-9997-844c0d6fd908 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:56.142331 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f32f9-8aeb-4e8c-9997-844c0d6fd908 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:56.143111 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f32f9-8aeb-4e8c-9997-844c0d6fd908 None admin] RBAC: Adding query filter params (name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:56.143422 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f32f9-8aeb-4e8c-9997-844c0d6fd908 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:56.144814 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f32f9-8aeb-4e8c-9997-844c0d6fd908 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:56.147959 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:56.153119 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 278/565] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jul 21 03:30:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:56.154406 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f7c85-c513-4ad4-aec6-e5a897374e9f None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:56.154645 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f7c85-c513-4ad4-aec6-e5a897374e9f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:56.154924 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f7c85-c513-4ad4-aec6-e5a897374e9f None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:56.158516 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 279/566] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:56.158516 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f7c85-c513-4ad4-aec6-e5a897374e9f None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:56.167341 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476447a-e8ad-4c3b-be45-021040044579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:56.168009 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476447a-e8ad-4c3b-be45-021040044579 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:56.168298 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476447a-e8ad-4c3b-be45-021040044579 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:56.168577 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d476447a-e8ad-4c3b-be45-021040044579 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:56.169417 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d476447a-e8ad-4c3b-be45-021040044579 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:56.169733 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d476447a-e8ad-4c3b-be45-021040044579 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:56.171188 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d476447a-e8ad-4c3b-be45-021040044579 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:56.188718 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 288/567] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Jul 21 03:30:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:56.188718 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476447a-e8ad-4c3b-be45-021040044579 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:56.256704 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f7c85-c513-4ad4-aec6-e5a897374e9f None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:56.266939 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:56.285437 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d476447a-e8ad-4c3b-be45-021040044579 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:56.290388 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dee1ef-49a7-4e7a-a28a-42e820da863b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:56.291212 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dee1ef-49a7-4e7a-a28a-42e820da863b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:56.291492 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dee1ef-49a7-4e7a-a28a-42e820da863b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:56.291762 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dee1ef-49a7-4e7a-a28a-42e820da863b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:56.301635 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dee1ef-49a7-4e7a-a28a-42e820da863b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:56.309848 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-b8dee1ef-49a7-4e7a-a28a-42e820da863b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 03:30:56.309848 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:56.309848 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:56.309848 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:56.309848 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:56.309848 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:56.309848 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:56.309848 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:56.309848 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:56.309848 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:56.309848 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:56.309848 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:56.309848 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:56.309848 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:56.309848 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:56.309848 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:56.310797 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:56.310797 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:56.310797 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:56.310797 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:56.310797 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:56.310797 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:56.310797 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:56.310797 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:56.310797 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:56.310797 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:56.310797 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:56.310797 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:56.310797 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:56.310797 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:56.310797 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:56.310797 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:56.311976 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:56.311976 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:56.311976 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:56.311976 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:56.311976 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:56.311976 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:56.311976 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:56.311976 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:56.311976 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:56.311976 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:56.311976 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 03:30:56.311976 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:30:56.311976 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 280/568] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jul 21 03:30:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:56.311976 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dee1ef-49a7-4e7a-a28a-42e820da863b None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:56.321609 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c608027-5c00-4c56-acdc-fdddfdefb1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:56.322393 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c608027-5c00-4c56-acdc-fdddfdefb1a6 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:56.322774 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c608027-5c00-4c56-acdc-fdddfdefb1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:56.323044 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c608027-5c00-4c56-acdc-fdddfdefb1a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:56.329741 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c608027-5c00-4c56-acdc-fdddfdefb1a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:56.331186 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c608027-5c00-4c56-acdc-fdddfdefb1a6 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:56.345239 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-0c608027-5c00-4c56-acdc-fdddfdefb1a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:30:56.345239 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:56.345239 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:56.345239 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:56.345239 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:56.345239 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:56.345239 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:56.345239 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:56.345239 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:56.345239 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:56.345239 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:56.345239 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:56.345239 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 03:30:56.345239 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 03:30:56.345239 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 03:30:56.346118 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 03:30:56.346118 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:56.346118 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:56.346118 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:56.346118 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:56.346118 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:56.346118 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:56.346118 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:56.346118 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:56.346118 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:56.346118 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:56.346118 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:56.346118 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:56.346118 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:56.346118 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:56.346118 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:56.346118 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:56.347034 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 03:30:56.347034 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 03:30:56.347034 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 03:30:56.347034 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 03:30:56.347034 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 03:30:56.347034 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 03:30:56.347034 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:30:56.347034 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:56.347034 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 289/569] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:30:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:56.347691 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6547918-2783-405b-92ca-53899f44a236 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:56.347915 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6547918-2783-405b-92ca-53899f44a236 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:56.348164 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6547918-2783-405b-92ca-53899f44a236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:56.364138 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e6547918-2783-405b-92ca-53899f44a236 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:56.365308 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e6547918-2783-405b-92ca-53899f44a236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:56.392366 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:56.414818 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dee1ef-49a7-4e7a-a28a-42e820da863b None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:56.430816 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 290/570] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:30:56.431616 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6547918-2783-405b-92ca-53899f44a236 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:56.459349 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed913a-242b-4135-954e-2e76732a1481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:56.460656 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed913a-242b-4135-954e-2e76732a1481 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:56.460945 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed913a-242b-4135-954e-2e76732a1481 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:56.461224 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed913a-242b-4135-954e-2e76732a1481 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:56.472291 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afed913a-242b-4135-954e-2e76732a1481 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:56.473766 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afed913a-242b-4135-954e-2e76732a1481 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:56.491734 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-afed913a-242b-4135-954e-2e76732a1481 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:30:56.491734 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:56.491734 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:56.491734 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:56.491734 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:56.491734 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:56.491734 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:56.491734 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:56.491734 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:56.491734 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:56.491734 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:56.491734 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:56.491734 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:30:56.491734 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:30:56.491734 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:30:56.492807 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:30:56.492807 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:56.492807 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:56.492807 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:56.492807 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:56.492807 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:56.492807 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:56.492807 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:56.492807 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:56.492807 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:56.492807 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:56.492807 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:56.492807 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:56.492807 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:56.492807 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:56.492807 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:56.492807 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:56.493834 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:30:56.493834 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:30:56.493834 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:30:56.493834 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:30:56.493834 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 281/571] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:30:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:56.493834 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed913a-242b-4135-954e-2e76732a1481 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:56.517419 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:56.532380 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6547918-2783-405b-92ca-53899f44a236 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:56.576331 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7740408d-2147-4082-a261-ebf98b2b7757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:56.577252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7740408d-2147-4082-a261-ebf98b2b7757 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:56.577639 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7740408d-2147-4082-a261-ebf98b2b7757 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:56.577913 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7740408d-2147-4082-a261-ebf98b2b7757 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:56.588532 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7740408d-2147-4082-a261-ebf98b2b7757 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:56.589983 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7740408d-2147-4082-a261-ebf98b2b7757 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:56.593683 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed913a-242b-4135-954e-2e76732a1481 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:56.607356 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-7740408d-2147-4082-a261-ebf98b2b7757 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:30:56.607356 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:56.607356 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:56.607356 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:56.607356 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:56.607356 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:56.607356 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:56.607356 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:56.607356 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:56.607356 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:56.607356 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:56.607356 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:56.607356 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:30:56.607356 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:30:56.607356 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:30:56.608402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:30:56.608402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:56.608402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:56.608402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:56.608402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:56.608402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:56.608402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:56.608402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:56.608402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:56.608402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:56.608402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:56.608402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:56.608402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:56.608402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:56.608402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:56.608402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:56.608402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:56.609380 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:30:56.609380 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:30:56.609380 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:30:56.609380 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:56.609380 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 291/572] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:30:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:56.609380 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7740408d-2147-4082-a261-ebf98b2b7757 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:56.628499 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:56.632105 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc3985-187b-419f-8131-b0e5ceaf2f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:56.632766 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc3985-187b-419f-8131-b0e5ceaf2f2e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:56.633058 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc3985-187b-419f-8131-b0e5ceaf2f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:56.633339 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc3985-187b-419f-8131-b0e5ceaf2f2e None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:56.634082 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc3985-187b-419f-8131-b0e5ceaf2f2e None admin] RBAC: Adding query filter params (name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:56.634396 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc3985-187b-419f-8131-b0e5ceaf2f2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:56.635859 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc3985-187b-419f-8131-b0e5ceaf2f2e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:56.643717 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 282/573] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jul 21 03:30:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:56.644487 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc3985-187b-419f-8131-b0e5ceaf2f2e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:56.714031 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7740408d-2147-4082-a261-ebf98b2b7757 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:56.732718 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:56.748399 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc3985-187b-419f-8131-b0e5ceaf2f2e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:56.749241 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929e3b2-eb91-49e6-a45f-47a3d9d98a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:56.749908 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929e3b2-eb91-49e6-a45f-47a3d9d98a92 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:56.750198 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929e3b2-eb91-49e6-a45f-47a3d9d98a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:56.750505 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929e3b2-eb91-49e6-a45f-47a3d9d98a92 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:56.751307 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3929e3b2-eb91-49e6-a45f-47a3d9d98a92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:56.751621 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3929e3b2-eb91-49e6-a45f-47a3d9d98a92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:56.753051 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3929e3b2-eb91-49e6-a45f-47a3d9d98a92 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:56.765101 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 292/574] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 03:30:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:56.765904 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929e3b2-eb91-49e6-a45f-47a3d9d98a92 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:56.787633 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad303c-1fff-4d7b-bc20-ca30f80926cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:56.788384 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad303c-1fff-4d7b-bc20-ca30f80926cd None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:56.788669 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad303c-1fff-4d7b-bc20-ca30f80926cd None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:56.788943 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad303c-1fff-4d7b-bc20-ca30f80926cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:56.800625 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ad303c-1fff-4d7b-bc20-ca30f80926cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:56.808389 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-52ad303c-1fff-4d7b-bc20-ca30f80926cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 03:30:56.808389 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:56.808389 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:56.808389 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:56.808389 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:56.808389 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:56.808389 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:56.808389 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:56.808389 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:56.808389 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:56.808389 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:56.808389 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:56.808389 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:56.808389 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:56.808389 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:56.808389 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:56.809495 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:56.809495 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:56.809495 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:56.809495 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:56.809495 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:56.809495 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:56.809495 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:56.809495 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:56.809495 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:56.809495 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:56.809495 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:56.809495 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:56.809495 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:56.809495 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:56.809495 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:56.809495 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:56.810542 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:56.810542 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:56.810542 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:56.810542 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:56.810542 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:56.810542 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:56.810542 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:56.810542 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:56.810542 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:56.810542 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:56.810542 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 03:30:56.810542 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:30:56.810542 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 283/575] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jul 21 03:30:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:56.810542 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad303c-1fff-4d7b-bc20-ca30f80926cd None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:56.848457 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:56.870249 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929e3b2-eb91-49e6-a45f-47a3d9d98a92 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:56.903520 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782436e-9ae0-48b2-9390-0f0370f0865e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:56.904169 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782436e-9ae0-48b2-9390-0f0370f0865e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:56.904452 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782436e-9ae0-48b2-9390-0f0370f0865e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:56.904734 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f782436e-9ae0-48b2-9390-0f0370f0865e None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:56.905446 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f782436e-9ae0-48b2-9390-0f0370f0865e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:56.905753 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f782436e-9ae0-48b2-9390-0f0370f0865e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:56.907145 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f782436e-9ae0-48b2-9390-0f0370f0865e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:56.913978 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad303c-1fff-4d7b-bc20-ca30f80926cd None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:56.918424 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 293/576] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:56.919212 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782436e-9ae0-48b2-9390-0f0370f0865e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:56.947567 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748633c-df94-455e-942c-ac1490fa8df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:56.948231 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748633c-df94-455e-942c-ac1490fa8df3 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:56.948517 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748633c-df94-455e-942c-ac1490fa8df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:56.948793 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748633c-df94-455e-942c-ac1490fa8df3 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:56.949519 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8748633c-df94-455e-942c-ac1490fa8df3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:56.949827 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8748633c-df94-455e-942c-ac1490fa8df3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:56.951234 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8748633c-df94-455e-942c-ac1490fa8df3 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:56.963207 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 284/577] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:56.963988 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748633c-df94-455e-942c-ac1490fa8df3 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:56.970536 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:57.016675 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f782436e-9ae0-48b2-9390-0f0370f0865e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:57.051085 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9df0c-3feb-4e8b-8250-54fc8352a0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:57.051797 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9df0c-3feb-4e8b-8250-54fc8352a0ed None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:57.052080 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9df0c-3feb-4e8b-8250-54fc8352a0ed None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:57.052357 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9df0c-3feb-4e8b-8250-54fc8352a0ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:57.058839 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:57.063077 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a9df0c-3feb-4e8b-8250-54fc8352a0ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:57.064772 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a9df0c-3feb-4e8b-8250-54fc8352a0ed None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:57.068293 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8748633c-df94-455e-942c-ac1490fa8df3 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:57.082282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-f7a9df0c-3feb-4e8b-8250-54fc8352a0ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:30:57.082282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:57.082282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:57.082282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:57.082282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:57.082282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:57.082282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:57.082282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:57.082282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:57.082282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:57.082282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:57.082282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:57.082282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:30:57.082282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:30:57.082282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:30:57.083213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:30:57.083213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:57.083213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:57.083213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:57.083213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:57.083213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:57.083213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:57.083213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:57.083213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:57.083213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:57.083213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:57.083213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:57.083213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:57.083213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:57.083213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:57.083213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:57.083213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:57.084107 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:30:57.084107 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:30:57.084107 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:30:57.084107 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:57.084849 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 294/578] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:30:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:57.086288 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9df0c-3feb-4e8b-8250-54fc8352a0ed None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:57.109947 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead310b2-8a7d-4582-8151-9f3fa64f127d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:57.110650 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead310b2-8a7d-4582-8151-9f3fa64f127d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:57.110934 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead310b2-8a7d-4582-8151-9f3fa64f127d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:57.111209 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead310b2-8a7d-4582-8151-9f3fa64f127d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:57.112042 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead310b2-8a7d-4582-8151-9f3fa64f127d None admin] RBAC: Adding query filter params (role.id=3d204e16b7214bf29bde33739ca9006a, scope.project.id=0432303daa8b4304a8e07032d6a80781, user.id=ce8bc228892e45c0a7d1b529c2f9a8f2) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:57.112354 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead310b2-8a7d-4582-8151-9f3fa64f127d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:57.113792 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead310b2-8a7d-4582-8151-9f3fa64f127d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:57.119657 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 285/579] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:30:56 2022] GET /identity/v3/role_assignments?user.id=ce8bc228892e45c0a7d1b529c2f9a8f2&scope.project.id=0432303daa8b4304a8e07032d6a80781&role.id=3d204e16b7214bf29bde33739ca9006a => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:57.120516 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead310b2-8a7d-4582-8151-9f3fa64f127d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:57.195959 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:57.211828 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9df0c-3feb-4e8b-8250-54fc8352a0ed None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:57.235467 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead310b2-8a7d-4582-8151-9f3fa64f127d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:57.249261 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d555b-1651-4005-8852-75fbed5c261b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:57.249945 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d555b-1651-4005-8852-75fbed5c261b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:57.250231 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d555b-1651-4005-8852-75fbed5c261b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:57.250560 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d555b-1651-4005-8852-75fbed5c261b None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:57.251651 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248d555b-1651-4005-8852-75fbed5c261b None admin] RBAC: Adding query filter params (name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:57.251651 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248d555b-1651-4005-8852-75fbed5c261b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:57.253026 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248d555b-1651-4005-8852-75fbed5c261b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:57.264373 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 295/580] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jul 21 03:30:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:57.266213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d555b-1651-4005-8852-75fbed5c261b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:57.274539 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ae00f-5c1f-4d9e-9e5c-4137a11d1b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:57.275659 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ae00f-5c1f-4d9e-9e5c-4137a11d1b10 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:57.275659 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ae00f-5c1f-4d9e-9e5c-4137a11d1b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:57.275945 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ae00f-5c1f-4d9e-9e5c-4137a11d1b10 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:57.284787 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ae00f-5c1f-4d9e-9e5c-4137a11d1b10 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:57.286270 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ae00f-5c1f-4d9e-9e5c-4137a11d1b10 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:57.301612 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-780ae00f-5c1f-4d9e-9e5c-4137a11d1b10 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 03:30:57.301612 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:57.301612 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:57.301612 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:57.301612 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:57.301612 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:57.301612 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:57.301612 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:57.301612 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:57.301612 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:57.301612 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:57.301612 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:57.301612 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 03:30:57.301612 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 03:30:57.301612 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 03:30:57.301612 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 03:30:57.302594 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:57.302594 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:57.302594 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 03:30:57.302594 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:30:57.302594 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 03:30:57.302594 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:30:57.302594 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:57.302594 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:57.302594 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:57.302594 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:57.302594 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:57.302594 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:57.302594 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:57.302594 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:57.302594 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:57.302594 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:57.302594 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:57.302594 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:57.304066 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:57.304066 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:57.304066 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 03:30:57.304066 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 03:30:57.304066 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 03:30:57.304066 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 03:30:57.304066 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 03:30:57.304066 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 03:30:57.304066 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 03:30:57.304066 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:30:57.304066 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 286/581] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:30:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:57.304066 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ae00f-5c1f-4d9e-9e5c-4137a11d1b10 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:57.329124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:57.380996 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d555b-1651-4005-8852-75fbed5c261b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:57.410430 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ae00f-5c1f-4d9e-9e5c-4137a11d1b10 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:57.415840 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d102a85-8bcc-457e-9958-47dd5641c4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:57.416645 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d102a85-8bcc-457e-9958-47dd5641c4ec None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:57.416932 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d102a85-8bcc-457e-9958-47dd5641c4ec None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:57.417208 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d102a85-8bcc-457e-9958-47dd5641c4ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:57.424338 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d102a85-8bcc-457e-9958-47dd5641c4ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:57.425787 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d102a85-8bcc-457e-9958-47dd5641c4ec None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:57.438165 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:57.442209 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-5d102a85-8bcc-457e-9958-47dd5641c4ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:30:57.442209 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:57.442209 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:57.442209 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:57.442209 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:57.442209 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:57.442209 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:57.442209 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:57.442209 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:57.442209 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:57.442209 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:57.442209 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:57.442209 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 03:30:57.442209 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 03:30:57.442209 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 03:30:57.443235 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 03:30:57.443235 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:57.443235 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:57.443235 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:57.443235 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:57.443235 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:57.443235 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:57.443235 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:57.443235 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:57.443235 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:57.443235 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:57.443235 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:57.443235 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:57.443235 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:57.443235 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:57.443235 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:57.443235 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:57.444107 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 03:30:57.444107 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 03:30:57.444107 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 03:30:57.444107 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 03:30:57.444107 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 03:30:57.444107 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 03:30:57.444107 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:30:57.444107 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:57.444107 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 296/582] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:30:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:57.444597 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d102a85-8bcc-457e-9958-47dd5641c4ec None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:57.452686 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6503a-c2ce-49e2-9318-9f55324b524d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:57.453365 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6503a-c2ce-49e2-9318-9f55324b524d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:57.453654 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6503a-c2ce-49e2-9318-9f55324b524d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:57.453930 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6503a-c2ce-49e2-9318-9f55324b524d None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:57.454761 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d6503a-c2ce-49e2-9318-9f55324b524d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:57.455071 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d6503a-c2ce-49e2-9318-9f55324b524d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:57.456453 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d6503a-c2ce-49e2-9318-9f55324b524d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:57.468583 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 287/583] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:30:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:57.469620 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6503a-c2ce-49e2-9318-9f55324b524d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:57.557404 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d102a85-8bcc-457e-9958-47dd5641c4ec None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:57.571983 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:57.579404 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6503a-c2ce-49e2-9318-9f55324b524d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:57.595724 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cced960c-3f44-4a76-b563-cf5ebb9482c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:57.596641 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced960c-3f44-4a76-b563-cf5ebb9482c9 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:57.596927 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced960c-3f44-4a76-b563-cf5ebb9482c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:57.597323 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced960c-3f44-4a76-b563-cf5ebb9482c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:57.610555 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cced960c-3f44-4a76-b563-cf5ebb9482c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:57.612307 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cced960c-3f44-4a76-b563-cf5ebb9482c9 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:57.614033 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75e9f3-077b-4396-b006-c4a135fc4b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:57.614737 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75e9f3-077b-4396-b006-c4a135fc4b95 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:57.615027 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75e9f3-077b-4396-b006-c4a135fc4b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:57.615309 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e75e9f3-077b-4396-b006-c4a135fc4b95 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:57.616701 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e75e9f3-077b-4396-b006-c4a135fc4b95 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:57.617017 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e75e9f3-077b-4396-b006-c4a135fc4b95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:57.618438 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e75e9f3-077b-4396-b006-c4a135fc4b95 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:57.635401 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-cced960c-3f44-4a76-b563-cf5ebb9482c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:30:57.635401 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:57.635401 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:57.635401 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:57.635401 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:57.635401 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:57.635401 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:57.635401 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:57.635401 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:57.635401 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:57.635401 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:57.635401 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:57.635401 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:30:57.635401 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:30:57.635401 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:30:57.636302 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:30:57.636302 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:57.636302 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:57.636302 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:57.636302 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:57.636302 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:57.636302 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:57.636302 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:57.636302 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:57.636302 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:57.636302 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:57.636302 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:57.636302 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:57.636302 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:57.636302 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:57.636302 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:57.636302 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:57.637172 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:30:57.637172 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:30:57.637172 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:30:57.637172 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:57.637386 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 288/584] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Jul 21 03:30:57 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:57.637386 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75e9f3-077b-4396-b006-c4a135fc4b95 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:57.640720 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 297/585] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:30:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:57.641552 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cced960c-3f44-4a76-b563-cf5ebb9482c9 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:57.698709 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:57.748228 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e75e9f3-077b-4396-b006-c4a135fc4b95 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:57.753340 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cced960c-3f44-4a76-b563-cf5ebb9482c9 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:57.784488 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ac8c2-d160-433d-8609-71af6f67f39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:57.785248 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ac8c2-d160-433d-8609-71af6f67f39d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:57.785540 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ac8c2-d160-433d-8609-71af6f67f39d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:57.785970 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ac8c2-d160-433d-8609-71af6f67f39d None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:57.786630 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ac8c2-d160-433d-8609-71af6f67f39d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:57.786948 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ac8c2-d160-433d-8609-71af6f67f39d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:57.789039 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ac8c2-d160-433d-8609-71af6f67f39d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:57.791416 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c1f9e-415b-499d-9d49-5d96eb5953e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:57.792212 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c1f9e-415b-499d-9d49-5d96eb5953e4 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:57.792495 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c1f9e-415b-499d-9d49-5d96eb5953e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:57.792772 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c1f9e-415b-499d-9d49-5d96eb5953e4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:57.800615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c1f9e-415b-499d-9d49-5d96eb5953e4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:57.801399 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 289/586] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 03:30:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:57.802042 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c1f9e-415b-499d-9d49-5d96eb5953e4 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:57.807247 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ac8c2-d160-433d-8609-71af6f67f39d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:57.817244 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-161c1f9e-415b-499d-9d49-5d96eb5953e4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 03:30:57.817244 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:57.817244 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:57.817244 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:57.817244 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:57.817244 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:57.817244 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:57.817244 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:57.817244 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:57.817244 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:57.817244 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:57.817244 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:57.817244 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 03:30:57.817244 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 03:30:57.817244 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 03:30:57.817244 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 03:30:57.818182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:57.818182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:57.818182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 03:30:57.818182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:30:57.818182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 03:30:57.818182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:30:57.818182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:57.818182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:57.818182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:57.818182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:57.818182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:57.818182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:57.818182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:57.818182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:57.818182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:57.818182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:57.818182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:57.818182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:57.819976 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:57.819976 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:57.819976 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 03:30:57.819976 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 03:30:57.819976 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 03:30:57.819976 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 03:30:57.819976 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 03:30:57.819976 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 03:30:57.819976 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 03:30:57.819976 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:57.819976 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 298/587] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Jul 21 03:30:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:57.819976 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c1f9e-415b-499d-9d49-5d96eb5953e4 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:57.846932 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:57.921920 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ac8c2-d160-433d-8609-71af6f67f39d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:57.928285 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c1f9e-415b-499d-9d49-5d96eb5953e4 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:57.929277 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:57.957620 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d427e8-92f2-4914-90d5-ca23dcdbec49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:57.958402 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d427e8-92f2-4914-90d5-ca23dcdbec49 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:57.958707 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d427e8-92f2-4914-90d5-ca23dcdbec49 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:57.958986 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d427e8-92f2-4914-90d5-ca23dcdbec49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:57.969446 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18185f5-a98f-4113-a4a3-4d93d35f2133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:57.970043 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d427e8-92f2-4914-90d5-ca23dcdbec49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:57.970148 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18185f5-a98f-4113-a4a3-4d93d35f2133 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:57.970374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18185f5-a98f-4113-a4a3-4d93d35f2133 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:57.970689 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18185f5-a98f-4113-a4a3-4d93d35f2133 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:57.971414 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18185f5-a98f-4113-a4a3-4d93d35f2133 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:57.971565 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d427e8-92f2-4914-90d5-ca23dcdbec49 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:57.971725 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18185f5-a98f-4113-a4a3-4d93d35f2133 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:57.973170 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18185f5-a98f-4113-a4a3-4d93d35f2133 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:57.990035 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 299/588] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:30:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:57.990974 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18185f5-a98f-4113-a4a3-4d93d35f2133 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:57.991097 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-07d427e8-92f2-4914-90d5-ca23dcdbec49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:30:57.991097 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:57.991097 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:57.991097 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:57.991097 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:57.991097 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:57.991097 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:57.991097 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:57.991097 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:57.991097 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:57.991097 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:57.991097 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:57.991097 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:30:57.991097 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:30:57.991097 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:30:57.991925 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:30:57.991925 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:57.991925 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:57.991925 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:57.991925 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:57.991925 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:57.991925 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:57.991925 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:57.991925 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:57.991925 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:57.991925 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:57.991925 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:57.991925 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:57.991925 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:57.991925 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:57.991925 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:57.991925 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:57.997856 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:30:57.997856 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:30:57.997856 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:30:57.997856 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:30:57.997856 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 290/589] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:30:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:57.997856 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d427e8-92f2-4914-90d5-ca23dcdbec49 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:58.082851 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:58.099557 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18185f5-a98f-4113-a4a3-4d93d35f2133 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:58.105031 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d427e8-92f2-4914-90d5-ca23dcdbec49 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:58.134553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497f985-422a-4cd9-a16c-f510602ac42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:58.135437 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497f985-422a-4cd9-a16c-f510602ac42f None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:58.135721 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497f985-422a-4cd9-a16c-f510602ac42f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:58.135994 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497f985-422a-4cd9-a16c-f510602ac42f None admin] PATH_INFO: `/v3/projects/0432303daa8b4304a8e07032d6a80781/users/a567cddc98164bd39317a245626d0f5d/roles/3d204e16b7214bf29bde33739ca9006a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:58.142839 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1adc8c-f38c-4400-a36e-37b50438ab2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:58.143847 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1adc8c-f38c-4400-a36e-37b50438ab2e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:58.144285 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1adc8c-f38c-4400-a36e-37b50438ab2e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:58.144712 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1adc8c-f38c-4400-a36e-37b50438ab2e None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:58.146611 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1adc8c-f38c-4400-a36e-37b50438ab2e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:58.147864 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1adc8c-f38c-4400-a36e-37b50438ab2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:58.150193 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1adc8c-f38c-4400-a36e-37b50438ab2e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:58.152893 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497f985-422a-4cd9-a16c-f510602ac42f None admin] RBAC: Authorizing `identity:create_grant(project_id=0432303daa8b4304a8e07032d6a80781, user_id=a567cddc98164bd39317a245626d0f5d, role_id=3d204e16b7214bf29bde33739ca9006a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:58.154479 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497f985-422a-4cd9-a16c-f510602ac42f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:58.170496 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 300/590] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 03:30:57 2022] PUT /identity/v3/projects/0432303daa8b4304a8e07032d6a80781/users/a567cddc98164bd39317a245626d0f5d/roles/3d204e16b7214bf29bde33739ca9006a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:30:58.170496 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497f985-422a-4cd9-a16c-f510602ac42f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:58.174268 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 291/591] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Jul 21 03:30:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:58.175559 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1adc8c-f38c-4400-a36e-37b50438ab2e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:58.204449 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:58.310369 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1adc8c-f38c-4400-a36e-37b50438ab2e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:58.321682 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497f985-422a-4cd9-a16c-f510602ac42f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:58.348852 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477fb998-a88e-4d1e-a8e5-777f39475c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:58.349530 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fb998-a88e-4d1e-a8e5-777f39475c92 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:58.349820 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fb998-a88e-4d1e-a8e5-777f39475c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:58.350103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fb998-a88e-4d1e-a8e5-777f39475c92 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:58.351449 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477fb998-a88e-4d1e-a8e5-777f39475c92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:58.351858 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477fb998-a88e-4d1e-a8e5-777f39475c92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:58.353150 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477fb998-a88e-4d1e-a8e5-777f39475c92 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:58.364324 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d09ac9-14ba-4a89-a001-50f4580d835d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:58.365198 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d09ac9-14ba-4a89-a001-50f4580d835d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:58.365551 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d09ac9-14ba-4a89-a001-50f4580d835d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:58.365896 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d09ac9-14ba-4a89-a001-50f4580d835d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:58.368562 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:58.369141 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 292/592] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:30:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:58.370319 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477fb998-a88e-4d1e-a8e5-777f39475c92 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:58.374291 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d09ac9-14ba-4a89-a001-50f4580d835d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:58.375778 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d09ac9-14ba-4a89-a001-50f4580d835d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:58.392739 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-88d09ac9-14ba-4a89-a001-50f4580d835d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 03:30:58.392739 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:58.392739 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:58.392739 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:58.392739 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:58.392739 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:58.392739 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:58.392739 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:58.392739 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:58.392739 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:58.392739 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:58.392739 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:58.392739 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 03:30:58.392739 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 03:30:58.392739 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 03:30:58.392739 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 03:30:58.393942 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:58.393942 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:58.393942 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 03:30:58.393942 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:30:58.393942 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 03:30:58.393942 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:30:58.393942 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:58.393942 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:58.393942 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:58.393942 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:58.393942 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:58.393942 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:58.393942 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:58.393942 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:58.393942 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:58.393942 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:58.393942 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:58.393942 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:58.395163 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:58.395163 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:58.395163 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 03:30:58.395163 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 03:30:58.395163 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 03:30:58.395163 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 03:30:58.395163 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 03:30:58.395163 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 03:30:58.395163 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 03:30:58.395163 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:58.396474 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 301/593] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jul 21 03:30:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:58.398365 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d09ac9-14ba-4a89-a001-50f4580d835d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:58.481547 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:58.515964 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d09ac9-14ba-4a89-a001-50f4580d835d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:58.519030 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477fb998-a88e-4d1e-a8e5-777f39475c92 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:58.553007 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd8620-f0b8-42ab-bde3-f18c62047c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:58.554726 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd8620-f0b8-42ab-bde3-f18c62047c83 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:58.555399 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd8620-f0b8-42ab-bde3-f18c62047c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:58.555760 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd8620-f0b8-42ab-bde3-f18c62047c83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:58.565136 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59486b55-2f6c-4b33-98c1-a631ea41e57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:58.565935 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59486b55-2f6c-4b33-98c1-a631ea41e57a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:58.566217 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59486b55-2f6c-4b33-98c1-a631ea41e57a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:58.566513 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd8620-f0b8-42ab-bde3-f18c62047c83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:58.566641 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59486b55-2f6c-4b33-98c1-a631ea41e57a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:58.568425 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd8620-f0b8-42ab-bde3-f18c62047c83 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:58.577842 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59486b55-2f6c-4b33-98c1-a631ea41e57a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:58.579339 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59486b55-2f6c-4b33-98c1-a631ea41e57a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:58.584254 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-34dd8620-f0b8-42ab-bde3-f18c62047c83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:30:58.584254 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:58.584254 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:58.584254 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:58.584254 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:58.584254 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:58.584254 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:58.584254 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:58.584254 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:58.584254 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:58.584254 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:58.584254 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:58.584254 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 03:30:58.584254 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 03:30:58.584254 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 03:30:58.585659 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 03:30:58.585659 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:58.585659 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:58.585659 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:58.585659 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:58.585659 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:58.585659 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:58.585659 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:58.585659 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:58.585659 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:58.585659 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:58.585659 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:58.585659 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:58.585659 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:58.585659 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:58.585659 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:58.585659 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:58.586570 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 03:30:58.586570 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 03:30:58.586570 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 03:30:58.586570 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 03:30:58.586570 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 03:30:58.586570 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 03:30:58.586570 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:30:58.586570 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:58.589130 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 302/594] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:30:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:58.590133 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd8620-f0b8-42ab-bde3-f18c62047c83 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:58.597921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-59486b55-2f6c-4b33-98c1-a631ea41e57a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:30:58.597921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:58.597921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:58.597921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:58.597921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:58.597921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:58.597921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:58.597921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:58.597921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:58.597921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:58.597921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:58.597921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:58.597921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:30:58.597921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:30:58.597921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:30:58.598839 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:30:58.598839 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:58.598839 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:58.598839 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:58.598839 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:58.598839 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:58.598839 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:58.598839 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:58.598839 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:58.598839 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:58.598839 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:58.598839 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:58.598839 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:58.598839 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:58.598839 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:58.598839 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:58.598839 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:58.599789 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:30:58.599789 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:30:58.599789 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:30:58.599789 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:30:58.604435 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 293/595] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:30:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:58.605461 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59486b55-2f6c-4b33-98c1-a631ea41e57a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:58.656048 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:58.713781 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59486b55-2f6c-4b33-98c1-a631ea41e57a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:58.717864 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd8620-f0b8-42ab-bde3-f18c62047c83 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:58.741967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:58.756824 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d3ed0-f0b8-4524-bb4d-678c6b579fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:58.757975 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d3ed0-f0b8-4524-bb4d-678c6b579fde None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:58.758448 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d3ed0-f0b8-4524-bb4d-678c6b579fde None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:58.758904 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d3ed0-f0b8-4524-bb4d-678c6b579fde None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:58.759999 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2d3ed0-f0b8-4524-bb4d-678c6b579fde None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:58.760135 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d0056-1a43-465c-935f-f496a286fa72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:58.760596 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2d3ed0-f0b8-4524-bb4d-678c6b579fde None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:58.761003 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d0056-1a43-465c-935f-f496a286fa72 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:58.761384 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d0056-1a43-465c-935f-f496a286fa72 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:58.761786 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74d0056-1a43-465c-935f-f496a286fa72 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:58.762695 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2d3ed0-f0b8-4524-bb4d-678c6b579fde None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:58.762881 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d0056-1a43-465c-935f-f496a286fa72 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:58.763290 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d0056-1a43-465c-935f-f496a286fa72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:58.764885 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74d0056-1a43-465c-935f-f496a286fa72 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:58.780071 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 294/596] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 03:30:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:58.781154 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d3ed0-f0b8-4524-bb4d-678c6b579fde None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:58.788798 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 303/597] 10.222.0.20 () {56 vars in 1139 bytes} [Thu Jul 21 03:30:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:58.789946 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d0056-1a43-465c-935f-f496a286fa72 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:58.894366 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d3ed0-f0b8-4524-bb4d-678c6b579fde None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:58.911186 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74d0056-1a43-465c-935f-f496a286fa72 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:58.926734 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:58.931261 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b7385-5fec-4ced-ba3e-9185c44b861f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:58.932060 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b7385-5fec-4ced-ba3e-9185c44b861f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:58.932450 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b7385-5fec-4ced-ba3e-9185c44b861f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:58.932828 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b7385-5fec-4ced-ba3e-9185c44b861f None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:58.933666 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b7385-5fec-4ced-ba3e-9185c44b861f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:58.934076 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b7385-5fec-4ced-ba3e-9185c44b861f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:58.935636 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b7385-5fec-4ced-ba3e-9185c44b861f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:58.949826 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 295/598] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:30:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:58.951277 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b7385-5fec-4ced-ba3e-9185c44b861f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:58.956259 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac98bd-b405-496f-9e0c-22d793d083ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:58.958083 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac98bd-b405-496f-9e0c-22d793d083ea None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:58.958491 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac98bd-b405-496f-9e0c-22d793d083ea None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:58.958892 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac98bd-b405-496f-9e0c-22d793d083ea None admin] PATH_INFO: `/v3/projects/0432303daa8b4304a8e07032d6a80781/users/03f2ad420185421c97d5bc06be965bd9/roles/3d204e16b7214bf29bde33739ca9006a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:58.978828 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cac98bd-b405-496f-9e0c-22d793d083ea None admin] RBAC: Authorizing `identity:create_grant(project_id=0432303daa8b4304a8e07032d6a80781, user_id=03f2ad420185421c97d5bc06be965bd9, role_id=3d204e16b7214bf29bde33739ca9006a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:58.980906 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cac98bd-b405-496f-9e0c-22d793d083ea None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:58.998741 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 304/599] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 03:30:58 2022] PUT /identity/v3/projects/0432303daa8b4304a8e07032d6a80781/users/03f2ad420185421c97d5bc06be965bd9/roles/3d204e16b7214bf29bde33739ca9006a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:30:58.999772 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac98bd-b405-496f-9e0c-22d793d083ea None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:59.012947 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:59.093222 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b7385-5fec-4ced-ba3e-9185c44b861f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:59.165591 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f80a2e-ef34-475d-a883-da7bc7055a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:59.167453 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f80a2e-ef34-475d-a883-da7bc7055a2c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:59.167836 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f80a2e-ef34-475d-a883-da7bc7055a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:59.168224 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f80a2e-ef34-475d-a883-da7bc7055a2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:59.183292 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f80a2e-ef34-475d-a883-da7bc7055a2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:59.185260 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f80a2e-ef34-475d-a883-da7bc7055a2c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:59.197924 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac98bd-b405-496f-9e0c-22d793d083ea None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:59.212929 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-b1f80a2e-ef34-475d-a883-da7bc7055a2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:30:59.212929 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:59.212929 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:59.212929 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:59.212929 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:59.212929 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:59.212929 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:59.212929 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:59.212929 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:59.212929 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:59.212929 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:59.212929 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:59.212929 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:30:59.212929 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:30:59.212929 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:30:59.214046 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:30:59.214046 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:59.214046 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:59.214046 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:59.214046 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:59.214046 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:59.214046 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:59.214046 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:59.214046 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:59.214046 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:59.214046 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:59.214046 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:59.214046 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:59.214046 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:59.214046 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:59.214046 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:59.214046 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:59.215171 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:30:59.215171 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:30:59.215171 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:30:59.215171 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:30:59.217056 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 296/600] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:30:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:59.218439 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11423252-06ed-49b1-b952-8936571a05dd None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:59.218932 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11423252-06ed-49b1-b952-8936571a05dd None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:59.219357 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11423252-06ed-49b1-b952-8936571a05dd None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:59.221018 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 297/601] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:30:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:30:59.226900 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11423252-06ed-49b1-b952-8936571a05dd None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:59.239439 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2cedec-3f59-408e-96d6-566dce7d31b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:59.240359 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2cedec-3f59-408e-96d6-566dce7d31b6 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:59.240523 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2cedec-3f59-408e-96d6-566dce7d31b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:59.240795 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2cedec-3f59-408e-96d6-566dce7d31b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:59.247973 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2cedec-3f59-408e-96d6-566dce7d31b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:59.249404 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2cedec-3f59-408e-96d6-566dce7d31b6 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:59.270799 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-3b2cedec-3f59-408e-96d6-566dce7d31b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:30:59.270799 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:59.270799 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:59.270799 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:59.270799 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:59.270799 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:59.270799 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:59.270799 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:59.270799 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:59.270799 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:59.270799 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:59.270799 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:59.270799 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 03:30:59.270799 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 03:30:59.270799 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 03:30:59.271724 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 03:30:59.271724 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:59.271724 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:59.271724 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:59.271724 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:59.271724 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:59.271724 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:59.271724 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:59.271724 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:59.271724 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:59.271724 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:59.271724 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:59.271724 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:59.271724 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:59.271724 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:59.271724 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:59.271724 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:59.273432 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 03:30:59.273432 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 03:30:59.273432 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 03:30:59.273432 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 03:30:59.273432 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 03:30:59.273432 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 03:30:59.273432 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:30:59.273432 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:59.275958 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 305/602] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:30:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:59.280758 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf8145-8512-4483-87b9-304b54cd2924 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:59.280758 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf8145-8512-4483-87b9-304b54cd2924 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:59.280758 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf8145-8512-4483-87b9-304b54cd2924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:59.303325 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-ebbf8145-8512-4483-87b9-304b54cd2924 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:30:59.305547 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ebbf8145-8512-4483-87b9-304b54cd2924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:30:59.329135 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:59.347908 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:59.352334 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11423252-06ed-49b1-b952-8936571a05dd None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:59.397489 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c52f21-f4c4-4ae5-9cbe-d94e9a77cd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:59.398341 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c52f21-f4c4-4ae5-9cbe-d94e9a77cd26 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:59.398819 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c52f21-f4c4-4ae5-9cbe-d94e9a77cd26 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:59.399192 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c52f21-f4c4-4ae5-9cbe-d94e9a77cd26 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:59.400023 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c52f21-f4c4-4ae5-9cbe-d94e9a77cd26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:59.400427 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c52f21-f4c4-4ae5-9cbe-d94e9a77cd26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:59.401153 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 306/603] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:30:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:30:59.402238 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf8145-8512-4483-87b9-304b54cd2924 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:59.407817 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c52f21-f4c4-4ae5-9cbe-d94e9a77cd26 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:59.433172 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 298/604] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:59.438242 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c52f21-f4c4-4ae5-9cbe-d94e9a77cd26 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:59.535317 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf8145-8512-4483-87b9-304b54cd2924 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:59.550676 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c52f21-f4c4-4ae5-9cbe-d94e9a77cd26 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:59.584434 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99bd701-bedc-44ce-ad56-b9f2334f0496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:59.585378 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99bd701-bedc-44ce-ad56-b9f2334f0496 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:59.585673 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99bd701-bedc-44ce-ad56-b9f2334f0496 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:59.585960 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99bd701-bedc-44ce-ad56-b9f2334f0496 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:59.586862 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99bd701-bedc-44ce-ad56-b9f2334f0496 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:59.587271 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99bd701-bedc-44ce-ad56-b9f2334f0496 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:59.588043 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36213c20-da40-4d2b-ad5c-2070aa6c25f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:59.588715 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99bd701-bedc-44ce-ad56-b9f2334f0496 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:59.589276 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36213c20-da40-4d2b-ad5c-2070aa6c25f9 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:59.589760 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36213c20-da40-4d2b-ad5c-2070aa6c25f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:59.590231 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36213c20-da40-4d2b-ad5c-2070aa6c25f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:59.597723 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36213c20-da40-4d2b-ad5c-2070aa6c25f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:59.599461 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36213c20-da40-4d2b-ad5c-2070aa6c25f9 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:59.603004 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 307/605] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 03:30:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:30:59.603835 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99bd701-bedc-44ce-ad56-b9f2334f0496 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:59.614373 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-36213c20-da40-4d2b-ad5c-2070aa6c25f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:30:59.614373 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:59.614373 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:59.614373 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:59.614373 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:59.614373 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:59.614373 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:59.614373 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:59.614373 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:59.614373 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:59.614373 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:59.614373 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:59.614373 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 03:30:59.614373 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 03:30:59.614373 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 03:30:59.615347 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 03:30:59.615347 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:59.615347 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:59.615347 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:59.615347 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:59.615347 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:59.615347 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:59.615347 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:59.615347 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:59.615347 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:59.615347 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:59.615347 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:59.615347 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:59.615347 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:59.615347 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:59.615347 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:59.615347 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:59.616805 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 03:30:59.616805 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 03:30:59.616805 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 03:30:59.616805 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 03:30:59.616805 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 03:30:59.616805 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 03:30:59.616805 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:30:59.616805 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:30:59.619332 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 299/606] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:30:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:59.620330 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36213c20-da40-4d2b-ad5c-2070aa6c25f9 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:59.624145 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:59.645952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:59.739057 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99bd701-bedc-44ce-ad56-b9f2334f0496 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:59.748564 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36213c20-da40-4d2b-ad5c-2070aa6c25f9 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:59.785164 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc8976-ba90-46ae-97f1-08bca6aaa710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:59.786065 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc8976-ba90-46ae-97f1-08bca6aaa710 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:59.786359 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc8976-ba90-46ae-97f1-08bca6aaa710 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:59.786623 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae397e-1245-421b-8da8-e73278379996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:59.786750 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc8976-ba90-46ae-97f1-08bca6aaa710 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:59.788472 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae397e-1245-421b-8da8-e73278379996 None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:59.789003 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae397e-1245-421b-8da8-e73278379996 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:59.789482 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae397e-1245-421b-8da8-e73278379996 None admin] PATH_INFO: `/v3/projects/0432303daa8b4304a8e07032d6a80781/users/cefbe2d0c739428ab0d4dfeaed6c37ab/roles/3d204e16b7214bf29bde33739ca9006a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:59.800276 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc8976-ba90-46ae-97f1-08bca6aaa710 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:30:59.806877 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae397e-1245-421b-8da8-e73278379996 None admin] RBAC: Authorizing `identity:create_grant(project_id=0432303daa8b4304a8e07032d6a80781, user_id=cefbe2d0c739428ab0d4dfeaed6c37ab, role_id=3d204e16b7214bf29bde33739ca9006a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:59.808622 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae397e-1245-421b-8da8-e73278379996 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:59.810182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-8dbc8976-ba90-46ae-97f1-08bca6aaa710 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 03:30:59.810182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:30:59.810182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:30:59.810182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:30:59.810182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:30:59.810182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:30:59.810182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:30:59.810182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:30:59.810182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:30:59.810182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:30:59.810182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:30:59.810182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:30:59.810182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:30:59.810182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:30:59.810182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:30:59.810182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:30:59.811124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:30:59.811124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:30:59.811124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:30:59.811124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:30:59.811124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:30:59.811124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:30:59.811124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:30:59.811124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:30:59.811124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:30:59.811124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:30:59.811124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:30:59.811124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:30:59.811124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:30:59.811124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:30:59.811124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:30:59.811124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:30:59.811954 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:30:59.811954 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:30:59.811954 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:30:59.811954 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:30:59.811954 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:30:59.811954 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:30:59.811954 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:30:59.811954 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:30:59.811954 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:30:59.811954 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:30:59.811954 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 03:30:59.811954 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:30:59.814603 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 308/607] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jul 21 03:30:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:30:59.815621 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc8976-ba90-46ae-97f1-08bca6aaa710 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:59.832491 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 300/608] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 03:30:59 2022] PUT /identity/v3/projects/0432303daa8b4304a8e07032d6a80781/users/cefbe2d0c739428ab0d4dfeaed6c37ab/roles/3d204e16b7214bf29bde33739ca9006a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:30:59.833769 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae397e-1245-421b-8da8-e73278379996 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:30:59.900227 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:59.935950 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc8976-ba90-46ae-97f1-08bca6aaa710 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:59.940264 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:30:59.976464 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8580e-edb9-4eb9-b582-2a667317f1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:30:59.977473 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8580e-edb9-4eb9-b582-2a667317f1eb None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:30:59.977982 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8580e-edb9-4eb9-b582-2a667317f1eb None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:30:59.978574 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed8580e-edb9-4eb9-b582-2a667317f1eb None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:30:59.979583 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed8580e-edb9-4eb9-b582-2a667317f1eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:30:59.980099 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed8580e-edb9-4eb9-b582-2a667317f1eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:30:59.981786 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed8580e-edb9-4eb9-b582-2a667317f1eb None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:30:59.983217 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae397e-1245-421b-8da8-e73278379996 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:30:59.996763 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 309/609] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 03:30:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:00.007514 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8580e-edb9-4eb9-b582-2a667317f1eb None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:00.034394 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07910b4-88ff-47fb-9f76-76620e581bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:00.035162 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07910b4-88ff-47fb-9f76-76620e581bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:00.035453 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07910b4-88ff-47fb-9f76-76620e581bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:00.035786 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07910b4-88ff-47fb-9f76-76620e581bc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:00.036559 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07910b4-88ff-47fb-9f76-76620e581bc1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:00.036874 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07910b4-88ff-47fb-9f76-76620e581bc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:00.039571 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07910b4-88ff-47fb-9f76-76620e581bc1 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:00.054248 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 301/610] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jul 21 03:30:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:00.057354 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07910b4-88ff-47fb-9f76-76620e581bc1 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:00.179206 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed8580e-edb9-4eb9-b582-2a667317f1eb None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:00.197717 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07910b4-88ff-47fb-9f76-76620e581bc1 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:00.218059 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac58aa3-5eca-40cc-bf51-9956ad848b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:00.219777 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac58aa3-5eca-40cc-bf51-9956ad848b9f None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:00.220543 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac58aa3-5eca-40cc-bf51-9956ad848b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:00.221038 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac58aa3-5eca-40cc-bf51-9956ad848b9f None admin] PATH_INFO: `/v3/projects/0432303daa8b4304a8e07032d6a80781/users/b68c257254de483ab65eb5dc5684a704/roles/3d204e16b7214bf29bde33739ca9006a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:00.222661 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:00.236502 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:00.247990 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac58aa3-5eca-40cc-bf51-9956ad848b9f None admin] RBAC: Authorizing `identity:create_grant(project_id=0432303daa8b4304a8e07032d6a80781, user_id=b68c257254de483ab65eb5dc5684a704, role_id=3d204e16b7214bf29bde33739ca9006a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:00.249398 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2633fd-e3ba-450b-a029-ea1f026d594b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:00.251763 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2633fd-e3ba-450b-a029-ea1f026d594b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:00.252202 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2633fd-e3ba-450b-a029-ea1f026d594b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:00.252644 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2633fd-e3ba-450b-a029-ea1f026d594b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:00.253606 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac58aa3-5eca-40cc-bf51-9956ad848b9f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:00.269331 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2633fd-e3ba-450b-a029-ea1f026d594b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:00.273686 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2633fd-e3ba-450b-a029-ea1f026d594b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:00.276479 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 310/611] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 03:31:00 2022] PUT /identity/v3/projects/0432303daa8b4304a8e07032d6a80781/users/b68c257254de483ab65eb5dc5684a704/roles/3d204e16b7214bf29bde33739ca9006a => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:31:00.310604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-7b2633fd-e3ba-450b-a029-ea1f026d594b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:00.310604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:00.310604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:00.310604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:00.310604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:00.310604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:00.310604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:00.310604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:00.310604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:00.310604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:00.310604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:00.310604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:00.310604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:31:00.310604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:31:00.310604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:31:00.311810 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:31:00.311810 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:00.311810 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:00.311810 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:00.311810 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:00.311810 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:00.311810 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:00.311810 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:00.311810 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:00.311810 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:00.311810 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:00.311810 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:00.311810 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:00.311810 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:00.311810 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:00.311810 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:00.311810 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:00.312932 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:31:00.312932 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:31:00.312932 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:00.312932 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:00.319033 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 302/612] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:00.324910 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac58aa3-5eca-40cc-bf51-9956ad848b9f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:00.379331 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335f0e5-6713-4374-a509-401277374592 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:00.379858 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335f0e5-6713-4374-a509-401277374592 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:00.380145 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335f0e5-6713-4374-a509-401277374592 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:00.382603 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 303/613] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:31:00.387889 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a385e-531d-4b4b-a63a-7ff14c7ff190 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:00.388316 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a385e-531d-4b4b-a63a-7ff14c7ff190 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:00.388697 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a385e-531d-4b4b-a63a-7ff14c7ff190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:00.410026 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-1c2a385e-531d-4b4b-a63a-7ff14c7ff190 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:00.411443 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1c2a385e-531d-4b4b-a63a-7ff14c7ff190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:00.509172 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac58aa3-5eca-40cc-bf51-9956ad848b9f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:00.510619 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 304/614] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:31:00.546541 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74069e-6dda-401b-93ae-9763ed2cd12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:00.547499 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74069e-6dda-401b-93ae-9763ed2cd12c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:00.547935 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74069e-6dda-401b-93ae-9763ed2cd12c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:00.548369 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74069e-6dda-401b-93ae-9763ed2cd12c None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:00.549252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e74069e-6dda-401b-93ae-9763ed2cd12c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:00.549713 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e74069e-6dda-401b-93ae-9763ed2cd12c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:00.551826 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a385e-531d-4b4b-a63a-7ff14c7ff190 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:00.554644 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e74069e-6dda-401b-93ae-9763ed2cd12c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:00.568983 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 311/615] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:31:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:00.575115 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74069e-6dda-401b-93ae-9763ed2cd12c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:00.638726 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:00.688321 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a385e-531d-4b4b-a63a-7ff14c7ff190 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:00.705963 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:00.731075 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58075e1f-ad0f-46da-adf7-1f134596ded3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:00.731908 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58075e1f-ad0f-46da-adf7-1f134596ded3 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:00.732197 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58075e1f-ad0f-46da-adf7-1f134596ded3 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:00.732479 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58075e1f-ad0f-46da-adf7-1f134596ded3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:00.744019 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58075e1f-ad0f-46da-adf7-1f134596ded3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:31:00.752117 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-58075e1f-ad0f-46da-adf7-1f134596ded3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 03:31:00.752117 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:00.752117 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:00.752117 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:00.752117 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:00.752117 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:00.752117 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:00.752117 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:00.752117 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:00.752117 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:00.752117 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:00.752117 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:00.752117 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:31:00.752117 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:31:00.752117 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:31:00.752117 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:31:00.753069 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:31:00.753069 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:31:00.753069 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:31:00.753069 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:31:00.753069 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:00.753069 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:00.753069 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:00.753069 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:00.753069 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:00.753069 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:00.753069 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:00.753069 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:00.753069 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:00.753069 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:00.753069 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:00.753069 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:00.753891 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:00.753891 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:00.753891 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:00.753891 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:00.753891 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:31:00.753891 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:31:00.753891 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:31:00.753891 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:31:00.753891 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:31:00.753891 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:31:00.753891 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 03:31:00.753891 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:00.754552 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74069e-6dda-401b-93ae-9763ed2cd12c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:00.758795 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 305/616] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jul 21 03:31:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:31:00.761256 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58075e1f-ad0f-46da-adf7-1f134596ded3 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:00.848074 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd482fc2-80cb-4cd1-9808-e51a687feaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:00.848881 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd482fc2-80cb-4cd1-9808-e51a687feaa2 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:00.849168 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd482fc2-80cb-4cd1-9808-e51a687feaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:00.849447 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd482fc2-80cb-4cd1-9808-e51a687feaa2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:00.857537 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd482fc2-80cb-4cd1-9808-e51a687feaa2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:00.859016 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd482fc2-80cb-4cd1-9808-e51a687feaa2 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:00.871695 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58075e1f-ad0f-46da-adf7-1f134596ded3 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:00.873874 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-cd482fc2-80cb-4cd1-9808-e51a687feaa2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 03:31:00.873874 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:00.873874 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:00.873874 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:00.873874 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:00.873874 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:00.873874 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:00.873874 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:00.873874 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:00.873874 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:00.873874 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:00.873874 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:00.873874 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 03:31:00.873874 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 03:31:00.873874 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 03:31:00.873874 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 03:31:00.874827 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:00.874827 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:00.874827 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 03:31:00.874827 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:31:00.874827 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 03:31:00.874827 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:31:00.874827 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:00.874827 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:00.874827 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:00.874827 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:00.874827 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:00.874827 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:00.874827 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:00.874827 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:00.874827 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:00.874827 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:00.874827 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:00.874827 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:00.875765 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:00.875765 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:00.875765 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 03:31:00.875765 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 03:31:00.875765 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 03:31:00.875765 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 03:31:00.875765 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 03:31:00.875765 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 03:31:00.875765 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 03:31:00.875765 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:00.875765 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 312/617] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 03:31:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:31:00.887491 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd482fc2-80cb-4cd1-9808-e51a687feaa2 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:00.909424 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45da92-5f10-4342-8d68-7954209381f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:00.910206 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45da92-5f10-4342-8d68-7954209381f4 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:00.910518 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45da92-5f10-4342-8d68-7954209381f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:00.910800 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45da92-5f10-4342-8d68-7954209381f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:00.911556 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45da92-5f10-4342-8d68-7954209381f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:00.911865 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45da92-5f10-4342-8d68-7954209381f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:00.913413 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45da92-5f10-4342-8d68-7954209381f4 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:00.926581 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 306/618] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jul 21 03:31:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:31:00.927916 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45da92-5f10-4342-8d68-7954209381f4 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:00.973877 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:01.020122 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd482fc2-80cb-4cd1-9808-e51a687feaa2 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:01.021580 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:01.055440 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45da92-5f10-4342-8d68-7954209381f4 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:01.056802 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e0053-3c06-4237-a08f-757b903d5c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:01.057479 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e0053-3c06-4237-a08f-757b903d5c18 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:01.057766 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e0053-3c06-4237-a08f-757b903d5c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:01.058047 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e0053-3c06-4237-a08f-757b903d5c18 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:01.058926 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e0053-3c06-4237-a08f-757b903d5c18 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:01.059237 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e0053-3c06-4237-a08f-757b903d5c18 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:01.060665 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e0053-3c06-4237-a08f-757b903d5c18 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:01.080127 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 313/619] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Jul 21 03:31:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:01.086095 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e0053-3c06-4237-a08f-757b903d5c18 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:01.099398 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71874b25-ffb4-493a-ab7f-fbc935dbff00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:01.100220 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71874b25-ffb4-493a-ab7f-fbc935dbff00 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:01.101216 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71874b25-ffb4-493a-ab7f-fbc935dbff00 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:01.101500 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71874b25-ffb4-493a-ab7f-fbc935dbff00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:01.116315 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71874b25-ffb4-493a-ab7f-fbc935dbff00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:01.117798 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71874b25-ffb4-493a-ab7f-fbc935dbff00 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:01.145706 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-71874b25-ffb4-493a-ab7f-fbc935dbff00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:01.145706 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:01.145706 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:01.145706 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:01.145706 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:01.145706 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:01.145706 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:01.145706 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:01.145706 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:01.145706 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:01.145706 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:01.145706 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:01.145706 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:31:01.145706 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:31:01.145706 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:31:01.148616 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:31:01.148616 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:01.148616 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:01.148616 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:01.148616 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:01.148616 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:01.148616 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:01.148616 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:01.148616 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:01.148616 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:01.148616 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:01.148616 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:01.148616 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:01.148616 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:01.148616 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:01.148616 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:01.148616 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:01.154726 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:31:01.154726 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:31:01.154726 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:01.154726 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:01.155427 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 307/620] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:01.160867 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71874b25-ffb4-493a-ab7f-fbc935dbff00 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:01.198830 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e0053-3c06-4237-a08f-757b903d5c18 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:01.236214 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6534449d-dedb-44e2-8eea-b8c7695e3117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:01.237009 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534449d-dedb-44e2-8eea-b8c7695e3117 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:01.237291 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534449d-dedb-44e2-8eea-b8c7695e3117 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:01.237561 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534449d-dedb-44e2-8eea-b8c7695e3117 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:01.248892 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6534449d-dedb-44e2-8eea-b8c7695e3117 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:01.250433 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6534449d-dedb-44e2-8eea-b8c7695e3117 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:01.273477 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-6534449d-dedb-44e2-8eea-b8c7695e3117 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:01.273477 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:01.273477 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:01.273477 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:01.273477 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:01.273477 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:01.273477 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:01.273477 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:01.273477 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:01.273477 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:01.273477 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:01.273477 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:01.273477 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:31:01.273477 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:31:01.273477 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:31:01.275601 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:31:01.275601 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:01.275601 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:01.275601 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:01.275601 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:01.275601 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:01.275601 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:01.275601 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:01.275601 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:01.275601 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:01.275601 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:01.275601 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:01.275601 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:01.275601 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:01.275601 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:01.275601 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:01.275601 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:01.277749 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:31:01.277749 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:31:01.277749 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:01.277749 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:01.277749 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 314/621] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:01.284579 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6534449d-dedb-44e2-8eea-b8c7695e3117 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:01.286252 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:01.299903 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:01.313257 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71874b25-ffb4-493a-ab7f-fbc935dbff00 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:01.376521 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8615f-9871-4c30-aa9e-bcab938b95c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:01.377199 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8615f-9871-4c30-aa9e-bcab938b95c7 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:01.377486 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8615f-9871-4c30-aa9e-bcab938b95c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:01.377762 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8615f-9871-4c30-aa9e-bcab938b95c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:01.378544 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8615f-9871-4c30-aa9e-bcab938b95c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:01.378822 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8615f-9871-4c30-aa9e-bcab938b95c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:01.380210 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8615f-9871-4c30-aa9e-bcab938b95c7 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:01.402509 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 308/622] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:31:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:01.405945 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6534449d-dedb-44e2-8eea-b8c7695e3117 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:01.408406 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8615f-9871-4c30-aa9e-bcab938b95c7 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:01.448094 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7673e355-c0eb-45af-9c7c-c82906ae2175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:01.449161 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673e355-c0eb-45af-9c7c-c82906ae2175 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:01.449668 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673e355-c0eb-45af-9c7c-c82906ae2175 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:01.450157 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673e355-c0eb-45af-9c7c-c82906ae2175 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:01.451146 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7673e355-c0eb-45af-9c7c-c82906ae2175 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:01.451681 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7673e355-c0eb-45af-9c7c-c82906ae2175 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:01.453378 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7673e355-c0eb-45af-9c7c-c82906ae2175 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:01.467810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 315/623] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:31:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:01.473623 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e2792-fed2-441c-9770-edff8a993dbb None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:01.474361 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e2792-fed2-441c-9770-edff8a993dbb None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:01.474898 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e2792-fed2-441c-9770-edff8a993dbb None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:01.476564 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 316/624] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:31:01.477507 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e2792-fed2-441c-9770-edff8a993dbb None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:01.519091 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8615f-9871-4c30-aa9e-bcab938b95c7 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:01.555046 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae82593-3986-4bf8-8230-211e2fc87819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:01.555652 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae82593-3986-4bf8-8230-211e2fc87819 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:01.555944 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae82593-3986-4bf8-8230-211e2fc87819 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:01.556230 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae82593-3986-4bf8-8230-211e2fc87819 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:01.559708 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:01.564028 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae82593-3986-4bf8-8230-211e2fc87819 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:01.565556 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae82593-3986-4bf8-8230-211e2fc87819 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:01.581313 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-dae82593-3986-4bf8-8230-211e2fc87819 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 21 03:31:01.581313 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:01.581313 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:01.581313 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:01.581313 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:01.581313 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:01.581313 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:01.581313 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:01.581313 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:01.581313 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:01.581313 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:01.581313 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:01.581313 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 03:31:01.581313 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 03:31:01.581313 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 03:31:01.581313 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 03:31:01.582273 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:01.582273 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:01.582273 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 03:31:01.582273 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:31:01.582273 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 03:31:01.582273 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:31:01.582273 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:01.582273 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:01.582273 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:01.582273 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:01.582273 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:01.582273 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:01.582273 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:01.582273 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:01.582273 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:01.582273 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:01.582273 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:01.582273 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:01.583264 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:01.583264 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:01.583264 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 03:31:01.583264 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 03:31:01.583264 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 03:31:01.583264 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 03:31:01.583264 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 03:31:01.583264 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 03:31:01.583264 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 21 03:31:01.583264 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:01.583264 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 309/625] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:31:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:01.584346 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39819e7e-1d6d-42eb-8bae-f077c29e82da None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:01.584454 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39819e7e-1d6d-42eb-8bae-f077c29e82da None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:01.584777 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39819e7e-1d6d-42eb-8bae-f077c29e82da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:01.599070 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e2792-fed2-441c-9770-edff8a993dbb None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:01.602366 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-39819e7e-1d6d-42eb-8bae-f077c29e82da None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:01.603097 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-39819e7e-1d6d-42eb-8bae-f077c29e82da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:01.605122 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:01.646250 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d797e9-d846-4f12-9334-698541b74765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:01.647368 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d797e9-d846-4f12-9334-698541b74765 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:01.647671 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d797e9-d846-4f12-9334-698541b74765 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:01.647998 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d797e9-d846-4f12-9334-698541b74765 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:01.656691 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d797e9-d846-4f12-9334-698541b74765 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:01.658748 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d797e9-d846-4f12-9334-698541b74765 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:01.679374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-36d797e9-d846-4f12-9334-698541b74765 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:31:01.679374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:01.679374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:01.679374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:01.679374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:01.679374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:01.679374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:01.679374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:01.679374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:01.679374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:01.679374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:01.679374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:01.679374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 03:31:01.679374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 03:31:01.679374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 03:31:01.680278 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 03:31:01.680278 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:01.680278 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:01.680278 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:01.680278 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:01.680278 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:01.680278 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:01.680278 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:01.680278 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:01.680278 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:01.680278 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:01.680278 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:01.680278 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:01.680278 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:01.680278 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:01.680278 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:01.680278 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:01.681187 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 03:31:01.681187 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 03:31:01.681187 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 03:31:01.681187 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 03:31:01.681187 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 03:31:01.681187 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 03:31:01.681187 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:31:01.681187 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:01.689048 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 317/626] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:31:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:01.689048 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d797e9-d846-4f12-9334-698541b74765 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:01.704071 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 310/627] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:31:01.704071 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39819e7e-1d6d-42eb-8bae-f077c29e82da None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:01.807562 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d797e9-d846-4f12-9334-698541b74765 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:01.831153 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39819e7e-1d6d-42eb-8bae-f077c29e82da None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:01.842952 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:01.849494 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68a067-40f1-402b-97ee-f74923eb0274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:01.850572 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68a067-40f1-402b-97ee-f74923eb0274 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:01.851078 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68a067-40f1-402b-97ee-f74923eb0274 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:01.851646 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68a067-40f1-402b-97ee-f74923eb0274 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:01.852696 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68a067-40f1-402b-97ee-f74923eb0274 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:01.853282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68a067-40f1-402b-97ee-f74923eb0274 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:01.855134 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68a067-40f1-402b-97ee-f74923eb0274 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:01.868807 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7629ff-97ff-4855-8f6a-9976603a90d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:01.869478 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7629ff-97ff-4855-8f6a-9976603a90d0 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:01.869767 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7629ff-97ff-4855-8f6a-9976603a90d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:01.870048 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7629ff-97ff-4855-8f6a-9976603a90d0 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:01.870867 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7629ff-97ff-4855-8f6a-9976603a90d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:01.871180 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7629ff-97ff-4855-8f6a-9976603a90d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:01.872618 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7629ff-97ff-4855-8f6a-9976603a90d0 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:01.877379 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 318/628] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Jul 21 03:31:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:01.878575 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68a067-40f1-402b-97ee-f74923eb0274 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:01.879637 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:01.890751 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 311/629] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 03:31:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:01.891616 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7629ff-97ff-4855-8f6a-9976603a90d0 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:01.993173 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68a067-40f1-402b-97ee-f74923eb0274 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:01.993500 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7629ff-97ff-4855-8f6a-9976603a90d0 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:02.027683 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217a1cb-9e57-475c-96db-b6adbf723e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:02.028345 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217a1cb-9e57-475c-96db-b6adbf723e45 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:02.028639 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217a1cb-9e57-475c-96db-b6adbf723e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:02.028918 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7217a1cb-9e57-475c-96db-b6adbf723e45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:02.031652 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd497f9-a2a7-496f-a2aa-c1954be7974b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:02.032859 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd497f9-a2a7-496f-a2aa-c1954be7974b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:02.033433 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd497f9-a2a7-496f-a2aa-c1954be7974b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:02.033918 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd497f9-a2a7-496f-a2aa-c1954be7974b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:02.046144 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd497f9-a2a7-496f-a2aa-c1954be7974b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:31:02.055243 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-1dd497f9-a2a7-496f-a2aa-c1954be7974b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 03:31:02.055243 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:02.055243 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:02.055243 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:02.055243 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:02.055243 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:02.055243 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:02.055243 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:02.055243 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:02.055243 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:02.055243 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:02.055243 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:02.055243 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:31:02.055243 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:31:02.055243 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:31:02.055243 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:31:02.056167 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:31:02.056167 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:31:02.056167 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:31:02.056167 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:31:02.056167 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:02.056167 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:02.056167 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:02.056167 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:02.056167 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:02.056167 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:02.056167 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:02.056167 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:02.056167 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:02.056167 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:02.056167 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:02.056167 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:02.057006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:02.057006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:02.057006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:02.057006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:02.057006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:31:02.057006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:31:02.057006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:31:02.057006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:31:02.057006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:31:02.057006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:31:02.057006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 03:31:02.057006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:02.064397 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 319/630] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jul 21 03:31:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:02.065442 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd497f9-a2a7-496f-a2aa-c1954be7974b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:02.097429 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:02.101910 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7217a1cb-9e57-475c-96db-b6adbf723e45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:02.103415 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7217a1cb-9e57-475c-96db-b6adbf723e45 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:02.120944 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:02.173837 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd497f9-a2a7-496f-a2aa-c1954be7974b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:02.209937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e8af2-d35d-4618-895b-d8fe599b9627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:02.211270 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e8af2-d35d-4618-895b-d8fe599b9627 None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:02.211766 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e8af2-d35d-4618-895b-d8fe599b9627 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:02.212247 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e8af2-d35d-4618-895b-d8fe599b9627 None admin] PATH_INFO: `/v3/projects/0432303daa8b4304a8e07032d6a80781/users/ce8bc228892e45c0a7d1b529c2f9a8f2/roles/3d204e16b7214bf29bde33739ca9006a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:02.220953 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 312/631] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:31:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 03:31:02.221914 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217a1cb-9e57-475c-96db-b6adbf723e45 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:02.229170 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e8af2-d35d-4618-895b-d8fe599b9627 None admin] RBAC: Authorizing `identity:create_grant(project_id=0432303daa8b4304a8e07032d6a80781, user_id=ce8bc228892e45c0a7d1b529c2f9a8f2, role_id=3d204e16b7214bf29bde33739ca9006a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:02.230927 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0e8af2-d35d-4618-895b-d8fe599b9627 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:02.247191 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 320/632] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 03:31:02 2022] PUT /identity/v3/projects/0432303daa8b4304a8e07032d6a80781/users/ce8bc228892e45c0a7d1b529c2f9a8f2/roles/3d204e16b7214bf29bde33739ca9006a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:31:02.248957 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e8af2-d35d-4618-895b-d8fe599b9627 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:02.372813 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:02.376821 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0e8af2-d35d-4618-895b-d8fe599b9627 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:02.420826 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c40c6-7e24-4d01-9460-a7c55a206bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:02.421713 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c40c6-7e24-4d01-9460-a7c55a206bcd None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:02.422009 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c40c6-7e24-4d01-9460-a7c55a206bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:02.422291 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c40c6-7e24-4d01-9460-a7c55a206bcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:02.435571 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:02.437371 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c40c6-7e24-4d01-9460-a7c55a206bcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:02.439030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6c40c6-7e24-4d01-9460-a7c55a206bcd None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:02.441928 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7217a1cb-9e57-475c-96db-b6adbf723e45 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:02.462608 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-7f6c40c6-7e24-4d01-9460-a7c55a206bcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:02.462608 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:02.462608 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:02.462608 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:02.462608 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:02.462608 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:02.462608 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:02.462608 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:02.462608 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:02.462608 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:02.462608 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:02.462608 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:02.462608 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:31:02.462608 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:31:02.462608 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:31:02.463590 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:31:02.463590 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:02.463590 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:02.463590 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:02.463590 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:02.463590 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:02.463590 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:02.463590 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:02.463590 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:02.463590 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:02.463590 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:02.463590 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:02.463590 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:02.463590 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:02.463590 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:02.463590 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:02.463590 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:02.464494 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:31:02.464494 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:31:02.464494 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:02.464494 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:02.464494 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 321/633] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:02.471690 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c40c6-7e24-4d01-9460-a7c55a206bcd None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:02.525414 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b4bf6-de74-4764-bd21-4c92976ade81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:02.526582 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b4bf6-de74-4764-bd21-4c92976ade81 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:02.527127 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b4bf6-de74-4764-bd21-4c92976ade81 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:02.527613 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1b4bf6-de74-4764-bd21-4c92976ade81 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:02.528591 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b4bf6-de74-4764-bd21-4c92976ade81 None admin] RBAC: Adding query filter params (name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:02.529381 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b4bf6-de74-4764-bd21-4c92976ade81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:02.531760 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1b4bf6-de74-4764-bd21-4c92976ade81 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:02.549229 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 313/634] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jul 21 03:31:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:02.555547 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b4bf6-de74-4764-bd21-4c92976ade81 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:02.590425 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c40c6-7e24-4d01-9460-a7c55a206bcd None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:02.637971 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f872f-6511-4602-a0a0-8c7acb4a3bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:02.638581 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f872f-6511-4602-a0a0-8c7acb4a3bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:02.638868 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f872f-6511-4602-a0a0-8c7acb4a3bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:02.639142 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f872f-6511-4602-a0a0-8c7acb4a3bd9 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:02.640743 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82f872f-6511-4602-a0a0-8c7acb4a3bd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:02.641122 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82f872f-6511-4602-a0a0-8c7acb4a3bd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:02.642517 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82f872f-6511-4602-a0a0-8c7acb4a3bd9 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:02.662478 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 322/635] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:02.664591 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a7ba1-6c00-4290-8e35-5ff4f7a3ec64 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:02.664886 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a7ba1-6c00-4290-8e35-5ff4f7a3ec64 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:02.665163 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a7ba1-6c00-4290-8e35-5ff4f7a3ec64 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:02.667193 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 323/636] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:31:02.667832 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a7ba1-6c00-4290-8e35-5ff4f7a3ec64 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:02.676365 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1b4bf6-de74-4764-bd21-4c92976ade81 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:02.684308 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:02.724014 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3226cbc-ca2a-486b-8e02-f13c7474262d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:02.725072 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3226cbc-ca2a-486b-8e02-f13c7474262d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:02.725624 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3226cbc-ca2a-486b-8e02-f13c7474262d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:02.726142 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3226cbc-ca2a-486b-8e02-f13c7474262d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:02.737720 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3226cbc-ca2a-486b-8e02-f13c7474262d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:02.739572 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3226cbc-ca2a-486b-8e02-f13c7474262d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:02.758216 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-f3226cbc-ca2a-486b-8e02-f13c7474262d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:02.758216 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:02.758216 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:02.758216 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:02.758216 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:02.758216 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:02.758216 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:02.758216 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:02.758216 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:02.758216 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:02.758216 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:02.758216 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:02.758216 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:31:02.758216 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:31:02.758216 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:31:02.761252 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:31:02.761252 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:02.761252 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:02.761252 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:02.761252 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:02.761252 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:02.761252 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:02.761252 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:02.761252 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:02.761252 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:02.761252 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:02.761252 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:02.761252 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:02.761252 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:02.761252 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:02.761252 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:02.761252 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:02.763598 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:31:02.763598 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:31:02.763598 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:02.763598 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:02.763598 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 314/637] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:31:02.763598 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e8f28-35cd-4613-b38a-eb58ee9c6662 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:02.763598 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e8f28-35cd-4613-b38a-eb58ee9c6662 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:02.763598 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e8f28-35cd-4613-b38a-eb58ee9c6662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:02.779237 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-691e8f28-35cd-4613-b38a-eb58ee9c6662 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:02.779519 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a7ba1-6c00-4290-8e35-5ff4f7a3ec64 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:02.780423 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-691e8f28-35cd-4613-b38a-eb58ee9c6662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:02.788058 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:02.813398 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4dac9-e82e-4be6-b1ef-ceebea2a77ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:02.814204 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4dac9-e82e-4be6-b1ef-ceebea2a77ee None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:02.814674 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4dac9-e82e-4be6-b1ef-ceebea2a77ee None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:02.814796 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4dac9-e82e-4be6-b1ef-ceebea2a77ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:02.822308 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c4dac9-e82e-4be6-b1ef-ceebea2a77ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:02.823779 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c4dac9-e82e-4be6-b1ef-ceebea2a77ee None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:02.838775 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-12c4dac9-e82e-4be6-b1ef-ceebea2a77ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:31:02.838775 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:02.838775 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:02.838775 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:02.838775 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:02.838775 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:02.838775 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:02.838775 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:02.838775 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:02.838775 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:02.838775 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:02.838775 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:02.838775 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 03:31:02.838775 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 03:31:02.838775 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 03:31:02.839812 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 03:31:02.839812 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:02.839812 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:02.839812 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:02.839812 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:02.839812 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:02.839812 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:02.839812 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:02.839812 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:02.839812 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:02.839812 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:02.839812 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:02.839812 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:02.839812 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:02.839812 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:02.839812 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:02.839812 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:02.840711 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 03:31:02.840711 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 03:31:02.840711 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 03:31:02.840711 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 03:31:02.840711 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 03:31:02.840711 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 03:31:02.840711 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:31:02.840711 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:02.844552 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 324/638] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:31:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:31:02.845987 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e2c17-11ff-44b7-a235-0653e1b5a1c9 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:02.846274 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e2c17-11ff-44b7-a235-0653e1b5a1c9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:02.846581 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e2c17-11ff-44b7-a235-0653e1b5a1c9 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:02.850513 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 325/639] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:31:02.850513 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e2c17-11ff-44b7-a235-0653e1b5a1c9 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:02.865132 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 315/640] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:31:02.865995 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e8f28-35cd-4613-b38a-eb58ee9c6662 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:02.939293 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:02.972264 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e8f28-35cd-4613-b38a-eb58ee9c6662 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:02.972979 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e2c17-11ff-44b7-a235-0653e1b5a1c9 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:03.007279 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa6bb8-3e3d-464a-b7d9-7fd917d20d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:03.007953 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa6bb8-3e3d-464a-b7d9-7fd917d20d16 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:03.008242 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa6bb8-3e3d-464a-b7d9-7fd917d20d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:03.008531 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa6bb8-3e3d-464a-b7d9-7fd917d20d16 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:03.009318 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa6bb8-3e3d-464a-b7d9-7fd917d20d16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:03.009637 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa6bb8-3e3d-464a-b7d9-7fd917d20d16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:03.011109 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa6bb8-3e3d-464a-b7d9-7fd917d20d16 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:03.011738 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650598a-cae1-4b13-b1c3-0b7d73b5389a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:03.012789 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650598a-cae1-4b13-b1c3-0b7d73b5389a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:03.013276 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650598a-cae1-4b13-b1c3-0b7d73b5389a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:03.014099 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650598a-cae1-4b13-b1c3-0b7d73b5389a None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:03.015067 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5650598a-cae1-4b13-b1c3-0b7d73b5389a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:03.015588 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5650598a-cae1-4b13-b1c3-0b7d73b5389a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:03.017151 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5650598a-cae1-4b13-b1c3-0b7d73b5389a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:03.023710 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 316/641] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 03:31:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:03.024945 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442dd1c9-936b-4211-a404-5d7215b6c5b7 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:03.025239 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442dd1c9-936b-4211-a404-5d7215b6c5b7 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:03.025520 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442dd1c9-936b-4211-a404-5d7215b6c5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:03.031091 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:03.037826 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 326/642] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:03.038995 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650598a-cae1-4b13-b1c3-0b7d73b5389a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:03.044752 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-442dd1c9-936b-4211-a404-5d7215b6c5b7 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:03.045942 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-442dd1c9-936b-4211-a404-5d7215b6c5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:03.126488 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 317/643] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:31:03.126488 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442dd1c9-936b-4211-a404-5d7215b6c5b7 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:03.166274 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650598a-cae1-4b13-b1c3-0b7d73b5389a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:03.197154 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:03.203236 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee4038-028c-4270-95bc-1d9a4aa8854e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:03.204440 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee4038-028c-4270-95bc-1d9a4aa8854e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:03.205627 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee4038-028c-4270-95bc-1d9a4aa8854e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:03.206102 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee4038-028c-4270-95bc-1d9a4aa8854e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:03.219896 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee4038-028c-4270-95bc-1d9a4aa8854e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:31:03.228444 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-7aee4038-028c-4270-95bc-1d9a4aa8854e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 03:31:03.228444 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:03.228444 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:03.228444 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:03.228444 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:03.228444 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:03.228444 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:03.228444 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:03.228444 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:03.228444 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:03.228444 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:03.228444 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:03.228444 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:31:03.228444 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:31:03.228444 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:31:03.228444 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:31:03.229420 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:31:03.229420 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:31:03.229420 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:31:03.229420 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:31:03.229420 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:03.229420 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:03.229420 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:03.229420 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:03.229420 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:03.229420 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:03.229420 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:03.229420 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:03.229420 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:03.229420 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:03.229420 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:03.229420 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:03.230278 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:03.230278 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:03.230278 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:03.230278 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:03.230278 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:31:03.230278 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:31:03.230278 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:31:03.230278 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:31:03.230278 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:31:03.230278 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:31:03.230278 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 03:31:03.230278 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:03.230278 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 327/644] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jul 21 03:31:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:03.231025 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee4038-028c-4270-95bc-1d9a4aa8854e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:03.240373 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442dd1c9-936b-4211-a404-5d7215b6c5b7 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:03.272593 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:03.278350 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27a581-e79e-448e-baa2-95b938e448dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:03.279533 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27a581-e79e-448e-baa2-95b938e448dd None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:03.279984 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27a581-e79e-448e-baa2-95b938e448dd None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:03.280275 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27a581-e79e-448e-baa2-95b938e448dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:03.281126 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f27a581-e79e-448e-baa2-95b938e448dd None admin] RBAC: Adding query filter params (role.id=3d204e16b7214bf29bde33739ca9006a, scope.project.id=0432303daa8b4304a8e07032d6a80781, user.id=a567cddc98164bd39317a245626d0f5d) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:03.281448 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f27a581-e79e-448e-baa2-95b938e448dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:03.282962 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f27a581-e79e-448e-baa2-95b938e448dd None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:03.294501 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 318/645] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:31:03 2022] GET /identity/v3/role_assignments?user.id=a567cddc98164bd39317a245626d0f5d&scope.project.id=0432303daa8b4304a8e07032d6a80781&role.id=3d204e16b7214bf29bde33739ca9006a => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:03.294501 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27a581-e79e-448e-baa2-95b938e448dd None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:03.373753 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee4038-028c-4270-95bc-1d9a4aa8854e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:03.412229 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e954101-3309-4e17-9182-6c5f901422ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:03.413093 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e954101-3309-4e17-9182-6c5f901422ea None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:03.413384 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e954101-3309-4e17-9182-6c5f901422ea None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:03.413662 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e954101-3309-4e17-9182-6c5f901422ea None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:03.417637 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27a581-e79e-448e-baa2-95b938e448dd None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:03.422417 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e954101-3309-4e17-9182-6c5f901422ea None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:03.423943 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e954101-3309-4e17-9182-6c5f901422ea None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:03.441427 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-9e954101-3309-4e17-9182-6c5f901422ea None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 03:31:03.441427 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:03.441427 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:03.441427 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:03.441427 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:03.441427 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:03.441427 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:03.441427 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:03.441427 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:03.441427 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:03.441427 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:03.441427 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:03.441427 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 03:31:03.441427 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 03:31:03.441427 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 03:31:03.441427 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 03:31:03.442478 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:03.442478 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:03.442478 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 03:31:03.442478 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:31:03.442478 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 03:31:03.442478 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:31:03.442478 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:03.442478 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:03.442478 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:03.442478 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:03.442478 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:03.442478 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:03.442478 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:03.442478 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:03.442478 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:03.442478 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:03.442478 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:03.442478 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:03.443639 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:03.443639 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:03.443639 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 03:31:03.443639 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 03:31:03.443639 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 03:31:03.443639 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 03:31:03.443639 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 03:31:03.443639 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 03:31:03.443639 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 03:31:03.443639 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:03.443639 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 328/646] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:31:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:03.444842 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e954101-3309-4e17-9182-6c5f901422ea None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:03.470089 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd433ec8-4180-4e2f-9c06-39b2139ac903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:03.471589 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd433ec8-4180-4e2f-9c06-39b2139ac903 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:03.471886 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd433ec8-4180-4e2f-9c06-39b2139ac903 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:03.472174 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd433ec8-4180-4e2f-9c06-39b2139ac903 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:03.485656 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd433ec8-4180-4e2f-9c06-39b2139ac903 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:31:03.496560 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-cd433ec8-4180-4e2f-9c06-39b2139ac903 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 03:31:03.496560 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:03.496560 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:03.496560 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:03.496560 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:03.496560 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:03.496560 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:03.496560 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:03.496560 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:03.496560 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:03.496560 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:03.496560 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:03.496560 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:31:03.496560 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:31:03.496560 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:31:03.496560 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:31:03.497553 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:31:03.497553 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:31:03.497553 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:31:03.497553 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:31:03.497553 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:03.497553 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:03.497553 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:03.497553 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:03.497553 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:03.497553 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:03.497553 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:03.497553 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:03.497553 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:03.497553 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:03.497553 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:03.497553 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:03.498397 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:03.498397 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:03.498397 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:03.498397 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:03.498397 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:31:03.498397 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:31:03.498397 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:31:03.498397 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:31:03.498397 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:31:03.498397 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:31:03.498397 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 03:31:03.498397 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:03.498397 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 319/647] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jul 21 03:31:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:03.498397 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd433ec8-4180-4e2f-9c06-39b2139ac903 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:03.514708 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:03.566564 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:03.580048 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e954101-3309-4e17-9182-6c5f901422ea None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:03.625079 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216672cf-9ee9-4bee-8e41-2a9d0f743766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:03.626021 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216672cf-9ee9-4bee-8e41-2a9d0f743766 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:03.626451 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216672cf-9ee9-4bee-8e41-2a9d0f743766 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:03.626919 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216672cf-9ee9-4bee-8e41-2a9d0f743766 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:03.627267 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd433ec8-4180-4e2f-9c06-39b2139ac903 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:03.627961 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216672cf-9ee9-4bee-8e41-2a9d0f743766 None admin] RBAC: Adding query filter params (name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:03.628413 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216672cf-9ee9-4bee-8e41-2a9d0f743766 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:03.630827 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216672cf-9ee9-4bee-8e41-2a9d0f743766 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:03.643444 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 329/648] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jul 21 03:31:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:03.644609 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216672cf-9ee9-4bee-8e41-2a9d0f743766 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:03.674557 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cdb80f-995a-4bf2-9d75-a70eb8c7bc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:03.675300 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdb80f-995a-4bf2-9d75-a70eb8c7bc1b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:03.675840 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdb80f-995a-4bf2-9d75-a70eb8c7bc1b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:03.676180 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cdb80f-995a-4bf2-9d75-a70eb8c7bc1b None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:03.677463 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cdb80f-995a-4bf2-9d75-a70eb8c7bc1b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:03.677786 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cdb80f-995a-4bf2-9d75-a70eb8c7bc1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:03.680280 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cdb80f-995a-4bf2-9d75-a70eb8c7bc1b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:03.708518 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 320/649] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Jul 21 03:31:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:03.708518 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cdb80f-995a-4bf2-9d75-a70eb8c7bc1b None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:03.769472 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216672cf-9ee9-4bee-8e41-2a9d0f743766 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:03.784640 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:03.807597 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0a625-aec5-459e-9246-8ab398a79a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:03.808270 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0a625-aec5-459e-9246-8ab398a79a80 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:03.808560 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0a625-aec5-459e-9246-8ab398a79a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:03.808839 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0a625-aec5-459e-9246-8ab398a79a80 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:03.809703 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b0a625-aec5-459e-9246-8ab398a79a80 None admin] RBAC: Adding query filter params (name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:03.810019 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b0a625-aec5-459e-9246-8ab398a79a80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:03.811417 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b0a625-aec5-459e-9246-8ab398a79a80 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:03.824710 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 330/650] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jul 21 03:31:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:03.824710 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0a625-aec5-459e-9246-8ab398a79a80 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:03.827130 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cdb80f-995a-4bf2-9d75-a70eb8c7bc1b None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:03.844353 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:03.871657 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df12645b-c391-49be-a25d-b79bbcb2d018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:03.872459 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12645b-c391-49be-a25d-b79bbcb2d018 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:03.872747 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12645b-c391-49be-a25d-b79bbcb2d018 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:03.873026 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12645b-c391-49be-a25d-b79bbcb2d018 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:03.886473 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df12645b-c391-49be-a25d-b79bbcb2d018 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:03.888234 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df12645b-c391-49be-a25d-b79bbcb2d018 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:03.910130 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-df12645b-c391-49be-a25d-b79bbcb2d018 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:03.910130 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:03.910130 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:03.910130 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:03.910130 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:03.910130 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:03.910130 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:03.910130 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:03.910130 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:03.910130 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:03.910130 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:03.910130 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:03.910130 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:31:03.910130 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:31:03.910130 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:31:03.911059 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:31:03.911059 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:03.911059 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:03.911059 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:03.911059 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:03.911059 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:03.911059 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:03.911059 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:03.911059 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:03.911059 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:03.911059 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:03.911059 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:03.911059 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:03.911059 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:03.911059 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:03.911059 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:03.911059 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:03.911939 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:31:03.911939 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:31:03.911939 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:03.911939 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:03.915012 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 321/651] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:03.916066 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df12645b-c391-49be-a25d-b79bbcb2d018 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:03.952912 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0a625-aec5-459e-9246-8ab398a79a80 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:03.995847 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5a578-09ef-4506-97d2-ab74fc2669f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:03.996513 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5a578-09ef-4506-97d2-ab74fc2669f9 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:03.996869 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5a578-09ef-4506-97d2-ab74fc2669f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:03.997076 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5a578-09ef-4506-97d2-ab74fc2669f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:04.025249 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df12645b-c391-49be-a25d-b79bbcb2d018 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:04.048598 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:04.064403 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae8831-3012-42e8-b58c-b84478ad7b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:04.065565 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae8831-3012-42e8-b58c-b84478ad7b81 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:04.066058 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae8831-3012-42e8-b58c-b84478ad7b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:04.066671 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae8831-3012-42e8-b58c-b84478ad7b81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:04.074566 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b5a578-09ef-4506-97d2-ab74fc2669f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:04.076201 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b5a578-09ef-4506-97d2-ab74fc2669f9 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:04.078338 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae8831-3012-42e8-b58c-b84478ad7b81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:04.080120 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae8831-3012-42e8-b58c-b84478ad7b81 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:04.099716 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-a6ae8831-3012-42e8-b58c-b84478ad7b81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:04.099716 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:04.099716 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:04.099716 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:04.099716 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:04.099716 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:04.099716 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:04.099716 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:04.099716 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:04.099716 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:04.099716 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:04.099716 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:04.099716 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:31:04.099716 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:31:04.099716 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:31:04.101183 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:31:04.101183 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:04.101183 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:04.101183 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:04.101183 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:04.101183 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:04.101183 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:04.101183 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:04.101183 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:04.101183 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:04.101183 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:04.101183 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:04.101183 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:04.101183 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:04.101183 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:04.101183 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:04.101183 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:04.102077 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:31:04.102077 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:31:04.102077 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:04.102077 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:04.108781 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 322/652] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:04.110255 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae8831-3012-42e8-b58c-b84478ad7b81 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:04.130752 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:04.187529 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 331/653] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:31:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 03:31:04.188322 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5a578-09ef-4506-97d2-ab74fc2669f9 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:04.219832 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae8831-3012-42e8-b58c-b84478ad7b81 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:04.256249 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0eed36-aa16-4956-b4f5-e2d6f78a0996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:04.257991 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0eed36-aa16-4956-b4f5-e2d6f78a0996 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:04.259083 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0eed36-aa16-4956-b4f5-e2d6f78a0996 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:04.259568 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0eed36-aa16-4956-b4f5-e2d6f78a0996 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:04.260846 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0eed36-aa16-4956-b4f5-e2d6f78a0996 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:04.261353 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0eed36-aa16-4956-b4f5-e2d6f78a0996 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:04.263372 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0eed36-aa16-4956-b4f5-e2d6f78a0996 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:04.271327 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:04.282983 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 323/654] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:31:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:04.284043 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0eed36-aa16-4956-b4f5-e2d6f78a0996 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:04.301605 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5a578-09ef-4506-97d2-ab74fc2669f9 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:04.342325 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb779c-f20b-4df9-af9e-f7a1e47aaf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:04.343615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb779c-f20b-4df9-af9e-f7a1e47aaf8a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:04.344142 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb779c-f20b-4df9-af9e-f7a1e47aaf8a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:04.345044 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bb779c-f20b-4df9-af9e-f7a1e47aaf8a None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:04.346281 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb779c-f20b-4df9-af9e-f7a1e47aaf8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:04.347046 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb779c-f20b-4df9-af9e-f7a1e47aaf8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:04.349064 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bb779c-f20b-4df9-af9e-f7a1e47aaf8a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:04.370063 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 332/655] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:31:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:04.370063 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb779c-f20b-4df9-af9e-f7a1e47aaf8a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:04.385773 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:04.416860 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0eed36-aa16-4956-b4f5-e2d6f78a0996 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:04.463604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5edcf6-9c3d-425f-9252-9eb5edb118a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:04.464864 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5edcf6-9c3d-425f-9252-9eb5edb118a9 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:04.465359 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5edcf6-9c3d-425f-9252-9eb5edb118a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:04.465830 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5edcf6-9c3d-425f-9252-9eb5edb118a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:04.478164 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5edcf6-9c3d-425f-9252-9eb5edb118a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:04.478745 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bb779c-f20b-4df9-af9e-f7a1e47aaf8a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:04.481671 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5edcf6-9c3d-425f-9252-9eb5edb118a9 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:04.501024 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-3a5edcf6-9c3d-425f-9252-9eb5edb118a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:04.501024 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:04.501024 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:04.501024 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:04.501024 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:04.501024 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:04.501024 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:04.501024 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:04.501024 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:04.501024 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:04.501024 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:04.501024 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:04.501024 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:31:04.501024 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:31:04.501024 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:31:04.501935 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:31:04.501935 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:04.501935 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:04.501935 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:04.501935 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:04.501935 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:04.501935 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:04.501935 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:04.501935 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:04.501935 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:04.501935 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:04.501935 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:04.501935 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:04.501935 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:04.501935 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:04.501935 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:04.501935 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:04.502877 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:31:04.502877 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:31:04.502877 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:04.502877 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:04.507307 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 324/656] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:04.508141 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5edcf6-9c3d-425f-9252-9eb5edb118a9 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:04.516035 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5afe7ed-cd30-46ad-8876-568ecf7d8ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:04.517274 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afe7ed-cd30-46ad-8876-568ecf7d8ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:04.517575 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afe7ed-cd30-46ad-8876-568ecf7d8ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:04.517857 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afe7ed-cd30-46ad-8876-568ecf7d8ba1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:04.521589 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:04.528689 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5afe7ed-cd30-46ad-8876-568ecf7d8ba1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:04.530922 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5afe7ed-cd30-46ad-8876-568ecf7d8ba1 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:04.545848 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-f5afe7ed-cd30-46ad-8876-568ecf7d8ba1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 03:31:04.545848 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:04.545848 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:04.545848 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:04.545848 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:04.545848 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:04.545848 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:04.545848 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:04.545848 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:04.545848 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:04.545848 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:04.545848 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:04.545848 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 03:31:04.545848 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 03:31:04.545848 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 03:31:04.545848 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 03:31:04.547102 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:04.547102 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:04.547102 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 03:31:04.547102 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:31:04.547102 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 03:31:04.547102 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:31:04.547102 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:04.547102 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:04.547102 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:04.547102 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:04.547102 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:04.547102 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:04.547102 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:04.547102 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:04.547102 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:04.547102 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:04.547102 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:04.547102 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:04.548024 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:04.548024 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:04.548024 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 03:31:04.548024 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 03:31:04.548024 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 03:31:04.548024 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 03:31:04.548024 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 03:31:04.548024 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 03:31:04.548024 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 03:31:04.548024 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:04.551926 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 333/657] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Jul 21 03:31:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:04.553504 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fdbbfc-4dbd-4450-acb6-a68c738263ba None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:04.553801 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fdbbfc-4dbd-4450-acb6-a68c738263ba None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:04.554259 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fdbbfc-4dbd-4450-acb6-a68c738263ba None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:04.555685 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 334/658] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:31:04.556185 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fdbbfc-4dbd-4450-acb6-a68c738263ba None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:04.619805 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5edcf6-9c3d-425f-9252-9eb5edb118a9 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:04.649983 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:04.657931 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e0f99-0ae2-4cbc-aeca-cafdf220e0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:04.658760 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e0f99-0ae2-4cbc-aeca-cafdf220e0d8 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:04.659047 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e0f99-0ae2-4cbc-aeca-cafdf220e0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:04.659318 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e0f99-0ae2-4cbc-aeca-cafdf220e0d8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:04.664730 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fdbbfc-4dbd-4450-acb6-a68c738263ba None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:04.667037 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e0f99-0ae2-4cbc-aeca-cafdf220e0d8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:04.668506 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e0f99-0ae2-4cbc-aeca-cafdf220e0d8 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:04.684982 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-3c7e0f99-0ae2-4cbc-aeca-cafdf220e0d8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 03:31:04.684982 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:04.684982 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:04.684982 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:04.684982 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:04.684982 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:04.684982 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:04.684982 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:04.684982 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:04.684982 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:04.684982 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:04.684982 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:04.684982 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 03:31:04.684982 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 03:31:04.684982 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 03:31:04.684982 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 03:31:04.685966 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:04.685966 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:04.685966 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 03:31:04.685966 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:31:04.685966 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 03:31:04.685966 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:31:04.685966 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:04.685966 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:04.685966 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:04.685966 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:04.685966 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:04.685966 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:04.685966 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:04.685966 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:04.685966 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:04.685966 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:04.685966 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:04.685966 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:04.692021 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:04.692021 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:04.692021 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 03:31:04.692021 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 03:31:04.692021 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 03:31:04.692021 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 03:31:04.692021 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 03:31:04.692021 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 03:31:04.692021 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 03:31:04.692021 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:04.692021 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 325/659] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jul 21 03:31:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:04.692021 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e0f99-0ae2-4cbc-aeca-cafdf220e0d8 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:04.716061 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c9a85-942f-47a5-b205-ac94a0b5b9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:04.717101 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c9a85-942f-47a5-b205-ac94a0b5b9c7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:04.717810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c9a85-942f-47a5-b205-ac94a0b5b9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:04.718542 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c9a85-942f-47a5-b205-ac94a0b5b9c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:04.719573 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823c9a85-942f-47a5-b205-ac94a0b5b9c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:04.720038 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823c9a85-942f-47a5-b205-ac94a0b5b9c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:04.722064 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823c9a85-942f-47a5-b205-ac94a0b5b9c7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:04.736396 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 335/660] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:31:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:04.737856 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3589d1-b5fd-4f0b-86ac-8e42d8d075f5 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:04.738124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3589d1-b5fd-4f0b-86ac-8e42d8d075f5 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:04.738393 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3589d1-b5fd-4f0b-86ac-8e42d8d075f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:04.756053 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-bd3589d1-b5fd-4f0b-86ac-8e42d8d075f5 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:04.757830 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-bd3589d1-b5fd-4f0b-86ac-8e42d8d075f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:04.797301 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e0f99-0ae2-4cbc-aeca-cafdf220e0d8 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:04.809667 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:04.834516 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 336/661] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:31:04.834516 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3589d1-b5fd-4f0b-86ac-8e42d8d075f5 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:04.839934 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87f056-e036-4c48-a39f-572e9de6f30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:04.840614 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87f056-e036-4c48-a39f-572e9de6f30a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:04.840905 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87f056-e036-4c48-a39f-572e9de6f30a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:04.841190 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87f056-e036-4c48-a39f-572e9de6f30a None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:04.842034 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87f056-e036-4c48-a39f-572e9de6f30a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:04.842346 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87f056-e036-4c48-a39f-572e9de6f30a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:04.843825 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87f056-e036-4c48-a39f-572e9de6f30a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:04.861816 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 326/662] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Jul 21 03:31:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:04.862744 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87f056-e036-4c48-a39f-572e9de6f30a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:04.914486 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:04.952181 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3589d1-b5fd-4f0b-86ac-8e42d8d075f5 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:04.966181 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87f056-e036-4c48-a39f-572e9de6f30a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:04.987813 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c26ef2c-f9c6-475b-b90d-2e18f3244998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:04.988596 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26ef2c-f9c6-475b-b90d-2e18f3244998 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:04.988881 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26ef2c-f9c6-475b-b90d-2e18f3244998 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:04.989183 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c26ef2c-f9c6-475b-b90d-2e18f3244998 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:04.990088 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c26ef2c-f9c6-475b-b90d-2e18f3244998 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:04.990404 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c26ef2c-f9c6-475b-b90d-2e18f3244998 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:04.991991 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c26ef2c-f9c6-475b-b90d-2e18f3244998 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:05.000515 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffcc667-ddc3-400c-ab31-4937127c53e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:05.001320 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffcc667-ddc3-400c-ab31-4937127c53e2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:05.001605 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffcc667-ddc3-400c-ab31-4937127c53e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:05.001893 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffcc667-ddc3-400c-ab31-4937127c53e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:05.009180 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffcc667-ddc3-400c-ab31-4937127c53e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:05.010609 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 337/663] 10.222.0.20 () {56 vars in 1139 bytes} [Thu Jul 21 03:31:04 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:05.010722 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffcc667-ddc3-400c-ab31-4937127c53e2 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:05.011711 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c26ef2c-f9c6-475b-b90d-2e18f3244998 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:05.029728 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-0ffcc667-ddc3-400c-ab31-4937127c53e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:31:05.029728 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:05.029728 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:05.029728 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:05.029728 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:05.029728 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:05.029728 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:05.029728 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:05.029728 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:05.029728 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:05.029728 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:05.029728 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:05.029728 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 03:31:05.029728 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 03:31:05.029728 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 03:31:05.030778 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 03:31:05.030778 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:05.030778 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:05.030778 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:05.030778 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:05.030778 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:05.030778 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:05.030778 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:05.030778 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:05.030778 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:05.030778 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:05.030778 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:05.030778 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:05.030778 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:05.030778 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:05.030778 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:05.030778 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:05.031689 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 03:31:05.031689 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 03:31:05.031689 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 03:31:05.031689 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 03:31:05.031689 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 03:31:05.031689 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 03:31:05.031689 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:31:05.031689 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:05.031689 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 327/664] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:31:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:05.032170 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffcc667-ddc3-400c-ab31-4937127c53e2 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:05.067262 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:05.127309 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c26ef2c-f9c6-475b-b90d-2e18f3244998 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:05.139996 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffcc667-ddc3-400c-ab31-4937127c53e2 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:05.149741 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:05.165436 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0381fd54-17cb-4e98-9103-78b11c82fdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:05.166479 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381fd54-17cb-4e98-9103-78b11c82fdf7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:05.166861 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381fd54-17cb-4e98-9103-78b11c82fdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:05.167157 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0381fd54-17cb-4e98-9103-78b11c82fdf7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:05.176829 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c558c6-3ee3-42ff-8b68-afd48946b9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:05.177550 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c558c6-3ee3-42ff-8b68-afd48946b9db None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:05.177813 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c558c6-3ee3-42ff-8b68-afd48946b9db None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:05.178042 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c558c6-3ee3-42ff-8b68-afd48946b9db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:05.178255 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0381fd54-17cb-4e98-9103-78b11c82fdf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:31:05.186016 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-0381fd54-17cb-4e98-9103-78b11c82fdf7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 03:31:05.186016 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:05.186016 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:05.186016 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:05.186016 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:05.186016 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:05.186016 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:05.186016 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:05.186016 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:05.186016 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:05.186016 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:05.186016 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:05.186016 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:31:05.186016 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:31:05.186016 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:31:05.186016 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:31:05.186937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:31:05.186937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:31:05.186937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:31:05.186937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:31:05.186937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:05.186937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:05.186937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:05.186937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:05.186937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:05.186937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:05.186937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:05.186937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:05.186937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:05.186937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:05.186937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:05.186937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:05.187770 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:05.187770 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:05.187770 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:05.187770 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:05.187770 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:31:05.187770 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:31:05.187770 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:31:05.187770 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:31:05.187770 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:31:05.187770 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:31:05.187770 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 03:31:05.187770 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:05.192172 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 338/665] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jul 21 03:31:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:05.193354 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0381fd54-17cb-4e98-9103-78b11c82fdf7 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:05.247100 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c558c6-3ee3-42ff-8b68-afd48946b9db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:05.248568 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c558c6-3ee3-42ff-8b68-afd48946b9db None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:05.300251 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0381fd54-17cb-4e98-9103-78b11c82fdf7 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:05.302686 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:05.336799 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee9c640-ff73-4dba-8098-9094ce96c313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:05.337478 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9c640-ff73-4dba-8098-9094ce96c313 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:05.337744 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9c640-ff73-4dba-8098-9094ce96c313 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:05.338016 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9c640-ff73-4dba-8098-9094ce96c313 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:05.349421 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 328/666] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:31:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 03:31:05.349421 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c558c6-3ee3-42ff-8b68-afd48946b9db None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:05.362103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:05.416404 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee9c640-ff73-4dba-8098-9094ce96c313 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:05.418022 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee9c640-ff73-4dba-8098-9094ce96c313 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:05.457821 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c558c6-3ee3-42ff-8b68-afd48946b9db None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:05.493282 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1ec51-7ff1-4d9d-8347-e08cc38d56f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:05.493950 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1ec51-7ff1-4d9d-8347-e08cc38d56f0 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:05.494236 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1ec51-7ff1-4d9d-8347-e08cc38d56f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:05.494543 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1ec51-7ff1-4d9d-8347-e08cc38d56f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:05.495336 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca1ec51-7ff1-4d9d-8347-e08cc38d56f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:05.495648 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca1ec51-7ff1-4d9d-8347-e08cc38d56f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:05.497075 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca1ec51-7ff1-4d9d-8347-e08cc38d56f0 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:05.508948 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 329/667] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 03:31:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:05.509732 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1ec51-7ff1-4d9d-8347-e08cc38d56f0 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:05.521010 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 339/668] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:31:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 03:31:05.521699 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee9c640-ff73-4dba-8098-9094ce96c313 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:05.526421 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:05.578516 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:05.611996 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1ec51-7ff1-4d9d-8347-e08cc38d56f0 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:05.620056 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee9c640-ff73-4dba-8098-9094ce96c313 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:05.644866 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c84178-e7fc-44f7-81c5-927483f2a814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:05.645529 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c84178-e7fc-44f7-81c5-927483f2a814 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:05.645814 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c84178-e7fc-44f7-81c5-927483f2a814 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:05.646091 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c84178-e7fc-44f7-81c5-927483f2a814 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:05.646862 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c84178-e7fc-44f7-81c5-927483f2a814 None admin] RBAC: Adding query filter params (name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:05.647454 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c84178-e7fc-44f7-81c5-927483f2a814 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:05.648837 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c84178-e7fc-44f7-81c5-927483f2a814 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:05.654694 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd12da2-6fb8-491b-9f63-dd341c2621b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:05.655468 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd12da2-6fb8-491b-9f63-dd341c2621b0 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:05.655751 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd12da2-6fb8-491b-9f63-dd341c2621b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:05.656025 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd12da2-6fb8-491b-9f63-dd341c2621b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:05.656549 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 330/669] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jul 21 03:31:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:05.657733 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7bb63-7ce9-417c-8687-ff2e41c00115 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:05.658022 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7bb63-7ce9-417c-8687-ff2e41c00115 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:05.658306 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f7bb63-7ce9-417c-8687-ff2e41c00115 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:05.659712 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 331/670] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:31:05.660247 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7bb63-7ce9-417c-8687-ff2e41c00115 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:05.667178 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd12da2-6fb8-491b-9f63-dd341c2621b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:05.668628 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd12da2-6fb8-491b-9f63-dd341c2621b0 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:05.687059 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-edd12da2-6fb8-491b-9f63-dd341c2621b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:05.687059 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:05.687059 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:05.687059 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:05.687059 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:05.687059 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:05.687059 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:05.687059 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:05.687059 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:05.687059 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:05.687059 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:05.687059 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:05.687059 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:31:05.687059 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:31:05.687059 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:31:05.688917 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:31:05.688917 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:05.688917 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:05.688917 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:05.688917 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:05.688917 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:05.688917 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:05.688917 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:05.688917 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:05.688917 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:05.688917 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:05.688917 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:05.688917 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:05.688917 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:05.688917 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:05.688917 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:05.688917 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:05.690551 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:31:05.690551 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:31:05.690551 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:05.690551 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:05.690551 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 340/671] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:05.690551 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd12da2-6fb8-491b-9f63-dd341c2621b0 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:05.747327 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:05.769789 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f7bb63-7ce9-417c-8687-ff2e41c00115 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:05.789797 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd12da2-6fb8-491b-9f63-dd341c2621b0 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:05.797589 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:05.804103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3bf0ba-7cbc-479d-bd41-11c2e1a1088b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:05.804754 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bf0ba-7cbc-479d-bd41-11c2e1a1088b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:05.805034 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bf0ba-7cbc-479d-bd41-11c2e1a1088b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:05.805306 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bf0ba-7cbc-479d-bd41-11c2e1a1088b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:05.806132 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3bf0ba-7cbc-479d-bd41-11c2e1a1088b None admin] RBAC: Adding query filter params (role.id=3d204e16b7214bf29bde33739ca9006a, scope.project.id=0432303daa8b4304a8e07032d6a80781, user.id=03f2ad420185421c97d5bc06be965bd9) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:05.806444 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3bf0ba-7cbc-479d-bd41-11c2e1a1088b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:05.807927 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3bf0ba-7cbc-479d-bd41-11c2e1a1088b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:05.830503 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 332/672] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:31:05 2022] GET /identity/v3/role_assignments?user.id=03f2ad420185421c97d5bc06be965bd9&scope.project.id=0432303daa8b4304a8e07032d6a80781&role.id=3d204e16b7214bf29bde33739ca9006a => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:05.830503 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3bf0ba-7cbc-479d-bd41-11c2e1a1088b None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:05.830819 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6852d80-8b09-4aef-8ee8-53af04c4d4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:05.830819 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6852d80-8b09-4aef-8ee8-53af04c4d4d1 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:05.830819 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6852d80-8b09-4aef-8ee8-53af04c4d4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:05.830819 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6852d80-8b09-4aef-8ee8-53af04c4d4d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:05.837460 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6852d80-8b09-4aef-8ee8-53af04c4d4d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:05.838971 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6852d80-8b09-4aef-8ee8-53af04c4d4d1 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:05.858774 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-d6852d80-8b09-4aef-8ee8-53af04c4d4d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:05.858774 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:05.858774 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:05.858774 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:05.858774 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:05.858774 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:05.858774 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:05.858774 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:05.858774 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:05.858774 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:05.858774 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:05.858774 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:05.858774 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:31:05.858774 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:31:05.858774 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:31:05.859735 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:31:05.859735 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:05.859735 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:05.859735 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:05.859735 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:05.859735 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:05.859735 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:05.859735 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:05.859735 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:05.859735 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:05.859735 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:05.859735 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:05.859735 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:05.859735 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:05.859735 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:05.859735 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:05.859735 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:05.860609 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:31:05.860609 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:31:05.860609 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:05.860609 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:05.860609 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 341/673] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:05.861344 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012159e7-dac5-4683-b016-475924f335af None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:05.861605 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012159e7-dac5-4683-b016-475924f335af None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:05.861885 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012159e7-dac5-4683-b016-475924f335af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:05.880978 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-012159e7-dac5-4683-b016-475924f335af None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:05.882206 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-012159e7-dac5-4683-b016-475924f335af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:05.928210 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3bf0ba-7cbc-479d-bd41-11c2e1a1088b None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:05.957336 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 342/674] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:31:05.958042 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012159e7-dac5-4683-b016-475924f335af None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:05.983562 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb82a8d-56ec-475e-845d-f9925b901da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:05.984655 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb82a8d-56ec-475e-845d-f9925b901da4 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:05.984937 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb82a8d-56ec-475e-845d-f9925b901da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:05.985215 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb82a8d-56ec-475e-845d-f9925b901da4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:05.998092 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb82a8d-56ec-475e-845d-f9925b901da4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:05.999587 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb82a8d-56ec-475e-845d-f9925b901da4 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:06.005007 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:06.019318 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-edb82a8d-56ec-475e-845d-f9925b901da4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:06.019318 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:06.019318 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:06.019318 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:06.019318 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:06.019318 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:06.019318 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:06.019318 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:06.019318 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:06.019318 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:06.019318 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:06.019318 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:06.019318 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:31:06.019318 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:31:06.019318 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:31:06.020432 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:31:06.020432 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:06.020432 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:06.020432 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:06.020432 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:06.020432 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:06.020432 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:06.020432 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:06.020432 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:06.020432 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:06.020432 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:06.020432 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:06.020432 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:06.020432 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:06.020432 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:06.020432 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:06.020432 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:06.021408 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:31:06.021408 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:31:06.021408 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:06.021408 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:06.021408 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 333/675] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:06.021408 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb82a8d-56ec-475e-845d-f9925b901da4 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:06.069463 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:06.070952 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012159e7-dac5-4683-b016-475924f335af None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:06.108664 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be42b848-eb5f-49fb-bed0-c7a01df2414e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:06.109334 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be42b848-eb5f-49fb-bed0-c7a01df2414e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:06.109625 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be42b848-eb5f-49fb-bed0-c7a01df2414e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:06.110140 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be42b848-eb5f-49fb-bed0-c7a01df2414e None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:06.110659 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be42b848-eb5f-49fb-bed0-c7a01df2414e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:06.110974 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be42b848-eb5f-49fb-bed0-c7a01df2414e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:06.112349 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be42b848-eb5f-49fb-bed0-c7a01df2414e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:06.128775 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 343/676] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:31:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:06.128948 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb82a8d-56ec-475e-845d-f9925b901da4 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:06.129042 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be42b848-eb5f-49fb-bed0-c7a01df2414e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:06.159864 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291e800-8f39-4d6e-bcaf-fef91c9e92dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:06.160450 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291e800-8f39-4d6e-bcaf-fef91c9e92dd None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:06.160732 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291e800-8f39-4d6e-bcaf-fef91c9e92dd None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:06.161001 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291e800-8f39-4d6e-bcaf-fef91c9e92dd None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:06.161723 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f291e800-8f39-4d6e-bcaf-fef91c9e92dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:06.162029 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f291e800-8f39-4d6e-bcaf-fef91c9e92dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:06.163980 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f291e800-8f39-4d6e-bcaf-fef91c9e92dd None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:06.181367 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 334/677] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:06.181367 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291e800-8f39-4d6e-bcaf-fef91c9e92dd None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:06.236320 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:06.241087 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be42b848-eb5f-49fb-bed0-c7a01df2414e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:06.275940 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f6013-f942-4445-a121-0e5319c858e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:06.276986 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f6013-f942-4445-a121-0e5319c858e9 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:06.277426 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f6013-f942-4445-a121-0e5319c858e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:06.277708 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4f6013-f942-4445-a121-0e5319c858e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:06.286230 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291e800-8f39-4d6e-bcaf-fef91c9e92dd None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:06.288811 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f6013-f942-4445-a121-0e5319c858e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:06.290254 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4f6013-f942-4445-a121-0e5319c858e9 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:06.294719 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:06.307379 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-0b4f6013-f942-4445-a121-0e5319c858e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:06.307379 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:06.307379 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:06.307379 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:06.307379 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:06.307379 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:06.307379 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:06.307379 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:06.307379 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:06.307379 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:06.307379 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:06.307379 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:06.307379 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:31:06.307379 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:31:06.307379 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:31:06.308313 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:31:06.308313 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:06.308313 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:06.308313 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:06.308313 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:06.308313 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:06.308313 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:06.308313 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:06.308313 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:06.308313 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:06.308313 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:06.308313 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:06.308313 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:06.308313 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:06.308313 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:06.308313 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:06.308313 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:06.309182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:31:06.309182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:31:06.309182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:06.309182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:06.309182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 344/678] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:06.309777 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f6013-f942-4445-a121-0e5319c858e9 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:06.326824 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbce96c-ae48-46f4-964e-872e220d45f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:06.327837 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbce96c-ae48-46f4-964e-872e220d45f4 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:06.328304 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbce96c-ae48-46f4-964e-872e220d45f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:06.328773 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbce96c-ae48-46f4-964e-872e220d45f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:06.329839 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbce96c-ae48-46f4-964e-872e220d45f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:06.330445 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbce96c-ae48-46f4-964e-872e220d45f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:06.332051 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbce96c-ae48-46f4-964e-872e220d45f4 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:06.346607 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 335/679] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:06.347571 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbce96c-ae48-46f4-964e-872e220d45f4 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:06.420104 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4f6013-f942-4445-a121-0e5319c858e9 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:06.452860 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbce96c-ae48-46f4-964e-872e220d45f4 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:06.455061 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b7729-cf00-46b5-a7ec-50e19b78757b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:06.455855 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b7729-cf00-46b5-a7ec-50e19b78757b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:06.456140 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b7729-cf00-46b5-a7ec-50e19b78757b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:06.456415 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b7729-cf00-46b5-a7ec-50e19b78757b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:06.463654 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b7729-cf00-46b5-a7ec-50e19b78757b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:06.465102 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b7729-cf00-46b5-a7ec-50e19b78757b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:06.479301 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-5b6b7729-cf00-46b5-a7ec-50e19b78757b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:31:06.479301 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:06.479301 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:06.479301 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:06.479301 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:06.479301 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:06.479301 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:06.479301 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:06.479301 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:06.479301 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:06.479301 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:06.479301 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:06.479301 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 03:31:06.479301 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 03:31:06.479301 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 03:31:06.480225 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 03:31:06.480225 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:06.480225 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:06.480225 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:06.480225 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:06.480225 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:06.480225 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:06.480225 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:06.480225 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:06.480225 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:06.480225 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:06.480225 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:06.480225 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:06.480225 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:06.480225 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:06.480225 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:06.480225 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:06.481174 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 03:31:06.481174 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 03:31:06.481174 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 03:31:06.481174 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 03:31:06.481174 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 03:31:06.481174 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 03:31:06.481174 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:31:06.481174 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:06.481174 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 345/680] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:31:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:06.481675 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b7729-cf00-46b5-a7ec-50e19b78757b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:06.494279 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:06.495179 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c82375-ac25-4bdc-83cb-86e645e3e857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:06.496089 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c82375-ac25-4bdc-83cb-86e645e3e857 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:06.497229 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c82375-ac25-4bdc-83cb-86e645e3e857 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:06.497572 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c82375-ac25-4bdc-83cb-86e645e3e857 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:06.504877 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c82375-ac25-4bdc-83cb-86e645e3e857 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:06.506325 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c82375-ac25-4bdc-83cb-86e645e3e857 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:06.521604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-d6c82375-ac25-4bdc-83cb-86e645e3e857 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:31:06.521604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:06.521604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:06.521604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:06.521604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:06.521604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:06.521604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:06.521604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:06.521604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:06.521604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:06.521604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:06.521604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:06.521604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 03:31:06.521604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 03:31:06.521604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 03:31:06.523358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 03:31:06.523358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:06.523358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:06.523358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:06.523358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:06.523358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:06.523358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:06.523358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:06.523358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:06.523358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:06.523358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:06.523358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:06.523358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:06.523358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:06.523358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:06.523358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:06.523358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:06.524269 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 03:31:06.524269 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 03:31:06.524269 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 03:31:06.524269 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 03:31:06.524269 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 03:31:06.524269 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 03:31:06.524269 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:31:06.524269 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:06.524269 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 336/681] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:31:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:06.524755 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c82375-ac25-4bdc-83cb-86e645e3e857 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:06.554353 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:06.593348 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b7729-cf00-46b5-a7ec-50e19b78757b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:06.627249 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c82375-ac25-4bdc-83cb-86e645e3e857 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:06.628620 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927487d2-4119-4bcf-9e18-57946a390ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:06.629277 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927487d2-4119-4bcf-9e18-57946a390ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:06.629563 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927487d2-4119-4bcf-9e18-57946a390ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:06.629839 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927487d2-4119-4bcf-9e18-57946a390ab2 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:06.630592 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927487d2-4119-4bcf-9e18-57946a390ab2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:06.630901 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927487d2-4119-4bcf-9e18-57946a390ab2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:06.632861 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927487d2-4119-4bcf-9e18-57946a390ab2 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:06.649148 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 346/682] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:06.649148 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927487d2-4119-4bcf-9e18-57946a390ab2 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:06.666620 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a9b31-3853-43a3-9d80-6ece610afc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:06.667402 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a9b31-3853-43a3-9d80-6ece610afc21 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:06.667687 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a9b31-3853-43a3-9d80-6ece610afc21 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:06.667962 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a9b31-3853-43a3-9d80-6ece610afc21 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:06.675027 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a9b31-3853-43a3-9d80-6ece610afc21 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:06.676411 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a9b31-3853-43a3-9d80-6ece610afc21 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:06.690671 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-e42a9b31-3853-43a3-9d80-6ece610afc21 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 03:31:06.690671 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:06.690671 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:06.690671 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:06.690671 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:06.690671 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:06.690671 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:06.690671 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:06.690671 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:06.690671 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:06.690671 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:06.690671 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:06.690671 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 03:31:06.690671 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 03:31:06.690671 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 03:31:06.690671 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 03:31:06.691587 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:06.691587 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:06.691587 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 03:31:06.691587 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:31:06.691587 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 03:31:06.691587 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:31:06.691587 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:06.691587 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:06.691587 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:06.691587 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:06.691587 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:06.691587 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:06.691587 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:06.691587 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:06.691587 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:06.691587 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:06.691587 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:06.691587 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:06.693568 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:06.693568 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:06.693568 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 03:31:06.693568 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 03:31:06.693568 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 03:31:06.693568 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 03:31:06.693568 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 03:31:06.693568 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 03:31:06.693568 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 03:31:06.693568 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:06.696783 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 337/683] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 03:31:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:06.697863 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a9b31-3853-43a3-9d80-6ece610afc21 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:06.727265 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:06.759031 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927487d2-4119-4bcf-9e18-57946a390ab2 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:06.788296 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:06.793754 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f918b9-55ce-4c32-b895-aee212b56382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:06.794529 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f918b9-55ce-4c32-b895-aee212b56382 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:06.794818 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f918b9-55ce-4c32-b895-aee212b56382 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:06.795151 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f918b9-55ce-4c32-b895-aee212b56382 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:06.795951 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f918b9-55ce-4c32-b895-aee212b56382 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:06.796311 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f918b9-55ce-4c32-b895-aee212b56382 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:06.797741 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f918b9-55ce-4c32-b895-aee212b56382 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:06.805260 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a9b31-3853-43a3-9d80-6ece610afc21 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:06.814523 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 347/684] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 03:31:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:06.814523 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f918b9-55ce-4c32-b895-aee212b56382 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:06.848325 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb41b23-380f-4bc0-8091-0ba26167f89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:06.849089 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb41b23-380f-4bc0-8091-0ba26167f89e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:06.849446 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb41b23-380f-4bc0-8091-0ba26167f89e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:06.849799 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb41b23-380f-4bc0-8091-0ba26167f89e None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:06.850695 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb41b23-380f-4bc0-8091-0ba26167f89e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:06.851082 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb41b23-380f-4bc0-8091-0ba26167f89e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:06.852583 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb41b23-380f-4bc0-8091-0ba26167f89e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:06.869412 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 338/685] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 03:31:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:06.869412 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb41b23-380f-4bc0-8091-0ba26167f89e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:06.927872 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f918b9-55ce-4c32-b895-aee212b56382 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:06.958171 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:06.965836 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce96f0d-34b7-4662-9865-8e1a19a0ddbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:06.966575 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce96f0d-34b7-4662-9865-8e1a19a0ddbb None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:06.966840 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce96f0d-34b7-4662-9865-8e1a19a0ddbb None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:06.967230 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce96f0d-34b7-4662-9865-8e1a19a0ddbb None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:06.967933 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce96f0d-34b7-4662-9865-8e1a19a0ddbb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:06.969349 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb41b23-380f-4bc0-8091-0ba26167f89e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:06.969468 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce96f0d-34b7-4662-9865-8e1a19a0ddbb None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:06.993645 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 348/686] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jul 21 03:31:06 2022] POST /identity/v3/users => generated 254 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:31:06.994490 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce96f0d-34b7-4662-9865-8e1a19a0ddbb None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:07.021547 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd21b0d-02a1-4a15-9e1e-c65bd9c133a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:07.023546 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd21b0d-02a1-4a15-9e1e-c65bd9c133a8 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:07.024077 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd21b0d-02a1-4a15-9e1e-c65bd9c133a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:07.024577 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd21b0d-02a1-4a15-9e1e-c65bd9c133a8 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:07.025667 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd21b0d-02a1-4a15-9e1e-c65bd9c133a8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:07.026954 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd21b0d-02a1-4a15-9e1e-c65bd9c133a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:07.028971 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd21b0d-02a1-4a15-9e1e-c65bd9c133a8 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:07.057121 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 339/687] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Jul 21 03:31:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:07.058409 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd21b0d-02a1-4a15-9e1e-c65bd9c133a8 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:07.070764 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:07.135662 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce96f0d-34b7-4662-9865-8e1a19a0ddbb None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:07.173425 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd9559-f472-4de3-8125-ada8c5feef9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:07.174185 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd9559-f472-4de3-8125-ada8c5feef9e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:07.174548 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd9559-f472-4de3-8125-ada8c5feef9e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:07.174789 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd9559-f472-4de3-8125-ada8c5feef9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:07.176030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd9559-f472-4de3-8125-ada8c5feef9e None admin] RBAC: Adding query filter params (role.id=3d204e16b7214bf29bde33739ca9006a, scope.project.id=0432303daa8b4304a8e07032d6a80781, user.id=cefbe2d0c739428ab0d4dfeaed6c37ab) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:07.176030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd9559-f472-4de3-8125-ada8c5feef9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:07.177622 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd9559-f472-4de3-8125-ada8c5feef9e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:07.179091 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd21b0d-02a1-4a15-9e1e-c65bd9c133a8 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:07.185709 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 349/688] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:31:06 2022] GET /identity/v3/role_assignments?user.id=cefbe2d0c739428ab0d4dfeaed6c37ab&scope.project.id=0432303daa8b4304a8e07032d6a80781&role.id=3d204e16b7214bf29bde33739ca9006a => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:07.187043 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd9559-f472-4de3-8125-ada8c5feef9e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:07.226551 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07941148-2954-44b1-ad8e-ddd790a6789f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:07.227233 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07941148-2954-44b1-ad8e-ddd790a6789f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:07.232173 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07941148-2954-44b1-ad8e-ddd790a6789f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:07.232505 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07941148-2954-44b1-ad8e-ddd790a6789f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:07.233414 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07941148-2954-44b1-ad8e-ddd790a6789f None admin] RBAC: Adding query filter params (role.id=3d204e16b7214bf29bde33739ca9006a, scope.project.id=0432303daa8b4304a8e07032d6a80781, user.id=b68c257254de483ab65eb5dc5684a704) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:07.233732 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07941148-2954-44b1-ad8e-ddd790a6789f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:07.235273 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07941148-2954-44b1-ad8e-ddd790a6789f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:07.246934 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 340/689] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:31:07 2022] GET /identity/v3/role_assignments?user.id=b68c257254de483ab65eb5dc5684a704&scope.project.id=0432303daa8b4304a8e07032d6a80781&role.id=3d204e16b7214bf29bde33739ca9006a => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:07.250347 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:07.319138 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd9559-f472-4de3-8125-ada8c5feef9e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:07.369869 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270cc942-a5e0-4aeb-b9df-4c6071616a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:07.370587 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270cc942-a5e0-4aeb-b9df-4c6071616a0f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:07.370876 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270cc942-a5e0-4aeb-b9df-4c6071616a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:07.371153 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270cc942-a5e0-4aeb-b9df-4c6071616a0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:07.465027 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270cc942-a5e0-4aeb-b9df-4c6071616a0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:07.466418 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270cc942-a5e0-4aeb-b9df-4c6071616a0f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:07.518805 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:07.585878 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 350/690] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:31:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 03:31:07.591072 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07941148-2954-44b1-ad8e-ddd790a6789f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:07.679431 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:07.726889 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07941148-2954-44b1-ad8e-ddd790a6789f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:07.774150 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77abb79b-18be-42ac-9a5a-f391cab89829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:07.774973 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abb79b-18be-42ac-9a5a-f391cab89829 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:07.775325 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abb79b-18be-42ac-9a5a-f391cab89829 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:07.775596 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abb79b-18be-42ac-9a5a-f391cab89829 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:07.794614 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77abb79b-18be-42ac-9a5a-f391cab89829 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:07.796091 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77abb79b-18be-42ac-9a5a-f391cab89829 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:07.817051 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-77abb79b-18be-42ac-9a5a-f391cab89829 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:07.817051 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:07.817051 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:07.817051 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:07.817051 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:07.817051 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:07.817051 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:07.817051 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:07.817051 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:07.817051 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:07.817051 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:07.817051 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:07.817051 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:31:07.817051 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:31:07.817051 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:31:07.817939 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:31:07.817939 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:07.817939 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:07.817939 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:07.817939 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:07.817939 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:07.817939 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:07.817939 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:07.817939 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:07.817939 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:07.817939 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:07.817939 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:07.817939 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:07.817939 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:07.817939 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:07.817939 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:07.817939 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:07.819305 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:31:07.819305 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:31:07.819305 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:07.819305 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:07.819305 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 341/691] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:07.827565 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270cc942-a5e0-4aeb-b9df-4c6071616a0f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:07.968056 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270cc942-a5e0-4aeb-b9df-4c6071616a0f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:08.002703 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6247ec07-95dc-44c3-af86-cdd59da176c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:08.003374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247ec07-95dc-44c3-af86-cdd59da176c7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:08.003659 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247ec07-95dc-44c3-af86-cdd59da176c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:08.003939 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247ec07-95dc-44c3-af86-cdd59da176c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:08.004673 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6247ec07-95dc-44c3-af86-cdd59da176c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:08.004984 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6247ec07-95dc-44c3-af86-cdd59da176c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:08.006352 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6247ec07-95dc-44c3-af86-cdd59da176c7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:08.018836 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 351/692] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:08.024966 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77abb79b-18be-42ac-9a5a-f391cab89829 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:08.128814 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920319f9-0bdc-4220-9f32-1dda43e36e6b None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:08.129137 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920319f9-0bdc-4220-9f32-1dda43e36e6b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:08.129382 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920319f9-0bdc-4220-9f32-1dda43e36e6b None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:08.130872 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 352/693] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 03:31:08.136428 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc5406-acab-4c43-8ffe-323270c4241e None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:08.136721 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc5406-acab-4c43-8ffe-323270c4241e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:08.137001 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc5406-acab-4c43-8ffe-323270c4241e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:08.158470 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77abb79b-18be-42ac-9a5a-f391cab89829 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:08.186651 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-30dc5406-acab-4c43-8ffe-323270c4241e None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:08.187311 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:08.188165 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-30dc5406-acab-4c43-8ffe-323270c4241e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:08.194893 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb619c7-4be1-46ff-85db-5d48516da0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:08.196492 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb619c7-4be1-46ff-85db-5d48516da0e1 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:08.196852 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb619c7-4be1-46ff-85db-5d48516da0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:08.197061 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb619c7-4be1-46ff-85db-5d48516da0e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:08.198767 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:08.204709 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb619c7-4be1-46ff-85db-5d48516da0e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:08.206195 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb619c7-4be1-46ff-85db-5d48516da0e1 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:08.223698 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-bbb619c7-4be1-46ff-85db-5d48516da0e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:31:08.223698 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:08.223698 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:08.223698 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:08.223698 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:08.223698 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:08.223698 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:08.223698 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:08.223698 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:08.223698 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:08.223698 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:08.223698 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:08.223698 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 03:31:08.223698 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 03:31:08.223698 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 03:31:08.224584 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 03:31:08.224584 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:08.224584 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:08.224584 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:08.224584 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:08.224584 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:08.224584 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:08.224584 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:08.224584 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:08.224584 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:08.224584 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:08.224584 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:08.224584 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:08.224584 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:08.224584 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:08.224584 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:08.224584 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:08.226099 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 03:31:08.226099 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 03:31:08.226099 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 03:31:08.226099 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 03:31:08.226099 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 03:31:08.226099 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 03:31:08.226099 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:31:08.226099 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:08.226099 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 342/694] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:31:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:08.230429 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb619c7-4be1-46ff-85db-5d48516da0e1 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:08.350473 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb619c7-4be1-46ff-85db-5d48516da0e1 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:08.389349 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf3f8f-a7ca-45c0-9902-aa8caad5ad91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:08.390287 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf3f8f-a7ca-45c0-9902-aa8caad5ad91 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:08.390698 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf3f8f-a7ca-45c0-9902-aa8caad5ad91 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:08.391167 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daf3f8f-a7ca-45c0-9902-aa8caad5ad91 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:08.392090 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf3f8f-a7ca-45c0-9902-aa8caad5ad91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:08.392507 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf3f8f-a7ca-45c0-9902-aa8caad5ad91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:08.394070 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daf3f8f-a7ca-45c0-9902-aa8caad5ad91 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:08.400115 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 353/695] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 03:31:08.406921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 343/696] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 03:31:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:08.412229 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc5406-acab-4c43-8ffe-323270c4241e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:08.430282 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf3f8f-a7ca-45c0-9902-aa8caad5ad91 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:08.524838 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:08.550923 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc5406-acab-4c43-8ffe-323270c4241e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:08.617470 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2285f7f2-8d5c-45dd-82d3-417bc4202908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:08.618420 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285f7f2-8d5c-45dd-82d3-417bc4202908 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:08.619659 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285f7f2-8d5c-45dd-82d3-417bc4202908 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:08.620162 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285f7f2-8d5c-45dd-82d3-417bc4202908 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:08.621267 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2285f7f2-8d5c-45dd-82d3-417bc4202908 None admin] RBAC: Adding query filter params (role.id=3d204e16b7214bf29bde33739ca9006a, scope.project.id=0432303daa8b4304a8e07032d6a80781, user.id=ce8bc228892e45c0a7d1b529c2f9a8f2) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:08.623286 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2285f7f2-8d5c-45dd-82d3-417bc4202908 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:08.625915 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2285f7f2-8d5c-45dd-82d3-417bc4202908 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:08.639700 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 354/697] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:31:08 2022] GET /identity/v3/role_assignments?user.id=ce8bc228892e45c0a7d1b529c2f9a8f2&scope.project.id=0432303daa8b4304a8e07032d6a80781&role.id=3d204e16b7214bf29bde33739ca9006a => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:08.649796 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daf3f8f-a7ca-45c0-9902-aa8caad5ad91 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:08.704761 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f40277-1cf4-4bd6-8df0-1b2011ddc8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:08.705958 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f40277-1cf4-4bd6-8df0-1b2011ddc8be None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:08.706490 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f40277-1cf4-4bd6-8df0-1b2011ddc8be None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:08.706954 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f40277-1cf4-4bd6-8df0-1b2011ddc8be None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:08.707776 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f40277-1cf4-4bd6-8df0-1b2011ddc8be None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:08.709342 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f40277-1cf4-4bd6-8df0-1b2011ddc8be None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:08.728008 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-89f40277-1cf4-4bd6-8df0-1b2011ddc8be None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 03:31:08.728008 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:08.728008 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 03:31:08.728008 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 03:31:08.728008 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 03:31:08.728008 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 03:31:08.728008 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 03:31:08.728008 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:31:08.728008 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 03:31:08.728008 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:08.728008 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 03:31:08.728008 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:08.728008 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:08.728008 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:08.728008 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:08.728008 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:08.728972 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:08.728972 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:08.728972 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:08.728972 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:08.728972 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:08.728972 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:08.728972 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:08.728972 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 03:31:08.728972 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 03:31:08.728972 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 03:31:08.728972 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 03:31:08.728972 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:08.728972 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:08.728972 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:08.728972 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:08.728972 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:08.729824 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:08.729824 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:08.729824 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:08.729824 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:08.729824 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:08.729824 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:08.729824 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:08.729824 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:08.729824 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:08.729824 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:08.729824 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:08.729824 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 03:31:08.729824 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:31:08.729824 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 03:31:08.729824 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:08.736565 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 344/698] 10.222.0.20 () {56 vars in 1129 bytes} [Thu Jul 21 03:31:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:08.742733 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2285f7f2-8d5c-45dd-82d3-417bc4202908 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:08.746846 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:08.894784 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2285f7f2-8d5c-45dd-82d3-417bc4202908 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:08.939456 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512f863-14b9-45c8-bd69-ce20971c2d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:08.940130 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512f863-14b9-45c8-bd69-ce20971c2d56 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:08.940418 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512f863-14b9-45c8-bd69-ce20971c2d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:08.940694 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512f863-14b9-45c8-bd69-ce20971c2d56 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:08.941406 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8512f863-14b9-45c8-bd69-ce20971c2d56 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:08.941716 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8512f863-14b9-45c8-bd69-ce20971c2d56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:08.943135 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8512f863-14b9-45c8-bd69-ce20971c2d56 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:08.948615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 355/699] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Jul 21 03:31:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:08.953934 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f40277-1cf4-4bd6-8df0-1b2011ddc8be None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:09.082501 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f40277-1cf4-4bd6-8df0-1b2011ddc8be None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:09.085554 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:09.119721 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b740a24-43ad-442a-b96b-44df35b42e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:09.120397 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b740a24-43ad-442a-b96b-44df35b42e5a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:09.120678 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b740a24-43ad-442a-b96b-44df35b42e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:09.120958 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b740a24-43ad-442a-b96b-44df35b42e5a None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:09.121675 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b740a24-43ad-442a-b96b-44df35b42e5a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:09.121987 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b740a24-43ad-442a-b96b-44df35b42e5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:09.123427 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b740a24-43ad-442a-b96b-44df35b42e5a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:09.129652 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 345/700] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Jul 21 03:31:08 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:09.510388 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3c26c-1cc8-4630-8c61-262384aba778 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:09.510802 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3c26c-1cc8-4630-8c61-262384aba778 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:09.510999 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3c26c-1cc8-4630-8c61-262384aba778 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:09.512638 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 356/701] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:31:09.517837 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a5729-cc1d-41dc-9568-586eae1cd74d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:09.518139 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a5729-cc1d-41dc-9568-586eae1cd74d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:09.518427 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a5729-cc1d-41dc-9568-586eae1cd74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:09.539405 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-653a5729-cc1d-41dc-9568-586eae1cd74d None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:09.540623 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-653a5729-cc1d-41dc-9568-586eae1cd74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:09.632355 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 346/702] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:31:09.663439 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb3c26c-1cc8-4630-8c61-262384aba778 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:09.751056 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a0700-4388-47d6-be60-21b4cca833a3 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:09.751574 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a0700-4388-47d6-be60-21b4cca833a3 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:09.751684 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a0700-4388-47d6-be60-21b4cca833a3 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:09.753237 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 347/703] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:31:09.759649 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:09.763886 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ed5ff-2314-410a-a62a-c7e6a909d0a5 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:09.764120 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ed5ff-2314-410a-a62a-c7e6a909d0a5 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:09.764403 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ed5ff-2314-410a-a62a-c7e6a909d0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:09.794416 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-7f0ed5ff-2314-410a-a62a-c7e6a909d0a5 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:09.796909 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7f0ed5ff-2314-410a-a62a-c7e6a909d0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:09.819358 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb3c26c-1cc8-4630-8c61-262384aba778 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:09.878446 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd4679-06a9-40c9-970d-58556b606312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:09.879653 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd4679-06a9-40c9-970d-58556b606312 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:09.880167 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd4679-06a9-40c9-970d-58556b606312 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:09.880638 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd4679-06a9-40c9-970d-58556b606312 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:09.893562 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cd4679-06a9-40c9-970d-58556b606312 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:31:09.902810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-a6cd4679-06a9-40c9-970d-58556b606312 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 03:31:09.902810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:09.902810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:09.902810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:09.902810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:09.902810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:09.902810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:09.902810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:09.902810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:09.902810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:09.902810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:09.902810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:09.902810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:31:09.902810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:31:09.902810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:31:09.902810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:31:09.904362 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:31:09.904362 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:31:09.904362 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:31:09.904362 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:31:09.904362 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:09.904362 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:09.904362 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:09.904362 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:09.904362 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:09.904362 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:09.904362 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:09.904362 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:09.904362 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:09.904362 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:09.904362 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:09.904362 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:09.905389 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:09.905389 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:09.905389 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:09.905389 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:09.905389 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:31:09.905389 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:31:09.905389 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:31:09.905389 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:31:09.905389 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:31:09.905389 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:31:09.905389 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 03:31:09.905389 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:09.905389 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 357/704] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jul 21 03:31:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:09.906704 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5fac08-c4ca-4eb9-84bf-45c873fd2b81 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:09.906993 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5fac08-c4ca-4eb9-84bf-45c873fd2b81 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:09.907318 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5fac08-c4ca-4eb9-84bf-45c873fd2b81 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:09.909061 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 358/705] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:31:09.911003 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5fac08-c4ca-4eb9-84bf-45c873fd2b81 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:09.923966 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 348/706] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:31:09.925959 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996ac1e-7683-47b8-b34e-f4ba8d584cfb None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:09.926544 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996ac1e-7683-47b8-b34e-f4ba8d584cfb None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:09.927051 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996ac1e-7683-47b8-b34e-f4ba8d584cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:09.946208 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c996ac1e-7683-47b8-b34e-f4ba8d584cfb None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:09.948246 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c996ac1e-7683-47b8-b34e-f4ba8d584cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:09.982181 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:10.032759 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 349/707] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:31:10.034002 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c996ac1e-7683-47b8-b34e-f4ba8d584cfb None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:10.058298 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5fac08-c4ca-4eb9-84bf-45c873fd2b81 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:10.093213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:10.106835 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc3682c-2926-4e04-aba9-a577fa86f382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:10.107984 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3682c-2926-4e04-aba9-a577fa86f382 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:10.108926 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3682c-2926-4e04-aba9-a577fa86f382 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:10.109307 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3682c-2926-4e04-aba9-a577fa86f382 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:10.110290 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc3682c-2926-4e04-aba9-a577fa86f382 None admin] RBAC: Adding query filter params (name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:10.110837 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc3682c-2926-4e04-aba9-a577fa86f382 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:10.112604 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc3682c-2926-4e04-aba9-a577fa86f382 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:10.124718 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 359/708] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jul 21 03:31:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:31:10.126185 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc3682c-2926-4e04-aba9-a577fa86f382 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:10.144876 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c996ac1e-7683-47b8-b34e-f4ba8d584cfb None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:10.181371 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af25d8-b3eb-4708-90d0-85e47de60e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:10.182394 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af25d8-b3eb-4708-90d0-85e47de60e0e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:10.182872 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af25d8-b3eb-4708-90d0-85e47de60e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:10.183371 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af25d8-b3eb-4708-90d0-85e47de60e0e None admin] PATH_INFO: `/v3/services/network` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:10.184268 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af25d8-b3eb-4708-90d0-85e47de60e0e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:10.185997 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af25d8-b3eb-4708-90d0-85e47de60e0e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:10.198997 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-b7af25d8-b3eb-4708-90d0-85e47de60e0e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 03:31:10.198997 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:10.198997 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 03:31:10.198997 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 03:31:10.198997 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 03:31:10.198997 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 03:31:10.198997 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 03:31:10.198997 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:31:10.198997 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 03:31:10.198997 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:10.198997 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 03:31:10.198997 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:10.198997 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:10.198997 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:10.198997 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:10.198997 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:10.198997 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:10.199999 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:10.199999 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:10.199999 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:10.199999 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:10.199999 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:10.199999 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:10.199999 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 03:31:10.199999 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 03:31:10.199999 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 03:31:10.199999 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 03:31:10.199999 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:10.199999 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:10.199999 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:10.199999 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:10.199999 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:10.199999 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:10.200840 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:10.200840 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:10.200840 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:10.200840 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:10.200840 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:10.200840 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:10.200840 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:10.200840 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:10.200840 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:10.200840 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:10.200840 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 03:31:10.200840 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:31:10.200840 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 03:31:10.200840 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:10.208259 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 350/709] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:31:10 2022] GET /identity/v3/services/network => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:10.209327 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af25d8-b3eb-4708-90d0-85e47de60e0e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:10.244431 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc3682c-2926-4e04-aba9-a577fa86f382 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:10.246779 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:10.283428 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef0dd3-a1c4-40ad-b92a-5e89ee14d9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:10.284576 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef0dd3-a1c4-40ad-b92a-5e89ee14d9fb None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:10.285113 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef0dd3-a1c4-40ad-b92a-5e89ee14d9fb None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:10.285580 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef0dd3-a1c4-40ad-b92a-5e89ee14d9fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:10.296878 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef0dd3-a1c4-40ad-b92a-5e89ee14d9fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:31:10.305213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-18ef0dd3-a1c4-40ad-b92a-5e89ee14d9fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:31:10.305213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:10.305213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:10.305213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:10.305213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:10.305213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:10.305213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:10.305213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:10.305213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:10.305213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:10.305213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:10.305213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:10.305213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:31:10.305213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:31:10.305213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:31:10.305213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:31:10.306099 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:31:10.306099 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:31:10.306099 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:31:10.306099 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:31:10.306099 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:10.306099 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:10.306099 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:10.306099 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:10.306099 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:10.306099 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:10.306099 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:10.306099 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:10.306099 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:10.306099 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:10.306099 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:10.306099 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:10.306952 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:10.306952 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:10.306952 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:10.306952 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:10.306952 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:31:10.306952 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:31:10.306952 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:31:10.306952 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:31:10.306952 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:31:10.306952 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:31:10.306952 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:31:10.306952 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:10.309804 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 360/710] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 03:31:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:10.310986 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef0dd3-a1c4-40ad-b92a-5e89ee14d9fb None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:10.338002 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af25d8-b3eb-4708-90d0-85e47de60e0e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:10.365553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:10.385663 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e55ce5-a57e-41e5-8042-3da5694228dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:10.387133 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e55ce5-a57e-41e5-8042-3da5694228dd None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:10.388580 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e55ce5-a57e-41e5-8042-3da5694228dd None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:10.388580 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e55ce5-a57e-41e5-8042-3da5694228dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:10.405853 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e55ce5-a57e-41e5-8042-3da5694228dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:10.407881 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e55ce5-a57e-41e5-8042-3da5694228dd None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:10.427904 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef0dd3-a1c4-40ad-b92a-5e89ee14d9fb None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:10.432066 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-57e55ce5-a57e-41e5-8042-3da5694228dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:10.432066 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:10.432066 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:10.432066 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:10.432066 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:10.432066 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:10.432066 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:10.432066 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:10.432066 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:10.432066 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:10.432066 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:10.432066 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:10.432066 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:31:10.432066 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:31:10.432066 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:31:10.433204 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:31:10.433204 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:10.433204 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:10.433204 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:10.433204 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:10.433204 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:10.433204 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:10.433204 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:10.433204 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:10.433204 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:10.433204 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:10.433204 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:10.433204 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:10.433204 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:10.433204 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:10.433204 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:10.433204 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:10.434374 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:31:10.434374 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:31:10.434374 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:10.434374 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:10.436310 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 351/711] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:10.437336 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e55ce5-a57e-41e5-8042-3da5694228dd None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:10.469821 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ccdce6-3832-4511-8f36-f33723e9938f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:10.470672 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ccdce6-3832-4511-8f36-f33723e9938f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:10.471232 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ccdce6-3832-4511-8f36-f33723e9938f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:10.471467 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ccdce6-3832-4511-8f36-f33723e9938f None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:10.472323 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ccdce6-3832-4511-8f36-f33723e9938f None admin] RBAC: Adding query filter params (name=network) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:10.472727 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ccdce6-3832-4511-8f36-f33723e9938f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:10.474224 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ccdce6-3832-4511-8f36-f33723e9938f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:10.483489 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 361/712] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jul 21 03:31:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:10.484426 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ccdce6-3832-4511-8f36-f33723e9938f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:10.528928 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:10.557709 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e55ce5-a57e-41e5-8042-3da5694228dd None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:10.596121 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c0a74-3e1e-4fc1-b282-748718707cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:10.596789 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c0a74-3e1e-4fc1-b282-748718707cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:10.597076 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c0a74-3e1e-4fc1-b282-748718707cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:10.597344 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c0a74-3e1e-4fc1-b282-748718707cf0 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:10.598094 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c0a74-3e1e-4fc1-b282-748718707cf0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:10.598400 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c0a74-3e1e-4fc1-b282-748718707cf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:10.599822 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06c0a74-3e1e-4fc1-b282-748718707cf0 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:10.609406 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 352/713] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:31:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:10.610599 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c0a74-3e1e-4fc1-b282-748718707cf0 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:10.612410 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ccdce6-3832-4511-8f36-f33723e9938f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:10.635765 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:10.663428 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6e029-9313-40f4-8b7a-92e0ef5cce66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:10.664647 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6e029-9313-40f4-8b7a-92e0ef5cce66 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:10.665378 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6e029-9313-40f4-8b7a-92e0ef5cce66 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:10.665856 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6e029-9313-40f4-8b7a-92e0ef5cce66 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:10.667082 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6e029-9313-40f4-8b7a-92e0ef5cce66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:10.667633 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6e029-9313-40f4-8b7a-92e0ef5cce66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:10.669744 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6e029-9313-40f4-8b7a-92e0ef5cce66 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:10.689573 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 362/714] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:10.689573 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6e029-9313-40f4-8b7a-92e0ef5cce66 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:10.737890 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06c0a74-3e1e-4fc1-b282-748718707cf0 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:10.773790 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867f910-ab7c-4617-bcdf-82c924264af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:10.775196 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867f910-ab7c-4617-bcdf-82c924264af8 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:10.775661 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867f910-ab7c-4617-bcdf-82c924264af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:10.776151 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867f910-ab7c-4617-bcdf-82c924264af8 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:10.777045 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3867f910-ab7c-4617-bcdf-82c924264af8 None admin] RBAC: Adding query filter params (type=network) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:10.777425 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3867f910-ab7c-4617-bcdf-82c924264af8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:10.779035 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3867f910-ab7c-4617-bcdf-82c924264af8 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:10.781532 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:10.792790 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 353/715] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jul 21 03:31:10 2022] GET /identity/v3/services?type=network => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:10.792790 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867f910-ab7c-4617-bcdf-82c924264af8 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:10.834267 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6e029-9313-40f4-8b7a-92e0ef5cce66 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:10.916056 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92b7b2-c233-499a-87cb-2905b9d9bf86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:10.918385 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92b7b2-c233-499a-87cb-2905b9d9bf86 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:10.920302 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92b7b2-c233-499a-87cb-2905b9d9bf86 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:10.920746 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92b7b2-c233-499a-87cb-2905b9d9bf86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:10.943306 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb92b7b2-c233-499a-87cb-2905b9d9bf86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:10.945725 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb92b7b2-c233-499a-87cb-2905b9d9bf86 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:10.971710 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867f910-ab7c-4617-bcdf-82c924264af8 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:10.974030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-fb92b7b2-c233-499a-87cb-2905b9d9bf86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:10.974030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:10.974030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:10.974030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:10.974030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:10.974030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:10.974030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:10.974030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:10.974030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:10.974030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:10.974030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:10.974030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:10.974030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:31:10.974030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:31:10.974030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:31:10.975726 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:31:10.975726 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:10.975726 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:10.975726 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:10.975726 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:10.975726 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:10.975726 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:10.975726 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:10.975726 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:10.975726 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:10.975726 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:10.975726 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:10.975726 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:10.975726 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:10.975726 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:10.975726 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:10.975726 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:10.976807 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:31:10.976807 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:31:10.976807 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:10.976807 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:10.978347 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 363/716] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:10.984338 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92b7b2-c233-499a-87cb-2905b9d9bf86 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:11.014213 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ff1cc-7a84-4b83-96b2-9ebb96346f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:11.015406 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ff1cc-7a84-4b83-96b2-9ebb96346f7e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:11.015858 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ff1cc-7a84-4b83-96b2-9ebb96346f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:11.016280 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ff1cc-7a84-4b83-96b2-9ebb96346f7e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:11.017736 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:11.027492 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ff1cc-7a84-4b83-96b2-9ebb96346f7e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:11.029166 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ff1cc-7a84-4b83-96b2-9ebb96346f7e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:11.046793 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-4d8ff1cc-7a84-4b83-96b2-9ebb96346f7e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 03:31:11.046793 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:11.046793 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:11.046793 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:11.046793 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:11.046793 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:11.046793 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:11.046793 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:11.046793 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:11.046793 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:11.046793 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:11.046793 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:11.046793 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 03:31:11.046793 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 03:31:11.046793 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 03:31:11.046793 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 03:31:11.047950 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:11.047950 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:11.047950 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 03:31:11.047950 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:31:11.047950 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 03:31:11.047950 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:31:11.047950 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:11.047950 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:11.047950 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:11.047950 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:11.047950 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:11.047950 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:11.047950 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:11.047950 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:11.047950 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:11.047950 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:11.047950 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:11.047950 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:11.048874 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:11.048874 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:11.048874 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 03:31:11.048874 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 03:31:11.048874 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 03:31:11.048874 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 03:31:11.048874 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 03:31:11.048874 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 03:31:11.048874 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 03:31:11.048874 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:11.051412 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 354/717] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Jul 21 03:31:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:11.057305 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ff1cc-7a84-4b83-96b2-9ebb96346f7e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:11.128943 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:11.155578 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92b7b2-c233-499a-87cb-2905b9d9bf86 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:11.172656 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ff1cc-7a84-4b83-96b2-9ebb96346f7e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:11.207504 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490296d-3fa3-4d9e-bc67-a113cb52df5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:11.208187 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490296d-3fa3-4d9e-bc67-a113cb52df5b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:11.208468 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490296d-3fa3-4d9e-bc67-a113cb52df5b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:11.208746 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490296d-3fa3-4d9e-bc67-a113cb52df5b None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:11.209825 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490296d-3fa3-4d9e-bc67-a113cb52df5b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:11.210134 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490296d-3fa3-4d9e-bc67-a113cb52df5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:11.210718 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b770c2-aa77-4d7a-a589-3b10a3790bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:11.211385 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b770c2-aa77-4d7a-a589-3b10a3790bad None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:11.211604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490296d-3fa3-4d9e-bc67-a113cb52df5b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:11.211714 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b770c2-aa77-4d7a-a589-3b10a3790bad None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:11.211926 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b770c2-aa77-4d7a-a589-3b10a3790bad None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:11.212658 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b770c2-aa77-4d7a-a589-3b10a3790bad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:11.212963 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b770c2-aa77-4d7a-a589-3b10a3790bad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:11.214317 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b770c2-aa77-4d7a-a589-3b10a3790bad None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:11.231371 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 355/718] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Jul 21 03:31:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:31:11.234968 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 364/719] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:11.236895 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490296d-3fa3-4d9e-bc67-a113cb52df5b None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:11.240009 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b770c2-aa77-4d7a-a589-3b10a3790bad None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:11.344463 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490296d-3fa3-4d9e-bc67-a113cb52df5b None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:11.378179 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:11.380550 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b24e8c4-daf9-48b7-bc19-619bbf9a38a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:11.381752 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24e8c4-daf9-48b7-bc19-619bbf9a38a5 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:11.382482 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24e8c4-daf9-48b7-bc19-619bbf9a38a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:11.383139 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24e8c4-daf9-48b7-bc19-619bbf9a38a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:11.419422 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:11.444009 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b770c2-aa77-4d7a-a589-3b10a3790bad None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:11.453924 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b24e8c4-daf9-48b7-bc19-619bbf9a38a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:11.455516 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b24e8c4-daf9-48b7-bc19-619bbf9a38a5 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:11.482668 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddfc24a-6580-4133-b029-3a4bdcb89ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:11.483932 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddfc24a-6580-4133-b029-3a4bdcb89ab3 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:11.484465 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddfc24a-6580-4133-b029-3a4bdcb89ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:11.484937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddfc24a-6580-4133-b029-3a4bdcb89ab3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:11.493520 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddfc24a-6580-4133-b029-3a4bdcb89ab3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:11.495241 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddfc24a-6580-4133-b029-3a4bdcb89ab3 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:11.510977 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-5ddfc24a-6580-4133-b029-3a4bdcb89ab3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 03:31:11.510977 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:11.510977 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:11.510977 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:11.510977 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:11.510977 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:11.510977 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:11.510977 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:11.510977 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:11.510977 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:11.510977 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:11.510977 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:11.510977 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 03:31:11.510977 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 03:31:11.510977 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 03:31:11.510977 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 03:31:11.511936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:11.511936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:11.511936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 03:31:11.511936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:31:11.511936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 03:31:11.511936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:31:11.511936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:11.511936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:11.511936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:11.511936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:11.511936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:11.511936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:11.511936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:11.511936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:11.511936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:11.511936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:11.511936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:11.511936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:11.512891 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:11.512891 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:11.512891 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 03:31:11.512891 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 03:31:11.512891 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 03:31:11.512891 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 03:31:11.512891 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 03:31:11.512891 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 03:31:11.512891 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 03:31:11.512891 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:11.515931 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 365/720] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Jul 21 03:31:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:11.517473 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51729996-ad1c-4bc5-9995-991f45e2a397 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:11.518052 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51729996-ad1c-4bc5-9995-991f45e2a397 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:11.518665 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51729996-ad1c-4bc5-9995-991f45e2a397 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:11.520483 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 366/721] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:31:11.521425 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51729996-ad1c-4bc5-9995-991f45e2a397 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:11.559296 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 356/722] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:31:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 03:31:11.564963 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5895be3-c8c9-4af6-b3ee-1ce31dbebf09 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:11.565297 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5895be3-c8c9-4af6-b3ee-1ce31dbebf09 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:11.565580 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5895be3-c8c9-4af6-b3ee-1ce31dbebf09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:11.582324 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d5895be3-c8c9-4af6-b3ee-1ce31dbebf09 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:11.583554 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d5895be3-c8c9-4af6-b3ee-1ce31dbebf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:11.598125 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:11.637338 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51729996-ad1c-4bc5-9995-991f45e2a397 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:11.654719 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 357/723] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:31:11.655548 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5895be3-c8c9-4af6-b3ee-1ce31dbebf09 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:11.680399 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df2ce6-97c4-4008-92ab-72b0134101ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:11.681347 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df2ce6-97c4-4008-92ab-72b0134101ea None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:11.681684 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df2ce6-97c4-4008-92ab-72b0134101ea None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:11.681968 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df2ce6-97c4-4008-92ab-72b0134101ea None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:11.683401 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2df2ce6-97c4-4008-92ab-72b0134101ea None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:11.683984 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2df2ce6-97c4-4008-92ab-72b0134101ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:11.686004 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2df2ce6-97c4-4008-92ab-72b0134101ea None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:11.711283 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 367/724] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Jul 21 03:31:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:11.711283 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2db07d-6e91-439d-9cb7-4fe0747ad340 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:11.711283 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2db07d-6e91-439d-9cb7-4fe0747ad340 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:11.711283 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2db07d-6e91-439d-9cb7-4fe0747ad340 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:11.711283 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 368/725] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:31:11.711283 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2db07d-6e91-439d-9cb7-4fe0747ad340 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:11.717298 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:11.768549 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5895be3-c8c9-4af6-b3ee-1ce31dbebf09 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:11.804634 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5ff388-92f2-4032-84fa-7b5ba221ebc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:11.805489 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ff388-92f2-4032-84fa-7b5ba221ebc0 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:11.805778 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ff388-92f2-4032-84fa-7b5ba221ebc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:11.806060 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5ff388-92f2-4032-84fa-7b5ba221ebc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:11.816289 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ff388-92f2-4032-84fa-7b5ba221ebc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:11.817747 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5ff388-92f2-4032-84fa-7b5ba221ebc0 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:11.822920 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2db07d-6e91-439d-9cb7-4fe0747ad340 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:11.827306 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:11.838917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-8c5ff388-92f2-4032-84fa-7b5ba221ebc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:11.838917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:11.838917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:11.838917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:11.838917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:11.838917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:11.838917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:11.838917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:11.838917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:11.838917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:11.838917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:11.838917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:11.838917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:31:11.838917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:31:11.838917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:31:11.839831 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:31:11.839831 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:11.839831 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:11.839831 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:11.839831 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:11.839831 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:11.839831 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:11.839831 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:11.839831 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:11.839831 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:11.839831 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:11.839831 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:11.839831 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:11.839831 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:11.839831 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:11.839831 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:11.839831 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:11.840837 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:31:11.840837 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:31:11.840837 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:11.840837 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:11.847622 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 358/726] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:11.847622 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc9da3-a492-4c46-86a5-2ec288801a87 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:11.847622 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc9da3-a492-4c46-86a5-2ec288801a87 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:11.847622 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dc9da3-a492-4c46-86a5-2ec288801a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:11.861264 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-65dc9da3-a492-4c46-86a5-2ec288801a87 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:11.862445 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-65dc9da3-a492-4c46-86a5-2ec288801a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:11.868784 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e5434-346a-465e-8ce4-41d75c476e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:11.869562 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e5434-346a-465e-8ce4-41d75c476e17 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:11.869841 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e5434-346a-465e-8ce4-41d75c476e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:11.870537 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e5434-346a-465e-8ce4-41d75c476e17 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:11.881586 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038e5434-346a-465e-8ce4-41d75c476e17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:31:11.889161 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-038e5434-346a-465e-8ce4-41d75c476e17 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:31:11.889161 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:11.889161 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:11.889161 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:11.889161 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:11.889161 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:11.889161 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:11.889161 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:11.889161 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:11.889161 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:11.889161 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:11.889161 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:11.889161 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:31:11.889161 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:31:11.889161 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:31:11.889161 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:31:11.890074 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:31:11.890074 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:31:11.890074 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:31:11.890074 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:31:11.890074 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:11.890074 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:11.890074 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:11.890074 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:11.890074 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:11.890074 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:11.890074 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:11.890074 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:11.890074 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:11.890074 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:11.890074 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:11.890074 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:11.891847 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:11.891847 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:11.891847 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:11.891847 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:11.891847 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:31:11.891847 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:31:11.891847 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:31:11.891847 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:31:11.891847 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:31:11.891847 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:31:11.891847 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:31:11.891847 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:11.891847 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 369/727] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 03:31:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:11.891847 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e5434-346a-465e-8ce4-41d75c476e17 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:11.941398 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 359/728] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:31:11.942833 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc9da3-a492-4c46-86a5-2ec288801a87 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:11.959485 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:11.999602 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e5434-346a-465e-8ce4-41d75c476e17 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:12.035298 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f02da-aeac-4cbe-a767-fa7c4bb4be3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:12.035967 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f02da-aeac-4cbe-a767-fa7c4bb4be3f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:12.036259 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f02da-aeac-4cbe-a767-fa7c4bb4be3f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:12.036545 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f02da-aeac-4cbe-a767-fa7c4bb4be3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:12.059141 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dc9da3-a492-4c46-86a5-2ec288801a87 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:12.091223 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:12.097701 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f87d3-7815-497a-bf00-0589db192c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:12.098372 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f87d3-7815-497a-bf00-0589db192c3d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:12.098680 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f87d3-7815-497a-bf00-0589db192c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:12.098955 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f87d3-7815-497a-bf00-0589db192c3d None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:12.099729 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762f87d3-7815-497a-bf00-0589db192c3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:12.100065 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762f87d3-7815-497a-bf00-0589db192c3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:12.102048 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762f87d3-7815-497a-bf00-0589db192c3d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:12.113284 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 360/729] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:31:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:12.114075 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f87d3-7815-497a-bf00-0589db192c3d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:12.121428 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f02da-aeac-4cbe-a767-fa7c4bb4be3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:12.123049 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f02da-aeac-4cbe-a767-fa7c4bb4be3f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:12.195386 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:12.219037 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f87d3-7815-497a-bf00-0589db192c3d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:12.235467 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 370/730] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:31:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 03:31:12.239790 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f02da-aeac-4cbe-a767-fa7c4bb4be3f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:12.253634 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0e32a-6c38-4dc6-95a2-1451f28d78aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:12.254311 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0e32a-6c38-4dc6-95a2-1451f28d78aa None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:12.254629 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0e32a-6c38-4dc6-95a2-1451f28d78aa None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:12.254912 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0e32a-6c38-4dc6-95a2-1451f28d78aa None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:12.255661 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0e32a-6c38-4dc6-95a2-1451f28d78aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:12.255972 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0e32a-6c38-4dc6-95a2-1451f28d78aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:12.257399 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0e32a-6c38-4dc6-95a2-1451f28d78aa None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:12.270000 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 361/731] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:31:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:12.270000 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0e32a-6c38-4dc6-95a2-1451f28d78aa None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:12.322100 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:12.348866 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f02da-aeac-4cbe-a767-fa7c4bb4be3f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:12.370152 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0e32a-6c38-4dc6-95a2-1451f28d78aa None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:12.384475 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c44c24-c25f-4e26-b202-4b353dcb21f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:12.385240 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c44c24-c25f-4e26-b202-4b353dcb21f9 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:12.385536 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c44c24-c25f-4e26-b202-4b353dcb21f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:12.385817 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c44c24-c25f-4e26-b202-4b353dcb21f9 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:12.386638 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c44c24-c25f-4e26-b202-4b353dcb21f9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:12.388047 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c44c24-c25f-4e26-b202-4b353dcb21f9 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:12.410480 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 371/732] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jul 21 03:31:12 2022] POST /identity/v3/services => generated 251 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:31:12.410480 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c44c24-c25f-4e26-b202-4b353dcb21f9 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:12.421565 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89fc51-dc1b-4f02-8636-b8711d5c56c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:12.422582 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89fc51-dc1b-4f02-8636-b8711d5c56c8 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:12.422977 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89fc51-dc1b-4f02-8636-b8711d5c56c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:12.423322 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89fc51-dc1b-4f02-8636-b8711d5c56c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:12.432074 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a89fc51-dc1b-4f02-8636-b8711d5c56c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:12.434126 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a89fc51-dc1b-4f02-8636-b8711d5c56c8 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:12.442196 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:12.454747 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-6a89fc51-dc1b-4f02-8636-b8711d5c56c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:31:12.454747 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:12.454747 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:12.454747 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:12.454747 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:12.454747 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:12.454747 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:12.454747 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:12.454747 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:12.454747 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:12.454747 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:12.454747 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:12.454747 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 03:31:12.454747 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 03:31:12.454747 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 03:31:12.455702 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 03:31:12.455702 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:12.455702 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:12.455702 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:12.455702 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:12.455702 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:12.455702 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:12.455702 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:12.455702 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:12.455702 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:12.455702 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:12.455702 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:12.455702 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:12.455702 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:12.455702 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:12.455702 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:12.455702 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:12.456616 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 03:31:12.456616 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 03:31:12.456616 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 03:31:12.456616 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 03:31:12.456616 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 03:31:12.456616 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 03:31:12.456616 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:31:12.456616 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:12.461492 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 362/733] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:31:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:12.462481 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89fc51-dc1b-4f02-8636-b8711d5c56c8 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:12.542950 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c44c24-c25f-4e26-b202-4b353dcb21f9 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:12.579468 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51814641-0fa6-4aa7-aad9-2776d5dcfdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:12.580320 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51814641-0fa6-4aa7-aad9-2776d5dcfdfc None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:12.580616 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51814641-0fa6-4aa7-aad9-2776d5dcfdfc None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:12.580883 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51814641-0fa6-4aa7-aad9-2776d5dcfdfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:12.583957 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89fc51-dc1b-4f02-8636-b8711d5c56c8 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:12.594023 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51814641-0fa6-4aa7-aad9-2776d5dcfdfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:12.595498 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51814641-0fa6-4aa7-aad9-2776d5dcfdfc None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:12.596421 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:12.615391 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-51814641-0fa6-4aa7-aad9-2776d5dcfdfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:12.615391 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:12.615391 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:12.615391 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:12.615391 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:12.615391 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:12.615391 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:12.615391 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:12.615391 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:12.615391 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:12.615391 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:12.615391 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:12.615391 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:31:12.615391 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:31:12.615391 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:31:12.616980 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:31:12.616980 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:12.616980 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:12.616980 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:12.616980 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:12.616980 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:12.616980 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:12.616980 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:12.616980 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:12.616980 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:12.616980 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:12.616980 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:12.616980 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:12.616980 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:12.616980 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:12.616980 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:12.616980 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:12.618376 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:31:12.618376 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:31:12.618376 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:12.618376 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:12.618376 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 372/734] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:12.618698 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51814641-0fa6-4aa7-aad9-2776d5dcfdfc None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:12.627468 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b1571e-cf5a-4f75-a603-8fbd13c0d6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:12.628285 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1571e-cf5a-4f75-a603-8fbd13c0d6fe None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:12.628574 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1571e-cf5a-4f75-a603-8fbd13c0d6fe None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:12.628854 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b1571e-cf5a-4f75-a603-8fbd13c0d6fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:12.642619 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b1571e-cf5a-4f75-a603-8fbd13c0d6fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:12.644157 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b1571e-cf5a-4f75-a603-8fbd13c0d6fe None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:12.663470 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-63b1571e-cf5a-4f75-a603-8fbd13c0d6fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:12.663470 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:12.663470 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:12.663470 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:12.663470 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:12.663470 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:12.663470 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:12.663470 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:12.663470 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:12.663470 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:12.663470 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:12.663470 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:12.663470 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:31:12.663470 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:31:12.663470 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:31:12.664541 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:31:12.664541 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:12.664541 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:12.664541 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:12.664541 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:12.664541 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:12.664541 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:12.664541 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:12.664541 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:12.664541 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:12.664541 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:12.664541 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:12.664541 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:12.664541 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:12.664541 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:12.664541 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:12.664541 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:12.665647 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:31:12.665647 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:31:12.665647 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:12.665647 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:12.665647 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 363/735] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:12.669664 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b1571e-cf5a-4f75-a603-8fbd13c0d6fe None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:12.722684 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:12.750737 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51814641-0fa6-4aa7-aad9-2776d5dcfdfc None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:12.788487 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b8028-0b94-44a4-b76a-36f543324859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:12.788795 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b1571e-cf5a-4f75-a603-8fbd13c0d6fe None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:12.789609 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b8028-0b94-44a4-b76a-36f543324859 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:12.790068 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b8028-0b94-44a4-b76a-36f543324859 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:12.790633 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b8028-0b94-44a4-b76a-36f543324859 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:12.791675 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b8028-0b94-44a4-b76a-36f543324859 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:12.792127 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b8028-0b94-44a4-b76a-36f543324859 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:12.794487 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b8028-0b94-44a4-b76a-36f543324859 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:12.812860 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 373/736] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 03:31:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:12.814262 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b8028-0b94-44a4-b76a-36f543324859 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:12.825336 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e488c3-3b79-44dc-9d67-9be8b97802d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:12.826187 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e488c3-3b79-44dc-9d67-9be8b97802d1 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:12.826606 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e488c3-3b79-44dc-9d67-9be8b97802d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:12.826980 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e488c3-3b79-44dc-9d67-9be8b97802d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:12.827823 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e488c3-3b79-44dc-9d67-9be8b97802d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:12.828231 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e488c3-3b79-44dc-9d67-9be8b97802d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:12.829705 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e488c3-3b79-44dc-9d67-9be8b97802d1 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:12.842618 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 364/737] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:31:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:12.843547 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e488c3-3b79-44dc-9d67-9be8b97802d1 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:12.876536 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:12.943317 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b8028-0b94-44a4-b76a-36f543324859 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:12.979415 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e488c3-3b79-44dc-9d67-9be8b97802d1 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:12.985514 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6250d-bee1-4ea4-b8a7-6e02b7221daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:12.986319 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6250d-bee1-4ea4-b8a7-6e02b7221daa None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:12.986723 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6250d-bee1-4ea4-b8a7-6e02b7221daa None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:12.987100 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e6250d-bee1-4ea4-b8a7-6e02b7221daa None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:12.987997 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e6250d-bee1-4ea4-b8a7-6e02b7221daa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:12.988396 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e6250d-bee1-4ea4-b8a7-6e02b7221daa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:12.989907 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e6250d-bee1-4ea4-b8a7-6e02b7221daa None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:12.993416 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:13.005273 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 374/738] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:31:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:13.006762 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6250d-bee1-4ea4-b8a7-6e02b7221daa None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:13.023195 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54f072-fd5d-4d07-8b4b-f68fbbd5b31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:13.023852 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54f072-fd5d-4d07-8b4b-f68fbbd5b31c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:13.024151 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54f072-fd5d-4d07-8b4b-f68fbbd5b31c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:13.024403 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54f072-fd5d-4d07-8b4b-f68fbbd5b31c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:13.025235 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa54f072-fd5d-4d07-8b4b-f68fbbd5b31c None admin] RBAC: Adding query filter params (role.id=3d204e16b7214bf29bde33739ca9006a, scope.project.id=0432303daa8b4304a8e07032d6a80781, user.id=73fad109df9f449e8ac5f38749c01ace) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:13.025544 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa54f072-fd5d-4d07-8b4b-f68fbbd5b31c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:13.027007 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa54f072-fd5d-4d07-8b4b-f68fbbd5b31c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:13.034798 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 365/739] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:31:12 2022] GET /identity/v3/role_assignments?user.id=73fad109df9f449e8ac5f38749c01ace&scope.project.id=0432303daa8b4304a8e07032d6a80781&role.id=3d204e16b7214bf29bde33739ca9006a => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:13.034798 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71257304-b251-4108-97a7-02611351b785 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:13.034798 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71257304-b251-4108-97a7-02611351b785 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:13.034798 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71257304-b251-4108-97a7-02611351b785 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:13.036265 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 366/740] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:31:13.037006 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71257304-b251-4108-97a7-02611351b785 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:13.120154 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e6250d-bee1-4ea4-b8a7-6e02b7221daa None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:13.157852 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7ab16e-909c-401f-8d32-9bbb23e59845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:13.158967 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ab16e-909c-401f-8d32-9bbb23e59845 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:13.159398 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ab16e-909c-401f-8d32-9bbb23e59845 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:13.159847 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7ab16e-909c-401f-8d32-9bbb23e59845 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:13.161828 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:13.168562 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ab16e-909c-401f-8d32-9bbb23e59845 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:13.170438 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7ab16e-909c-401f-8d32-9bbb23e59845 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:13.183063 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71257304-b251-4108-97a7-02611351b785 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:13.186226 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-1b7ab16e-909c-401f-8d32-9bbb23e59845 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:31:13.186226 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:13.186226 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:13.186226 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:13.186226 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:13.186226 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:13.186226 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:13.186226 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:13.186226 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:13.186226 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:13.186226 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:13.186226 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:13.186226 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 03:31:13.186226 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 03:31:13.186226 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 03:31:13.187187 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 03:31:13.187187 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:13.187187 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:13.187187 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:13.187187 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:13.187187 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:13.187187 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:13.187187 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:13.187187 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:13.187187 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:13.187187 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:13.187187 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:13.187187 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:13.187187 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:13.187187 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:13.187187 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:13.187187 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:13.188084 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 03:31:13.188084 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 03:31:13.188084 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 03:31:13.188084 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 03:31:13.188084 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 03:31:13.188084 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 03:31:13.188084 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:31:13.188084 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:13.192371 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 375/741] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:31:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:13.194437 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a9564-ab31-4023-ac9a-f49c85b32a49 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:13.194737 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a9564-ab31-4023-ac9a-f49c85b32a49 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:13.195012 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1a9564-ab31-4023-ac9a-f49c85b32a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:13.213110 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-1c1a9564-ab31-4023-ac9a-f49c85b32a49 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:13.214311 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1c1a9564-ab31-4023-ac9a-f49c85b32a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:13.236381 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90724a-4930-4238-8ff3-e3da48d3b0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:13.237113 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90724a-4930-4238-8ff3-e3da48d3b0d5 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:13.237396 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90724a-4930-4238-8ff3-e3da48d3b0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:13.237671 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b90724a-4930-4238-8ff3-e3da48d3b0d5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:13.246614 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b90724a-4930-4238-8ff3-e3da48d3b0d5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:13.248138 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b90724a-4930-4238-8ff3-e3da48d3b0d5 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:13.264921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-6b90724a-4930-4238-8ff3-e3da48d3b0d5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 03:31:13.264921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:13.264921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:13.264921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:13.264921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:13.264921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:13.264921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:13.264921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:13.264921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:13.264921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:13.264921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:13.264921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:13.264921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 03:31:13.264921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 03:31:13.264921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 03:31:13.264921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 03:31:13.265921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:13.265921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:13.265921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 03:31:13.265921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:31:13.265921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 03:31:13.265921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:31:13.265921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:13.265921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:13.265921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:13.265921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:13.265921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:13.265921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:13.265921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:13.265921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:13.265921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:13.265921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:13.265921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:13.265921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:13.266892 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:13.266892 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:13.266892 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 03:31:13.266892 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 03:31:13.266892 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 03:31:13.266892 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 03:31:13.266892 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 03:31:13.266892 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 03:31:13.266892 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 03:31:13.266892 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:13.266892 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 367/742] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 03:31:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:13.267501 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90724a-4930-4238-8ff3-e3da48d3b0d5 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:13.281852 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:13.309941 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 376/743] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:13 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 03:31:13.311074 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a9564-ab31-4023-ac9a-f49c85b32a49 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:13.375779 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b90724a-4930-4238-8ff3-e3da48d3b0d5 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:13.412334 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783f894-11b1-4964-87e7-8283dd158311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:13.413164 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783f894-11b1-4964-87e7-8283dd158311 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:13.413544 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783f894-11b1-4964-87e7-8283dd158311 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:13.413921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783f894-11b1-4964-87e7-8283dd158311 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:13.414863 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c783f894-11b1-4964-87e7-8283dd158311 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:13.415269 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c783f894-11b1-4964-87e7-8283dd158311 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:13.416959 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c783f894-11b1-4964-87e7-8283dd158311 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:13.430844 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 368/744] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 03:31:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:13.431838 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783f894-11b1-4964-87e7-8283dd158311 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:13.435515 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:13.452909 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1a9564-ab31-4023-ac9a-f49c85b32a49 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:13.489986 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229db1d-d5f8-4f71-8f0c-9454e08e2e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:13.490718 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229db1d-d5f8-4f71-8f0c-9454e08e2e80 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:13.491013 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229db1d-d5f8-4f71-8f0c-9454e08e2e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:13.491296 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229db1d-d5f8-4f71-8f0c-9454e08e2e80 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:13.492144 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a229db1d-d5f8-4f71-8f0c-9454e08e2e80 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:13.492461 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a229db1d-d5f8-4f71-8f0c-9454e08e2e80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:13.493986 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a229db1d-d5f8-4f71-8f0c-9454e08e2e80 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:13.517149 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 377/745] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Jul 21 03:31:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:13.518035 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229db1d-d5f8-4f71-8f0c-9454e08e2e80 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:13.570144 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:13.570566 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c783f894-11b1-4964-87e7-8283dd158311 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:13.618891 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb777ea0-e64b-4339-bac6-b7207acedb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:13.619575 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb777ea0-e64b-4339-bac6-b7207acedb48 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:13.619862 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb777ea0-e64b-4339-bac6-b7207acedb48 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:13.620139 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb777ea0-e64b-4339-bac6-b7207acedb48 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:13.621799 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb777ea0-e64b-4339-bac6-b7207acedb48 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:13.623253 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb777ea0-e64b-4339-bac6-b7207acedb48 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:13.633382 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229db1d-d5f8-4f71-8f0c-9454e08e2e80 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:13.639691 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 369/746] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jul 21 03:31:13 2022] POST /identity/v3/services => generated 240 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:31:13.640788 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb777ea0-e64b-4339-bac6-b7207acedb48 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:13.687201 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59757a81-3814-421d-9b9a-004bf498e2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:13.688239 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59757a81-3814-421d-9b9a-004bf498e2c2 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:13.688724 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59757a81-3814-421d-9b9a-004bf498e2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:13.689212 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59757a81-3814-421d-9b9a-004bf498e2c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:13.690320 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59757a81-3814-421d-9b9a-004bf498e2c2 None admin] RBAC: Adding query filter params (role.id=27e53d6c56f24c25a8c8057bfd36bcf1, scope.project.id=0432303daa8b4304a8e07032d6a80781, user.id=cefbe2d0c739428ab0d4dfeaed6c37ab) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:13.690976 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59757a81-3814-421d-9b9a-004bf498e2c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:13.693401 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59757a81-3814-421d-9b9a-004bf498e2c2 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:13.703055 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 378/747] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:31:13 2022] GET /identity/v3/role_assignments?user.id=cefbe2d0c739428ab0d4dfeaed6c37ab&scope.project.id=0432303daa8b4304a8e07032d6a80781&role.id=27e53d6c56f24c25a8c8057bfd36bcf1 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:13.728214 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:13.779300 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb777ea0-e64b-4339-bac6-b7207acedb48 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:13.821802 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0964387-d130-43c4-a8d2-82927c5cc5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:13.822498 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0964387-d130-43c4-a8d2-82927c5cc5db None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:13.822964 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0964387-d130-43c4-a8d2-82927c5cc5db None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:13.823251 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0964387-d130-43c4-a8d2-82927c5cc5db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:13.906806 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0964387-d130-43c4-a8d2-82927c5cc5db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:13.909092 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0964387-d130-43c4-a8d2-82927c5cc5db None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:13.974494 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:14.015850 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 370/748] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:31:13 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 03:31:14.021665 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59757a81-3814-421d-9b9a-004bf498e2c2 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:14.131648 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59757a81-3814-421d-9b9a-004bf498e2c2 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:14.134018 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:14.169470 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cecf65-2e87-4e36-ac8d-eb7a1dbfaaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:14.170285 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cecf65-2e87-4e36-ac8d-eb7a1dbfaaaf None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:14.170609 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cecf65-2e87-4e36-ac8d-eb7a1dbfaaaf None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:14.170885 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cecf65-2e87-4e36-ac8d-eb7a1dbfaaaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:14.181929 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cecf65-2e87-4e36-ac8d-eb7a1dbfaaaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:14.183404 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cecf65-2e87-4e36-ac8d-eb7a1dbfaaaf None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:14.205460 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-d6cecf65-2e87-4e36-ac8d-eb7a1dbfaaaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:14.205460 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:14.205460 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:14.205460 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:14.205460 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:14.205460 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:14.205460 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:14.205460 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:14.205460 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:14.205460 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:14.205460 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:14.205460 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:14.205460 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:31:14.205460 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:31:14.205460 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:31:14.206402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:31:14.206402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:14.206402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:14.206402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:14.206402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:14.206402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:14.206402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:14.206402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:14.206402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:14.206402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:14.206402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:14.206402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:14.206402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:14.206402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:14.206402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:14.206402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:14.206402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:14.207759 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:31:14.207759 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:31:14.207759 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:14.207759 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:14.207759 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 379/749] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:31:14.213895 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0964387-d130-43c4-a8d2-82927c5cc5db None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:14.341952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0964387-d130-43c4-a8d2-82927c5cc5db None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:14.382054 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb0140e-167a-4f54-934d-058237e2e540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:14.382670 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0140e-167a-4f54-934d-058237e2e540 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:14.382953 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0140e-167a-4f54-934d-058237e2e540 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:14.383229 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0140e-167a-4f54-934d-058237e2e540 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:14.383957 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb0140e-167a-4f54-934d-058237e2e540 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:14.384261 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb0140e-167a-4f54-934d-058237e2e540 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:14.385642 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb0140e-167a-4f54-934d-058237e2e540 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:14.402226 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 371/750] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:31:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:14.407955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cecf65-2e87-4e36-ac8d-eb7a1dbfaaaf None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:14.555711 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cecf65-2e87-4e36-ac8d-eb7a1dbfaaaf None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:14.603642 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca105cc-c8db-458c-aef8-ef4b82a75857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:14.604449 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca105cc-c8db-458c-aef8-ef4b82a75857 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:14.604727 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca105cc-c8db-458c-aef8-ef4b82a75857 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:14.605008 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca105cc-c8db-458c-aef8-ef4b82a75857 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:14.611897 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca105cc-c8db-458c-aef8-ef4b82a75857 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:14.613341 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca105cc-c8db-458c-aef8-ef4b82a75857 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:14.627665 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-8ca105cc-c8db-458c-aef8-ef4b82a75857 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:31:14.627665 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:14.627665 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:14.627665 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:14.627665 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:14.627665 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:14.627665 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:14.627665 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:14.627665 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:14.627665 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:14.627665 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:14.627665 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:14.627665 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 03:31:14.627665 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 03:31:14.627665 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 03:31:14.628589 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 03:31:14.628589 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:14.628589 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:14.628589 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:14.628589 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:14.628589 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:14.628589 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:14.628589 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:14.628589 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:14.628589 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:14.628589 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:14.628589 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:14.628589 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:14.628589 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:14.628589 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:14.628589 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:14.628589 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:14.629879 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 03:31:14.629879 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 03:31:14.629879 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 03:31:14.629879 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 03:31:14.629879 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 03:31:14.629879 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 03:31:14.629879 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:31:14.629879 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:14.629879 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 380/751] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:31:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:14.636485 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb0140e-167a-4f54-934d-058237e2e540 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:14.681435 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:14.765595 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f397cdb-a317-425b-ad20-d9a5d2638df2 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:14.766234 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f397cdb-a317-425b-ad20-d9a5d2638df2 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:14.766756 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f397cdb-a317-425b-ad20-d9a5d2638df2 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:14.769729 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 381/752] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 03:31:14.774612 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53634f-66c4-48b7-8280-fa40d75e15db None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:14.774874 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb0140e-167a-4f54-934d-058237e2e540 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:14.775415 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53634f-66c4-48b7-8280-fa40d75e15db None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:14.775906 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53634f-66c4-48b7-8280-fa40d75e15db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:14.793854 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-7b53634f-66c4-48b7-8280-fa40d75e15db None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:14.795435 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7b53634f-66c4-48b7-8280-fa40d75e15db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:14.807402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:14.813598 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb4097-91fd-4ada-a656-04a238b182e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:14.814419 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb4097-91fd-4ada-a656-04a238b182e2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:14.814827 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb4097-91fd-4ada-a656-04a238b182e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:14.815102 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb4097-91fd-4ada-a656-04a238b182e2 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:14.815894 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb4097-91fd-4ada-a656-04a238b182e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:14.816204 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb4097-91fd-4ada-a656-04a238b182e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:14.818074 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb4097-91fd-4ada-a656-04a238b182e2 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:14.839950 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 372/753] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 03:31:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:14.846350 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb4097-91fd-4ada-a656-04a238b182e2 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:14.904170 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 382/754] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 03:31:14.953122 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b53634f-66c4-48b7-8280-fa40d75e15db None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:14.963963 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:14.983279 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb4097-91fd-4ada-a656-04a238b182e2 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:15.026719 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079de54-9495-4db4-9d5c-7f23e6e4cf28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:15.029628 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079de54-9495-4db4-9d5c-7f23e6e4cf28 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:15.030129 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079de54-9495-4db4-9d5c-7f23e6e4cf28 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:15.030650 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079de54-9495-4db4-9d5c-7f23e6e4cf28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:15.031710 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e079de54-9495-4db4-9d5c-7f23e6e4cf28 None admin] RBAC: Adding query filter params (role.id=27e53d6c56f24c25a8c8057bfd36bcf1, scope.project.id=0432303daa8b4304a8e07032d6a80781, user.id=ce8bc228892e45c0a7d1b529c2f9a8f2) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:15.032457 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e079de54-9495-4db4-9d5c-7f23e6e4cf28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:15.035301 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e079de54-9495-4db4-9d5c-7f23e6e4cf28 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:15.047369 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 373/755] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:31:14 2022] GET /identity/v3/role_assignments?user.id=ce8bc228892e45c0a7d1b529c2f9a8f2&scope.project.id=0432303daa8b4304a8e07032d6a80781&role.id=27e53d6c56f24c25a8c8057bfd36bcf1 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:15.129619 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b53634f-66c4-48b7-8280-fa40d75e15db None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:15.185797 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff035f90-f593-4733-a5f0-065fe64323d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:15.187036 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff035f90-f593-4733-a5f0-065fe64323d0 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:15.187533 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff035f90-f593-4733-a5f0-065fe64323d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:15.188026 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff035f90-f593-4733-a5f0-065fe64323d0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:15.188974 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff035f90-f593-4733-a5f0-065fe64323d0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:15.190675 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff035f90-f593-4733-a5f0-065fe64323d0 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:15.209322 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-ff035f90-f593-4733-a5f0-065fe64323d0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 03:31:15.209322 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:15.209322 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 03:31:15.209322 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 03:31:15.209322 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 03:31:15.209322 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 03:31:15.209322 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 03:31:15.209322 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:31:15.209322 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 03:31:15.209322 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:15.209322 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 03:31:15.209322 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:15.209322 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:15.209322 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:15.209322 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:15.209322 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:15.210334 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:15.210334 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:15.210334 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:15.210334 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:15.210334 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:15.210334 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:15.210334 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:15.210334 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 03:31:15.210334 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 03:31:15.210334 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 03:31:15.210334 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 03:31:15.210334 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:15.210334 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:15.210334 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:15.210334 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:15.210334 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:15.211228 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:15.211228 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:15.211228 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:15.211228 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:15.211228 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:15.211228 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:15.211228 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:15.211228 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:15.211228 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:15.211228 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:15.211228 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:15.211228 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 03:31:15.211228 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:31:15.211228 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 03:31:15.211228 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:15.214164 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 383/756] 10.222.0.20 () {56 vars in 1129 bytes} [Thu Jul 21 03:31:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:31:15.219642 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079de54-9495-4db4-9d5c-7f23e6e4cf28 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:15.328038 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079de54-9495-4db4-9d5c-7f23e6e4cf28 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:15.369923 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e45ced-66c3-4bb9-99f0-a1ddfbc2bf9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:15.370985 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e45ced-66c3-4bb9-99f0-a1ddfbc2bf9d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:15.371483 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e45ced-66c3-4bb9-99f0-a1ddfbc2bf9d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:15.371966 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e45ced-66c3-4bb9-99f0-a1ddfbc2bf9d None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:15.372923 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e45ced-66c3-4bb9-99f0-a1ddfbc2bf9d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:15.373439 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e45ced-66c3-4bb9-99f0-a1ddfbc2bf9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:15.375066 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e45ced-66c3-4bb9-99f0-a1ddfbc2bf9d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:15.380148 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 374/757] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Jul 21 03:31:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:15.386181 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff035f90-f593-4733-a5f0-065fe64323d0 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:15.403915 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:15.430807 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334a072-893f-4788-bbf9-18fa32bb0055 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:15.431265 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334a072-893f-4788-bbf9-18fa32bb0055 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:15.431373 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334a072-893f-4788-bbf9-18fa32bb0055 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:15.432972 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 375/758] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 03:31:15.437905 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacc257-a8a7-4b2c-8c61-7313c15d21e2 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:15.438255 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacc257-a8a7-4b2c-8c61-7313c15d21e2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:15.438413 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacc257-a8a7-4b2c-8c61-7313c15d21e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:15.456353 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-9aacc257-a8a7-4b2c-8c61-7313c15d21e2 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:15.457550 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9aacc257-a8a7-4b2c-8c61-7313c15d21e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:15.465851 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:15.572818 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff035f90-f593-4733-a5f0-065fe64323d0 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:15.583784 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 376/759] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 03:31:15.610322 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aacc257-a8a7-4b2c-8c61-7313c15d21e2 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:15.639668 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95852a-988b-4a78-9719-d6ac6597dbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:15.640696 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95852a-988b-4a78-9719-d6ac6597dbf8 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:15.641211 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95852a-988b-4a78-9719-d6ac6597dbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:15.641691 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95852a-988b-4a78-9719-d6ac6597dbf8 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:15.642740 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b95852a-988b-4a78-9719-d6ac6597dbf8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:15.643315 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b95852a-988b-4a78-9719-d6ac6597dbf8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:15.644958 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b95852a-988b-4a78-9719-d6ac6597dbf8 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:15.660822 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 384/760] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Jul 21 03:31:15 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:15.664155 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95852a-988b-4a78-9719-d6ac6597dbf8 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:15.777493 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aacc257-a8a7-4b2c-8c61-7313c15d21e2 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:15.814651 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaad440-979f-4b9f-84d8-ccc30da27e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:15.815988 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaad440-979f-4b9f-84d8-ccc30da27e36 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:15.816482 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaad440-979f-4b9f-84d8-ccc30da27e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:15.817067 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaad440-979f-4b9f-84d8-ccc30da27e36 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:15.828125 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaad440-979f-4b9f-84d8-ccc30da27e36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:31:15.837003 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-ffaad440-979f-4b9f-84d8-ccc30da27e36 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 03:31:15.837003 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:15.837003 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:15.837003 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:15.837003 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:15.837003 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:15.837003 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:15.837003 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:15.837003 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:15.837003 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:15.837003 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:15.837003 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:15.837003 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:31:15.837003 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:31:15.837003 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:31:15.837003 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:31:15.837940 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:31:15.837940 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:31:15.837940 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:31:15.837940 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:31:15.837940 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:15.837940 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:15.837940 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:15.837940 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:15.837940 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:15.837940 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:15.837940 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:15.837940 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:15.837940 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:15.837940 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:15.837940 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:15.837940 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:15.838813 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:15.838813 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:15.838813 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:15.838813 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:15.838813 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:31:15.838813 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:31:15.838813 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:31:15.838813 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:31:15.838813 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:31:15.838813 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:31:15.838813 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 03:31:15.838813 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:15.841590 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 377/761] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jul 21 03:31:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:31:15.848043 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:15.849224 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaad440-979f-4b9f-84d8-ccc30da27e36 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:15.854773 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:15.900623 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95852a-988b-4a78-9719-d6ac6597dbf8 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:15.956077 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaad440-979f-4b9f-84d8-ccc30da27e36 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:15.976402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77468ea6-8f3a-4356-96f2-1878fcbfea9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:15.976998 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77468ea6-8f3a-4356-96f2-1878fcbfea9c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:15.977279 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77468ea6-8f3a-4356-96f2-1878fcbfea9c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:15.977552 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77468ea6-8f3a-4356-96f2-1878fcbfea9c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:15.978352 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77468ea6-8f3a-4356-96f2-1878fcbfea9c None admin] RBAC: Adding query filter params (interface=public, service_id=08096cfccb864b5da2088e963195cdcb, region_id=RegionOne) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:15.978696 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77468ea6-8f3a-4356-96f2-1878fcbfea9c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:15.980068 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77468ea6-8f3a-4356-96f2-1878fcbfea9c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:15.992952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507bc9e4-58ef-43a6-b238-b13b9d0d0c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:15.993759 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507bc9e4-58ef-43a6-b238-b13b9d0d0c9e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:15.994037 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507bc9e4-58ef-43a6-b238-b13b9d0d0c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:15.994319 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507bc9e4-58ef-43a6-b238-b13b9d0d0c9e None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:15.995108 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507bc9e4-58ef-43a6-b238-b13b9d0d0c9e None admin] RBAC: Adding query filter params (name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:15.995421 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507bc9e4-58ef-43a6-b238-b13b9d0d0c9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:15.996816 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507bc9e4-58ef-43a6-b238-b13b9d0d0c9e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:15.997098 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 385/762] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Jul 21 03:31:15 2022] GET /identity/v3/endpoints?service_id=08096cfccb864b5da2088e963195cdcb&interface=public®ion_id=RegionOne => generated 194 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:16.002351 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77468ea6-8f3a-4356-96f2-1878fcbfea9c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:16.006064 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 378/763] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jul 21 03:31:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:16.011420 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507bc9e4-58ef-43a6-b238-b13b9d0d0c9e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:16.135624 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:16.173546 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77468ea6-8f3a-4356-96f2-1878fcbfea9c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:16.210436 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507bc9e4-58ef-43a6-b238-b13b9d0d0c9e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:16.241122 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f5e9ac-aae3-4f17-99cd-1b5af51d7416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:16.241710 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5e9ac-aae3-4f17-99cd-1b5af51d7416 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:16.241991 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5e9ac-aae3-4f17-99cd-1b5af51d7416 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:16.242264 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f5e9ac-aae3-4f17-99cd-1b5af51d7416 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:16.242976 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5e9ac-aae3-4f17-99cd-1b5af51d7416 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:16.244353 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f5e9ac-aae3-4f17-99cd-1b5af51d7416 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:16.253653 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 386/764] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Jul 21 03:31:16 2022] GET /identity/v3/services => generated 772 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:31:16.265853 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9d221-6be5-40bf-8caa-390fa7dd95ae None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:16.266198 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9d221-6be5-40bf-8caa-390fa7dd95ae None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:16.266477 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9d221-6be5-40bf-8caa-390fa7dd95ae None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:16.269363 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 387/765] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 03:31:16.274698 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb7ba1-2fb3-4ee3-a991-44284d67c74c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:16.275013 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb7ba1-2fb3-4ee3-a991-44284d67c74c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:16.275273 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb7ba1-2fb3-4ee3-a991-44284d67c74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:16.280520 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:16.287242 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d90ee-d9f5-45f7-8ffa-10fd9325cac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:16.288111 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d90ee-d9f5-45f7-8ffa-10fd9325cac3 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:16.288398 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d90ee-d9f5-45f7-8ffa-10fd9325cac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:16.288674 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d90ee-d9f5-45f7-8ffa-10fd9325cac3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:16.295076 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-67eb7ba1-2fb3-4ee3-a991-44284d67c74c None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:16.296401 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-67eb7ba1-2fb3-4ee3-a991-44284d67c74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:16.310312 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d90ee-d9f5-45f7-8ffa-10fd9325cac3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:16.312359 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d90ee-d9f5-45f7-8ffa-10fd9325cac3 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:16.342265 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-a28d90ee-d9f5-45f7-8ffa-10fd9325cac3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:16.342265 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:16.342265 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:16.342265 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:16.342265 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:16.342265 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:16.342265 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:16.342265 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:16.342265 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:16.342265 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:16.342265 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:16.342265 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:16.342265 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:31:16.342265 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:31:16.342265 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:31:16.343257 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:31:16.343257 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:16.343257 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:16.343257 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:16.343257 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:16.343257 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:16.343257 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:16.343257 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:16.343257 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:16.343257 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:16.343257 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:16.343257 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:16.343257 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:16.343257 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:16.343257 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:16.343257 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:16.343257 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:16.344152 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:31:16.344152 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:31:16.344152 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:16.344152 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:16.349178 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 379/766] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:16.353654 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d90ee-d9f5-45f7-8ffa-10fd9325cac3 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:16.427740 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 388/767] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 03:31:16.464647 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb7ba1-2fb3-4ee3-a991-44284d67c74c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:16.523517 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d90ee-d9f5-45f7-8ffa-10fd9325cac3 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:16.546909 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:16.577971 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ae166-2b60-4f34-9a66-907b371afc49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:16.578670 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ae166-2b60-4f34-9a66-907b371afc49 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:16.578951 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ae166-2b60-4f34-9a66-907b371afc49 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:16.579225 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ae166-2b60-4f34-9a66-907b371afc49 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:16.579952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424ae166-2b60-4f34-9a66-907b371afc49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:16.580261 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424ae166-2b60-4f34-9a66-907b371afc49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:16.582500 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424ae166-2b60-4f34-9a66-907b371afc49 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:16.593689 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb7ba1-2fb3-4ee3-a991-44284d67c74c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:16.606489 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 380/768] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:31:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:16.606489 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64069edb-e352-4b7a-a6aa-031df5a016aa None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:16.606489 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64069edb-e352-4b7a-a6aa-031df5a016aa None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:16.606489 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64069edb-e352-4b7a-a6aa-031df5a016aa None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:16.606489 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 381/769] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:31:16.606489 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64069edb-e352-4b7a-a6aa-031df5a016aa None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:16.634322 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:16.640602 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aacf1b-beef-4b96-aced-8a51003b8160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:16.641676 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aacf1b-beef-4b96-aced-8a51003b8160 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:16.642160 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aacf1b-beef-4b96-aced-8a51003b8160 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:16.642675 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aacf1b-beef-4b96-aced-8a51003b8160 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:16.653651 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aacf1b-beef-4b96-aced-8a51003b8160 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:31:16.661587 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-73aacf1b-beef-4b96-aced-8a51003b8160 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:31:16.661587 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:16.661587 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:16.661587 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:16.661587 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:16.661587 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:16.661587 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:16.661587 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:16.661587 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:16.661587 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:16.661587 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:16.661587 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:16.661587 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:31:16.661587 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:31:16.661587 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:31:16.661587 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:31:16.662553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:31:16.662553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:31:16.662553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:31:16.662553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:31:16.662553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:16.662553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:16.662553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:16.662553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:16.662553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:16.662553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:16.662553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:16.662553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:16.662553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:16.662553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:16.662553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:16.662553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:16.663391 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:16.663391 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:16.663391 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:16.663391 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:16.663391 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:31:16.663391 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:31:16.663391 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:31:16.663391 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:31:16.663391 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:31:16.663391 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:31:16.663391 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:31:16.663391 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:16.666026 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 389/770] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 03:31:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:31:16.667442 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25db06-99e9-4eb0-a156-20704e32d1b7 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:16.668019 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25db06-99e9-4eb0-a156-20704e32d1b7 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:16.668488 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd25db06-99e9-4eb0-a156-20704e32d1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:16.686007 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-dd25db06-99e9-4eb0-a156-20704e32d1b7 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:16.687598 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-dd25db06-99e9-4eb0-a156-20704e32d1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:16.746137 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64069edb-e352-4b7a-a6aa-031df5a016aa None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:16.770862 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 390/771] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 03:31:16.772745 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25db06-99e9-4eb0-a156-20704e32d1b7 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:16.787582 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df085a01-5601-41c9-863b-d0180ec894a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:16.788313 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df085a01-5601-41c9-863b-d0180ec894a0 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:16.788586 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df085a01-5601-41c9-863b-d0180ec894a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:16.788863 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df085a01-5601-41c9-863b-d0180ec894a0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:16.797901 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df085a01-5601-41c9-863b-d0180ec894a0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:16.799658 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df085a01-5601-41c9-863b-d0180ec894a0 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:16.817621 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-df085a01-5601-41c9-863b-d0180ec894a0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 03:31:16.817621 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:16.817621 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:16.817621 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:16.817621 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:16.817621 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:16.817621 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:16.817621 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:16.817621 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:16.817621 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:16.817621 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:16.817621 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:16.817621 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 03:31:16.817621 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 03:31:16.817621 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 03:31:16.817621 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 03:31:16.819472 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:16.819472 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:16.819472 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 03:31:16.819472 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:31:16.819472 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 03:31:16.819472 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:31:16.819472 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:16.819472 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:16.819472 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:16.819472 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:16.819472 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:16.819472 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:16.819472 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:16.819472 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:16.819472 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:16.819472 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:16.819472 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:16.819472 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:16.820421 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:16.820421 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:16.820421 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 03:31:16.820421 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 03:31:16.820421 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 03:31:16.820421 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 03:31:16.820421 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 03:31:16.820421 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 03:31:16.820421 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 03:31:16.820421 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:16.827424 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 382/772] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Jul 21 03:31:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:16.828476 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df085a01-5601-41c9-863b-d0180ec894a0 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:16.870874 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:16.918242 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd25db06-99e9-4eb0-a156-20704e32d1b7 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:16.942541 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:16.956192 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df085a01-5601-41c9-863b-d0180ec894a0 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:16.956874 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf725a3-a0cd-4508-b91e-441ad680b476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:16.957709 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf725a3-a0cd-4508-b91e-441ad680b476 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:16.958221 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf725a3-a0cd-4508-b91e-441ad680b476 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:16.958537 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf725a3-a0cd-4508-b91e-441ad680b476 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:16.960021 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf725a3-a0cd-4508-b91e-441ad680b476 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:16.960021 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf725a3-a0cd-4508-b91e-441ad680b476 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:16.961445 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf725a3-a0cd-4508-b91e-441ad680b476 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:16.971089 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 391/773] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:31:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:16.972077 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf725a3-a0cd-4508-b91e-441ad680b476 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:17.002244 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ba507-1cb0-441a-9cd0-f845401baa38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:17.003905 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ba507-1cb0-441a-9cd0-f845401baa38 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:17.004586 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ba507-1cb0-441a-9cd0-f845401baa38 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:17.005017 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ba507-1cb0-441a-9cd0-f845401baa38 None admin] PATH_INFO: `/v3/services/network` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:17.006372 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ba507-1cb0-441a-9cd0-f845401baa38 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:17.008302 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ba507-1cb0-441a-9cd0-f845401baa38 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:17.024041 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-6f6ba507-1cb0-441a-9cd0-f845401baa38 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 03:31:17.024041 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:17.024041 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 03:31:17.024041 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 03:31:17.024041 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 03:31:17.024041 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 03:31:17.024041 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 03:31:17.024041 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:31:17.024041 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 03:31:17.024041 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:17.024041 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 03:31:17.024041 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:17.024041 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:17.024041 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:17.024041 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:17.024041 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:17.024041 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:17.025269 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:17.025269 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:17.025269 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:17.025269 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:17.025269 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:17.025269 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:17.025269 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 03:31:17.025269 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 03:31:17.025269 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 03:31:17.025269 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 03:31:17.025269 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:17.025269 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:17.025269 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:17.025269 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:17.025269 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:17.025269 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:17.026291 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:17.026291 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:17.026291 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:17.026291 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:17.026291 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:17.026291 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:17.026291 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:17.026291 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:17.026291 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:17.026291 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:17.026291 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 03:31:17.026291 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:31:17.026291 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 03:31:17.026291 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:17.027958 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 383/774] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:31:16 2022] GET /identity/v3/services/network => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:17.029616 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ba507-1cb0-441a-9cd0-f845401baa38 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:17.089297 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf725a3-a0cd-4508-b91e-441ad680b476 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:17.133374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5a210-af93-49ff-9247-bfd386fd61f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:17.133716 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5a210-af93-49ff-9247-bfd386fd61f3 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:17.133928 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5a210-af93-49ff-9247-bfd386fd61f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:17.134212 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5a210-af93-49ff-9247-bfd386fd61f3 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:17.135091 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f5a210-af93-49ff-9247-bfd386fd61f3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:17.135407 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f5a210-af93-49ff-9247-bfd386fd61f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:17.136841 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f5a210-af93-49ff-9247-bfd386fd61f3 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:17.155740 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 392/775] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Jul 21 03:31:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:17.156715 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5a210-af93-49ff-9247-bfd386fd61f3 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:17.172626 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:17.177401 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ba507-1cb0-441a-9cd0-f845401baa38 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:17.205906 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:17.229543 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798afb51-70e3-499a-b5c9-7e927a94d340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:17.230939 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798afb51-70e3-499a-b5c9-7e927a94d340 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:17.231424 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798afb51-70e3-499a-b5c9-7e927a94d340 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:17.232465 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798afb51-70e3-499a-b5c9-7e927a94d340 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:17.244857 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798afb51-70e3-499a-b5c9-7e927a94d340 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:17.246684 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798afb51-70e3-499a-b5c9-7e927a94d340 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:17.265118 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-798afb51-70e3-499a-b5c9-7e927a94d340 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:17.265118 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:17.265118 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:17.265118 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:17.265118 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:17.265118 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:17.265118 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:17.265118 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:17.265118 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:17.265118 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:17.265118 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:17.265118 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:17.265118 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:31:17.265118 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:31:17.265118 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:31:17.266203 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:31:17.266203 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:17.266203 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:17.266203 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:17.266203 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:17.266203 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:17.266203 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:17.266203 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:17.266203 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:17.266203 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:17.266203 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:17.266203 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:17.266203 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:17.266203 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:17.266203 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:17.266203 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:17.266203 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:17.267323 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:31:17.267323 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:31:17.267323 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:17.267323 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:17.268300 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5a210-af93-49ff-9247-bfd386fd61f3 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:17.269358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 384/776] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:17.270427 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798afb51-70e3-499a-b5c9-7e927a94d340 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:17.306690 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7a5be-a851-4abf-8853-910e363e936b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:17.307593 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7a5be-a851-4abf-8853-910e363e936b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:17.307956 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7a5be-a851-4abf-8853-910e363e936b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:17.308310 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d7a5be-a851-4abf-8853-910e363e936b None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:17.309604 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d7a5be-a851-4abf-8853-910e363e936b None admin] RBAC: Adding query filter params (name=network) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:17.309604 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d7a5be-a851-4abf-8853-910e363e936b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:17.310982 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d7a5be-a851-4abf-8853-910e363e936b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:17.316166 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 393/777] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jul 21 03:31:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:17.317333 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7a5be-a851-4abf-8853-910e363e936b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:17.377711 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798afb51-70e3-499a-b5c9-7e927a94d340 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:17.413500 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b6b67-2041-4039-a088-3ec4bcfcb345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:17.414682 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b6b67-2041-4039-a088-3ec4bcfcb345 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:17.415168 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b6b67-2041-4039-a088-3ec4bcfcb345 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:17.415659 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04b6b67-2041-4039-a088-3ec4bcfcb345 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:17.424305 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d7a5be-a851-4abf-8853-910e363e936b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:17.427060 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b6b67-2041-4039-a088-3ec4bcfcb345 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:17.428561 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04b6b67-2041-4039-a088-3ec4bcfcb345 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:17.432265 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:17.446131 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-e04b6b67-2041-4039-a088-3ec4bcfcb345 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:17.446131 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:17.446131 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:17.446131 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:17.446131 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:17.446131 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:17.446131 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:17.446131 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:17.446131 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:17.446131 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:17.446131 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:17.446131 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:17.446131 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:31:17.446131 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:31:17.446131 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:31:17.447206 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:31:17.447206 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:17.447206 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:17.447206 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:17.447206 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:17.447206 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:17.447206 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:17.447206 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:17.447206 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:17.447206 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:17.447206 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:17.447206 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:17.447206 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:17.447206 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:17.447206 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:17.447206 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:17.447206 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:17.448145 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:31:17.448145 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:31:17.448145 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:17.448145 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:17.448145 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 385/778] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:17.448444 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b6b67-2041-4039-a088-3ec4bcfcb345 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:17.455272 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:17.462759 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de778c-bb4f-4223-9aa1-ed0b442a8502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:17.463720 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de778c-bb4f-4223-9aa1-ed0b442a8502 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:17.464046 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de778c-bb4f-4223-9aa1-ed0b442a8502 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:17.464285 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de778c-bb4f-4223-9aa1-ed0b442a8502 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:17.465012 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de778c-bb4f-4223-9aa1-ed0b442a8502 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:17.465323 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de778c-bb4f-4223-9aa1-ed0b442a8502 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:17.466739 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de778c-bb4f-4223-9aa1-ed0b442a8502 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:17.478602 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 394/779] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:31:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:17.479849 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414cbe1-3e33-4dfa-87bc-76a349a42a5c None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:17.480137 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414cbe1-3e33-4dfa-87bc-76a349a42a5c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:17.480418 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414cbe1-3e33-4dfa-87bc-76a349a42a5c None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:17.485589 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 395/780] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:31:17.486327 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414cbe1-3e33-4dfa-87bc-76a349a42a5c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:17.564669 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04b6b67-2041-4039-a088-3ec4bcfcb345 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:17.600808 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414cbe1-3e33-4dfa-87bc-76a349a42a5c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:17.601483 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef388dd2-1581-4316-b450-0eae7f9a4244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:17.602153 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef388dd2-1581-4316-b450-0eae7f9a4244 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:17.602442 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef388dd2-1581-4316-b450-0eae7f9a4244 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:17.602762 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef388dd2-1581-4316-b450-0eae7f9a4244 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:17.603473 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef388dd2-1581-4316-b450-0eae7f9a4244 None admin] RBAC: Adding query filter params (type=network) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:17.603777 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef388dd2-1581-4316-b450-0eae7f9a4244 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:17.605162 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef388dd2-1581-4316-b450-0eae7f9a4244 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:17.610162 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 386/781] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jul 21 03:31:17 2022] GET /identity/v3/services?type=network => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:17.610962 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef388dd2-1581-4316-b450-0eae7f9a4244 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:17.642548 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e99832-523e-4083-b4b5-ff4b9dd500a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:17.643616 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e99832-523e-4083-b4b5-ff4b9dd500a3 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:17.644229 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e99832-523e-4083-b4b5-ff4b9dd500a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:17.644509 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e99832-523e-4083-b4b5-ff4b9dd500a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:17.645237 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e99832-523e-4083-b4b5-ff4b9dd500a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:17.645548 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e99832-523e-4083-b4b5-ff4b9dd500a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:17.647730 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e99832-523e-4083-b4b5-ff4b9dd500a3 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:17.665551 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 396/782] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:31:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:17.665551 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c588215-123a-4ed0-ab13-aa25cdf05843 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:17.665551 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c588215-123a-4ed0-ab13-aa25cdf05843 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:17.665551 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c588215-123a-4ed0-ab13-aa25cdf05843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:17.680163 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-7c588215-123a-4ed0-ab13-aa25cdf05843 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:17.680920 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:17.681340 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7c588215-123a-4ed0-ab13-aa25cdf05843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:17.702271 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:17.723546 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef388dd2-1581-4316-b450-0eae7f9a4244 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:17.758242 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36103140-0db4-426f-9a63-0255c30b141d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:17.759074 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36103140-0db4-426f-9a63-0255c30b141d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:17.759360 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36103140-0db4-426f-9a63-0255c30b141d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:17.759635 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36103140-0db4-426f-9a63-0255c30b141d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:17.760943 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 397/783] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 03:31:17.761585 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c588215-123a-4ed0-ab13-aa25cdf05843 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:17.775973 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36103140-0db4-426f-9a63-0255c30b141d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:17.778477 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36103140-0db4-426f-9a63-0255c30b141d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:17.793917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-36103140-0db4-426f-9a63-0255c30b141d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 03:31:17.793917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:17.793917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:17.793917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:17.793917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:17.793917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:17.793917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:17.793917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:17.793917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:17.793917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:17.793917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:17.793917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:17.793917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 03:31:17.793917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 03:31:17.793917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 03:31:17.793917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 03:31:17.795096 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:17.795096 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:17.795096 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 03:31:17.795096 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:31:17.795096 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 03:31:17.795096 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:31:17.795096 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:17.795096 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:17.795096 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:17.795096 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:17.795096 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:17.795096 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:17.795096 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:17.795096 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:17.795096 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:17.795096 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:17.795096 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:17.795096 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:17.796073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:17.796073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:17.796073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 03:31:17.796073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 03:31:17.796073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 03:31:17.796073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 03:31:17.796073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 03:31:17.796073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 03:31:17.796073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 03:31:17.796073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:17.796073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 387/784] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Jul 21 03:31:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:17.796073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36103140-0db4-426f-9a63-0255c30b141d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:17.863430 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c588215-123a-4ed0-ab13-aa25cdf05843 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:17.899598 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f35d7-8306-4ee9-bbc6-76f38eba6861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:17.900176 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f35d7-8306-4ee9-bbc6-76f38eba6861 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:17.900464 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f35d7-8306-4ee9-bbc6-76f38eba6861 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:17.900743 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41f35d7-8306-4ee9-bbc6-76f38eba6861 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:17.901531 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f35d7-8306-4ee9-bbc6-76f38eba6861 None admin] RBAC: Adding query filter params (interface=public, service_id=68466b1553b24ec89a4bc28e5d9c440a, region_id=RegionOne) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:17.901843 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f35d7-8306-4ee9-bbc6-76f38eba6861 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:17.903244 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41f35d7-8306-4ee9-bbc6-76f38eba6861 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:17.903942 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36103140-0db4-426f-9a63-0255c30b141d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:17.912579 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 398/785] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Jul 21 03:31:17 2022] GET /identity/v3/endpoints?service_id=68466b1553b24ec89a4bc28e5d9c440a&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:17.912579 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f35d7-8306-4ee9-bbc6-76f38eba6861 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:17.934490 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:17.935015 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:17.943600 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf19ce-8e90-48ba-9a0c-050496a21ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:17.944926 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf19ce-8e90-48ba-9a0c-050496a21ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:17.945443 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf19ce-8e90-48ba-9a0c-050496a21ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:17.945561 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf19ce-8e90-48ba-9a0c-050496a21ee7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:17.952310 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf19ce-8e90-48ba-9a0c-050496a21ee7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:17.953767 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf19ce-8e90-48ba-9a0c-050496a21ee7 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:17.968584 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-87bf19ce-8e90-48ba-9a0c-050496a21ee7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:31:17.968584 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:17.968584 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:17.968584 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:17.968584 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:17.968584 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:17.968584 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:17.968584 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:17.968584 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:17.968584 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:17.968584 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:17.968584 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:17.968584 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 03:31:17.968584 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 03:31:17.968584 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 03:31:17.969445 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 03:31:17.969445 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:17.969445 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:17.969445 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:17.969445 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:17.969445 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:17.969445 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:17.969445 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:17.969445 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:17.969445 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:17.969445 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:17.969445 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:17.969445 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:17.969445 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:17.969445 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:17.969445 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:17.969445 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:17.970328 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 03:31:17.970328 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 03:31:17.970328 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 03:31:17.970328 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 03:31:17.970328 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 03:31:17.970328 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 03:31:17.970328 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:31:17.970328 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:17.970328 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 388/786] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:31:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:17.971781 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf19ce-8e90-48ba-9a0c-050496a21ee7 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:18.023926 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41f35d7-8306-4ee9-bbc6-76f38eba6861 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:18.060198 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53861c86-d1a1-40bf-b315-76faf2ac335a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:18.060997 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53861c86-d1a1-40bf-b315-76faf2ac335a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:18.061280 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53861c86-d1a1-40bf-b315-76faf2ac335a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:18.061554 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53861c86-d1a1-40bf-b315-76faf2ac335a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:18.072759 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53861c86-d1a1-40bf-b315-76faf2ac335a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:31:18.076490 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf19ce-8e90-48ba-9a0c-050496a21ee7 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:18.080835 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-53861c86-d1a1-40bf-b315-76faf2ac335a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:31:18.080835 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:18.080835 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:18.080835 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:18.080835 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:18.080835 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:18.080835 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:18.080835 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:18.080835 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:18.080835 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:18.080835 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:18.080835 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:18.080835 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:31:18.080835 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:31:18.080835 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:31:18.080835 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:31:18.081776 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:31:18.081776 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:31:18.081776 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:31:18.081776 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:31:18.081776 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:18.081776 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:18.081776 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:18.081776 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:18.081776 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:18.081776 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:18.081776 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:18.081776 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:18.081776 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:18.081776 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:18.081776 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:18.081776 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:18.088284 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:18.088284 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:18.088284 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:18.088284 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:18.088284 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:31:18.088284 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:31:18.088284 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:31:18.088284 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:31:18.088284 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:31:18.088284 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:31:18.088284 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:31:18.088284 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:18.088284 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 399/787] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 03:31:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:18.088284 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53861c86-d1a1-40bf-b315-76faf2ac335a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:18.120112 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b2342-8eea-4c4f-9f79-6c3e48bd2e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:18.121074 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b2342-8eea-4c4f-9f79-6c3e48bd2e35 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:18.121529 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b2342-8eea-4c4f-9f79-6c3e48bd2e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:18.121965 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b2342-8eea-4c4f-9f79-6c3e48bd2e35 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:18.123005 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b2342-8eea-4c4f-9f79-6c3e48bd2e35 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:18.123453 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b2342-8eea-4c4f-9f79-6c3e48bd2e35 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:18.125066 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b2342-8eea-4c4f-9f79-6c3e48bd2e35 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:18.144584 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 389/788] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Jul 21 03:31:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:18.145596 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b2342-8eea-4c4f-9f79-6c3e48bd2e35 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:18.179148 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:18.192636 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:18.203734 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53861c86-d1a1-40bf-b315-76faf2ac335a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:18.238192 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d2ee5-c487-4940-8bfe-2de23dde974c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:18.239026 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d2ee5-c487-4940-8bfe-2de23dde974c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:18.239312 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d2ee5-c487-4940-8bfe-2de23dde974c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:18.239608 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d2ee5-c487-4940-8bfe-2de23dde974c None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:18.240370 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d2ee5-c487-4940-8bfe-2de23dde974c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:18.242249 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d2ee5-c487-4940-8bfe-2de23dde974c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:18.246133 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b2342-8eea-4c4f-9f79-6c3e48bd2e35 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:18.247693 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 400/789] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Jul 21 03:31:18 2022] GET /identity/v3/services => generated 772 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:18.248548 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d2ee5-c487-4940-8bfe-2de23dde974c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:18.308333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5165bdc-008a-4aa0-8ee0-f6d5e5e55972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:18.309045 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5165bdc-008a-4aa0-8ee0-f6d5e5e55972 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:18.309332 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5165bdc-008a-4aa0-8ee0-f6d5e5e55972 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:18.309613 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5165bdc-008a-4aa0-8ee0-f6d5e5e55972 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:18.310422 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5165bdc-008a-4aa0-8ee0-f6d5e5e55972 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:18.310767 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5165bdc-008a-4aa0-8ee0-f6d5e5e55972 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:18.312251 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5165bdc-008a-4aa0-8ee0-f6d5e5e55972 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:18.326513 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 390/790] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 03:31:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:18.327419 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5165bdc-008a-4aa0-8ee0-f6d5e5e55972 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:18.382797 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d2ee5-c487-4940-8bfe-2de23dde974c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:18.421270 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4ec83-b989-4354-b522-382502377e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:18.422323 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4ec83-b989-4354-b522-382502377e32 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:18.422873 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4ec83-b989-4354-b522-382502377e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:18.423290 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d4ec83-b989-4354-b522-382502377e32 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:18.424196 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d4ec83-b989-4354-b522-382502377e32 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:18.424648 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d4ec83-b989-4354-b522-382502377e32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:18.427103 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d4ec83-b989-4354-b522-382502377e32 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:18.438439 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 401/791] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:31:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:18.439554 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4ec83-b989-4354-b522-382502377e32 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:18.449907 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:18.463932 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5165bdc-008a-4aa0-8ee0-f6d5e5e55972 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:18.473086 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:18.504471 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2bde3a-95b8-4355-ad54-3660ece700c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:18.505381 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2bde3a-95b8-4355-ad54-3660ece700c0 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:18.505778 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2bde3a-95b8-4355-ad54-3660ece700c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:18.506055 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2bde3a-95b8-4355-ad54-3660ece700c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:18.517508 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2bde3a-95b8-4355-ad54-3660ece700c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:18.519157 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2bde3a-95b8-4355-ad54-3660ece700c0 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:18.538147 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-2e2bde3a-95b8-4355-ad54-3660ece700c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:18.538147 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:18.538147 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:18.538147 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:18.538147 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:18.538147 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:18.538147 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:18.538147 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:18.538147 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:18.538147 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:18.538147 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:18.538147 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:18.538147 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:31:18.538147 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:31:18.538147 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:31:18.539103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:31:18.539103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:18.539103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:18.539103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:18.539103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:18.539103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:18.539103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:18.539103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:18.539103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:18.539103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:18.539103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:18.539103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:18.539103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:18.539103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:18.539103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:18.539103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:18.539103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:18.540561 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:31:18.540561 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:31:18.540561 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:18.540561 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:18.540561 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 391/792] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:18.540849 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2bde3a-95b8-4355-ad54-3660ece700c0 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:18.560808 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d4ec83-b989-4354-b522-382502377e32 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:18.594363 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffbc72e-ebc7-4ccb-af2d-eb13e97d39bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:18.595290 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbc72e-ebc7-4ccb-af2d-eb13e97d39bd None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:18.595560 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbc72e-ebc7-4ccb-af2d-eb13e97d39bd None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:18.595835 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffbc72e-ebc7-4ccb-af2d-eb13e97d39bd None admin] PATH_INFO: `/v3/projects/0432303daa8b4304a8e07032d6a80781/users/73fad109df9f449e8ac5f38749c01ace/roles/3d204e16b7214bf29bde33739ca9006a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:18.610835 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffbc72e-ebc7-4ccb-af2d-eb13e97d39bd None admin] RBAC: Authorizing `identity:create_grant(project_id=0432303daa8b4304a8e07032d6a80781, user_id=73fad109df9f449e8ac5f38749c01ace, role_id=3d204e16b7214bf29bde33739ca9006a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:18.612290 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffbc72e-ebc7-4ccb-af2d-eb13e97d39bd None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:18.636803 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 402/793] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 03:31:18 2022] PUT /identity/v3/projects/0432303daa8b4304a8e07032d6a80781/users/73fad109df9f449e8ac5f38749c01ace/roles/3d204e16b7214bf29bde33739ca9006a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:31:18.636803 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bdcc4d-80d7-4e26-afb7-8e12db50338e None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:18.636803 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bdcc4d-80d7-4e26-afb7-8e12db50338e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:18.636803 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bdcc4d-80d7-4e26-afb7-8e12db50338e None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:18.636803 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 403/794] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:31:18.636803 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bdcc4d-80d7-4e26-afb7-8e12db50338e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:18.644697 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2bde3a-95b8-4355-ad54-3660ece700c0 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:18.687701 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc9b620-f934-456b-9ac8-adc33ee31505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:18.688571 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9b620-f934-456b-9ac8-adc33ee31505 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:18.688797 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9b620-f934-456b-9ac8-adc33ee31505 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:18.689067 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc9b620-f934-456b-9ac8-adc33ee31505 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:18.706483 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc9b620-f934-456b-9ac8-adc33ee31505 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:18.706483 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc9b620-f934-456b-9ac8-adc33ee31505 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:18.712549 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:18.731662 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-bfc9b620-f934-456b-9ac8-adc33ee31505 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:18.731662 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:18.731662 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:18.731662 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:18.731662 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:18.731662 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:18.731662 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:18.731662 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:18.731662 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:18.731662 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:18.731662 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:18.731662 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:18.731662 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:31:18.731662 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:31:18.731662 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:31:18.732747 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:31:18.732747 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:18.732747 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:18.732747 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:18.732747 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:18.732747 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:18.732747 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:18.732747 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:18.732747 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:18.732747 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:18.732747 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:18.732747 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:18.732747 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:18.732747 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:18.732747 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:18.732747 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:18.732747 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:18.733628 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:31:18.733628 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:31:18.733628 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:18.733628 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:18.741356 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 392/795] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:18.743224 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71b312-e45a-4570-b7f0-d3035d70dd78 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:18.743791 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71b312-e45a-4570-b7f0-d3035d70dd78 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:18.744244 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71b312-e45a-4570-b7f0-d3035d70dd78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:18.763194 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-8c71b312-e45a-4570-b7f0-d3035d70dd78 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:18.764805 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8c71b312-e45a-4570-b7f0-d3035d70dd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:18.765047 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bdcc4d-80d7-4e26-afb7-8e12db50338e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:18.769992 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:18.816510 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e1d301-3003-4f6c-a036-82b1df456c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:18.817548 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1d301-3003-4f6c-a036-82b1df456c44 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:18.818045 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1d301-3003-4f6c-a036-82b1df456c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:18.818544 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1d301-3003-4f6c-a036-82b1df456c44 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:18.819504 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e1d301-3003-4f6c-a036-82b1df456c44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:18.819960 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e1d301-3003-4f6c-a036-82b1df456c44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:18.821533 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e1d301-3003-4f6c-a036-82b1df456c44 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:18.836124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 404/796] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:31:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:18.837288 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e1d301-3003-4f6c-a036-82b1df456c44 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:18.851420 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 393/797] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 03:31:18.852200 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c71b312-e45a-4570-b7f0-d3035d70dd78 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:18.963957 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c71b312-e45a-4570-b7f0-d3035d70dd78 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:18.968660 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e1d301-3003-4f6c-a036-82b1df456c44 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:18.986406 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:19.012092 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e2607-f570-429e-b71a-33ea8ce91c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:19.012846 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e2607-f570-429e-b71a-33ea8ce91c57 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:19.013666 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e2607-f570-429e-b71a-33ea8ce91c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:19.014428 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e2607-f570-429e-b71a-33ea8ce91c57 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:19.015554 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e2607-f570-429e-b71a-33ea8ce91c57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:19.016443 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e2607-f570-429e-b71a-33ea8ce91c57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:19.017161 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d930528-19eb-437b-9d06-3a8381502130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:19.018640 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0e2607-f570-429e-b71a-33ea8ce91c57 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:19.019477 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d930528-19eb-437b-9d06-3a8381502130 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:19.019924 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d930528-19eb-437b-9d06-3a8381502130 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:19.020680 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d930528-19eb-437b-9d06-3a8381502130 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:19.032436 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d930528-19eb-437b-9d06-3a8381502130 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:19.034183 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d930528-19eb-437b-9d06-3a8381502130 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:19.037184 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:19.037427 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 405/798] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:31:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:19.038987 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e2607-f570-429e-b71a-33ea8ce91c57 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:19.055735 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-1d930528-19eb-437b-9d06-3a8381502130 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:31:19.055735 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:19.055735 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:19.055735 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:19.055735 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:19.055735 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:19.055735 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:19.055735 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:19.055735 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:19.055735 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:19.055735 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:19.055735 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:19.055735 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 03:31:19.055735 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 03:31:19.055735 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 03:31:19.056840 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 03:31:19.056840 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:19.056840 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:19.056840 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:19.056840 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:19.056840 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:19.056840 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:19.056840 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:19.056840 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:19.056840 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:19.056840 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:19.056840 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:19.056840 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:19.056840 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:19.056840 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:19.056840 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:19.056840 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:19.057949 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 03:31:19.057949 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 03:31:19.057949 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 03:31:19.057949 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 03:31:19.057949 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 03:31:19.057949 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 03:31:19.057949 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:31:19.057949 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:19.060665 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 394/799] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:31:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:19.061959 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d930528-19eb-437b-9d06-3a8381502130 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:19.149845 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e2607-f570-429e-b71a-33ea8ce91c57 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:19.178151 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d930528-19eb-437b-9d06-3a8381502130 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:19.185949 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e2ac4-9ed9-4f1e-8c65-a751ee7a4884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:19.186934 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e2ac4-9ed9-4f1e-8c65-a751ee7a4884 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:19.187318 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e2ac4-9ed9-4f1e-8c65-a751ee7a4884 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:19.187711 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e2ac4-9ed9-4f1e-8c65-a751ee7a4884 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:19.188464 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e2ac4-9ed9-4f1e-8c65-a751ee7a4884 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:19.189988 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e2ac4-9ed9-4f1e-8c65-a751ee7a4884 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:19.202932 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-4a6e2ac4-9ed9-4f1e-8c65-a751ee7a4884 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 03:31:19.202932 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:19.202932 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 03:31:19.202932 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 03:31:19.202932 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 03:31:19.202932 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 03:31:19.202932 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 03:31:19.202932 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:31:19.202932 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 03:31:19.202932 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:19.202932 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 03:31:19.202932 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:19.202932 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:19.202932 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:19.202932 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:19.202932 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:19.204054 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:19.204054 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:19.204054 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:19.204054 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:19.204054 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:19.204054 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:19.204054 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:19.204054 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 03:31:19.204054 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 03:31:19.204054 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 03:31:19.204054 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 03:31:19.204054 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:19.204054 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:19.204054 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:19.204054 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:19.204054 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:19.204891 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:19.204891 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:19.204891 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:19.204891 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:19.204891 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:19.204891 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:19.204891 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:19.204891 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:19.204891 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:19.204891 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:19.204891 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:19.204891 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 03:31:19.204891 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:31:19.204891 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 03:31:19.204891 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:19.205692 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 406/800] 10.222.0.20 () {56 vars in 1129 bytes} [Thu Jul 21 03:31:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:19.205692 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e2ac4-9ed9-4f1e-8c65-a751ee7a4884 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:19.220420 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2e0c5-2afb-4b2f-8f2c-f36d31fd19c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:19.221162 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2e0c5-2afb-4b2f-8f2c-f36d31fd19c7 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:19.221547 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2e0c5-2afb-4b2f-8f2c-f36d31fd19c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:19.221832 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d2e0c5-2afb-4b2f-8f2c-f36d31fd19c7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:19.230382 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d2e0c5-2afb-4b2f-8f2c-f36d31fd19c7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:19.231923 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d2e0c5-2afb-4b2f-8f2c-f36d31fd19c7 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:19.247524 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-f8d2e0c5-2afb-4b2f-8f2c-f36d31fd19c7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 03:31:19.247524 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:19.247524 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:19.247524 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:19.247524 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:19.247524 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:19.247524 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:19.247524 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:19.247524 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:19.247524 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:19.247524 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:19.247524 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:19.247524 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 03:31:19.247524 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 03:31:19.247524 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 03:31:19.247524 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 03:31:19.249690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:19.249690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:19.249690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 03:31:19.249690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:31:19.249690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 03:31:19.249690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:31:19.249690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:19.249690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:19.249690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:19.249690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:19.249690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:19.249690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:19.249690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:19.249690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:19.249690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:19.249690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:19.249690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:19.249690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:19.252047 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:19.252047 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:19.252047 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 03:31:19.252047 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 03:31:19.252047 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 03:31:19.252047 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 03:31:19.252047 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 03:31:19.252047 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 03:31:19.252047 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 03:31:19.252047 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:19.252047 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 395/801] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 03:31:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:19.252047 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2e0c5-2afb-4b2f-8f2c-f36d31fd19c7 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:19.262480 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:19.317973 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e2ac4-9ed9-4f1e-8c65-a751ee7a4884 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:19.318269 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:19.353107 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f029537-20c5-4145-a654-98f2c78dea0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:19.353883 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f029537-20c5-4145-a654-98f2c78dea0d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:19.354234 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f029537-20c5-4145-a654-98f2c78dea0d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:19.354605 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f029537-20c5-4145-a654-98f2c78dea0d None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:19.355459 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f029537-20c5-4145-a654-98f2c78dea0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:19.355834 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f029537-20c5-4145-a654-98f2c78dea0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:19.357332 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f029537-20c5-4145-a654-98f2c78dea0d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:19.363550 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d2e0c5-2afb-4b2f-8f2c-f36d31fd19c7 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:19.370199 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 407/802] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 03:31:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:19.371129 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f029537-20c5-4145-a654-98f2c78dea0d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:19.407560 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71bb918-b29f-4940-be17-816b8b391b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:19.408236 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71bb918-b29f-4940-be17-816b8b391b8c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:19.408521 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71bb918-b29f-4940-be17-816b8b391b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:19.408798 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71bb918-b29f-4940-be17-816b8b391b8c None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:19.409511 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71bb918-b29f-4940-be17-816b8b391b8c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:19.410450 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71bb918-b29f-4940-be17-816b8b391b8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:19.412144 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71bb918-b29f-4940-be17-816b8b391b8c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:19.421780 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 396/803] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Jul 21 03:31:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:19.422639 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71bb918-b29f-4940-be17-816b8b391b8c None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:19.476696 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f029537-20c5-4145-a654-98f2c78dea0d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:19.486288 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:19.512756 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85589f55-42b2-469b-a54d-778507404041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:19.513429 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85589f55-42b2-469b-a54d-778507404041 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:19.513718 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85589f55-42b2-469b-a54d-778507404041 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:19.513996 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85589f55-42b2-469b-a54d-778507404041 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:19.514930 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85589f55-42b2-469b-a54d-778507404041 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:19.515242 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85589f55-42b2-469b-a54d-778507404041 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:19.516727 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85589f55-42b2-469b-a54d-778507404041 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:19.538820 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71bb918-b29f-4940-be17-816b8b391b8c None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:19.538997 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 408/804] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Jul 21 03:31:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:19.539715 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85589f55-42b2-469b-a54d-778507404041 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:19.578747 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:19.582813 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4782370-e605-404b-85d0-2632d1a01c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:19.584168 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4782370-e605-404b-85d0-2632d1a01c81 None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:19.584991 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4782370-e605-404b-85d0-2632d1a01c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:19.585281 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4782370-e605-404b-85d0-2632d1a01c81 None admin] PATH_INFO: `/v3/projects/0432303daa8b4304a8e07032d6a80781/users/cefbe2d0c739428ab0d4dfeaed6c37ab/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:19.588450 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4782370-e605-404b-85d0-2632d1a01c81 None admin] RBAC: Authorizing `identity:create_grant(project_id=0432303daa8b4304a8e07032d6a80781, user_id=cefbe2d0c739428ab0d4dfeaed6c37ab, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:19.590654 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4782370-e605-404b-85d0-2632d1a01c81 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:19.609696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 397/805] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 03:31:19 2022] PUT /identity/v3/projects/0432303daa8b4304a8e07032d6a80781/users/cefbe2d0c739428ab0d4dfeaed6c37ab/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:31:19.616035 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4782370-e605-404b-85d0-2632d1a01c81 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:19.684360 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85589f55-42b2-469b-a54d-778507404041 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:19.738434 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9baa78-7dc8-43c7-a472-265d071ccae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:19.739107 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9baa78-7dc8-43c7-a472-265d071ccae3 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:19.739395 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9baa78-7dc8-43c7-a472-265d071ccae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:19.739671 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9baa78-7dc8-43c7-a472-265d071ccae3 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:19.740442 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9baa78-7dc8-43c7-a472-265d071ccae3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:19.741337 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9baa78-7dc8-43c7-a472-265d071ccae3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:19.743542 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9baa78-7dc8-43c7-a472-265d071ccae3 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:19.749627 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 409/806] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Jul 21 03:31:19 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:19.756991 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9baa78-7dc8-43c7-a472-265d071ccae3 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:19.804800 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:19.827761 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4782370-e605-404b-85d0-2632d1a01c81 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:19.882632 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba23d770-be9b-40db-969e-53842beeb4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:19.883773 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23d770-be9b-40db-969e-53842beeb4c1 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:19.884067 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23d770-be9b-40db-969e-53842beeb4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:19.885057 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23d770-be9b-40db-969e-53842beeb4c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:19.901472 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba23d770-be9b-40db-969e-53842beeb4c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:19.903351 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba23d770-be9b-40db-969e-53842beeb4c1 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:19.924943 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-ba23d770-be9b-40db-969e-53842beeb4c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:19.924943 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:19.924943 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:19.924943 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:19.924943 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:19.924943 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:19.924943 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:19.924943 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:19.924943 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:19.924943 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:19.924943 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:19.924943 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:19.924943 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:31:19.924943 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:31:19.924943 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:31:19.925884 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:31:19.925884 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:19.925884 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:19.925884 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:19.925884 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:19.925884 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:19.925884 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:19.925884 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:19.925884 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:19.925884 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:19.925884 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:19.925884 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:19.925884 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:19.925884 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:19.925884 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:19.925884 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:19.925884 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:19.927009 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:31:19.927009 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:31:19.927009 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:19.927009 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:19.927009 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 398/807] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:19.933706 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba23d770-be9b-40db-969e-53842beeb4c1 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:19.936530 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9baa78-7dc8-43c7-a472-265d071ccae3 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:19.973493 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b84c8-f38c-47dd-ad7d-91199c425eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:19.975684 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b84c8-f38c-47dd-ad7d-91199c425eea None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:19.976240 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b84c8-f38c-47dd-ad7d-91199c425eea None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:19.976843 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b84c8-f38c-47dd-ad7d-91199c425eea None admin] PATH_INFO: `/v3/endpoints` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:19.977819 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b84c8-f38c-47dd-ad7d-91199c425eea None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:19.979458 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b84c8-f38c-47dd-ad7d-91199c425eea None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:19.991465 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:20.018365 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 410/808] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Jul 21 03:31:19 2022] POST /identity/v3/endpoints => generated 346 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:31:20.073137 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba23d770-be9b-40db-969e-53842beeb4c1 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:20.123982 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e90bba-3c98-4e88-8a1a-ac71cabb432f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:20.124741 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e90bba-3c98-4e88-8a1a-ac71cabb432f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:20.125025 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e90bba-3c98-4e88-8a1a-ac71cabb432f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:20.125354 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e90bba-3c98-4e88-8a1a-ac71cabb432f None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:20.126083 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e90bba-3c98-4e88-8a1a-ac71cabb432f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:20.126437 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e90bba-3c98-4e88-8a1a-ac71cabb432f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:20.127840 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e90bba-3c98-4e88-8a1a-ac71cabb432f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:20.145942 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 399/809] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:31:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:20.151940 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b84c8-f38c-47dd-ad7d-91199c425eea None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:20.256248 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:20.288081 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b84c8-f38c-47dd-ad7d-91199c425eea None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:20.336388 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46175a50-c5d3-4e27-bb4e-12118138dcc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:20.337554 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46175a50-c5d3-4e27-bb4e-12118138dcc1 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:20.338085 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46175a50-c5d3-4e27-bb4e-12118138dcc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:20.338588 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46175a50-c5d3-4e27-bb4e-12118138dcc1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:20.353012 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46175a50-c5d3-4e27-bb4e-12118138dcc1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:20.354852 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46175a50-c5d3-4e27-bb4e-12118138dcc1 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:20.373272 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-46175a50-c5d3-4e27-bb4e-12118138dcc1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:31:20.373272 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:20.373272 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:20.373272 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:20.373272 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:20.373272 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:20.373272 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:20.373272 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:20.373272 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:20.373272 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:20.373272 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:20.373272 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:20.373272 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 03:31:20.373272 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 03:31:20.373272 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 03:31:20.374282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 03:31:20.374282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:20.374282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:20.374282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:20.374282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:20.374282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:20.374282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:20.374282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:20.374282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:20.374282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:20.374282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:20.374282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:20.374282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:20.374282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:20.374282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:20.374282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:20.374282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:20.375206 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 03:31:20.375206 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 03:31:20.375206 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 03:31:20.375206 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 03:31:20.375206 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 03:31:20.375206 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 03:31:20.375206 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:31:20.375206 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:20.377657 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 411/810] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:31:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:20.385366 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e90bba-3c98-4e88-8a1a-ac71cabb432f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:20.491506 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:20.502375 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e90bba-3c98-4e88-8a1a-ac71cabb432f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:20.505671 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a526244-9e1b-437f-a937-6a20c1d78e50 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:20.505964 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a526244-9e1b-437f-a937-6a20c1d78e50 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:20.506341 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a526244-9e1b-437f-a937-6a20c1d78e50 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:20.507849 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 412/811] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 03:31:20.513823 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90ebc9-8781-4ea3-8a4c-2be8e9100a8d None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:20.513823 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90ebc9-8781-4ea3-8a4c-2be8e9100a8d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:20.513823 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90ebc9-8781-4ea3-8a4c-2be8e9100a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:20.533643 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-0c90ebc9-8781-4ea3-8a4c-2be8e9100a8d None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:20.535235 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0c90ebc9-8781-4ea3-8a4c-2be8e9100a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:20.547714 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da535f-73d7-4ac8-8381-19e46aa9c781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:20.548381 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da535f-73d7-4ac8-8381-19e46aa9c781 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:20.548665 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da535f-73d7-4ac8-8381-19e46aa9c781 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:20.548940 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da535f-73d7-4ac8-8381-19e46aa9c781 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:20.549733 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da535f-73d7-4ac8-8381-19e46aa9c781 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:20.550044 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da535f-73d7-4ac8-8381-19e46aa9c781 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:20.551638 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da535f-73d7-4ac8-8381-19e46aa9c781 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:20.566730 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 400/812] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 03:31:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:20.574477 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da535f-73d7-4ac8-8381-19e46aa9c781 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:20.615354 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 413/813] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 03:31:20.641308 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c90ebc9-8781-4ea3-8a4c-2be8e9100a8d None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:20.701255 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da535f-73d7-4ac8-8381-19e46aa9c781 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:20.745014 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86e0b1-86c3-4f4e-b0f6-820946b8f23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:20.745914 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86e0b1-86c3-4f4e-b0f6-820946b8f23a None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:20.746197 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86e0b1-86c3-4f4e-b0f6-820946b8f23a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:20.746554 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86e0b1-86c3-4f4e-b0f6-820946b8f23a None admin] PATH_INFO: `/v3/projects/0432303daa8b4304a8e07032d6a80781/users/ce8bc228892e45c0a7d1b529c2f9a8f2/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:20.748585 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a86e0b1-86c3-4f4e-b0f6-820946b8f23a None admin] RBAC: Authorizing `identity:create_grant(project_id=0432303daa8b4304a8e07032d6a80781, user_id=ce8bc228892e45c0a7d1b529c2f9a8f2, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:20.750017 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a86e0b1-86c3-4f4e-b0f6-820946b8f23a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:20.767665 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 401/814] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 03:31:20 2022] PUT /identity/v3/projects/0432303daa8b4304a8e07032d6a80781/users/ce8bc228892e45c0a7d1b529c2f9a8f2/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:31:20.827943 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:20.875813 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c90ebc9-8781-4ea3-8a4c-2be8e9100a8d None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:20.928095 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a46a5-cadd-4d1d-9a65-488f3d610c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:20.928916 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a46a5-cadd-4d1d-9a65-488f3d610c1b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:20.929207 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a46a5-cadd-4d1d-9a65-488f3d610c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:20.929479 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a46a5-cadd-4d1d-9a65-488f3d610c1b None admin] PATH_INFO: `/v3/services/network` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:20.930147 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a46a5-cadd-4d1d-9a65-488f3d610c1b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:20.931590 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a46a5-cadd-4d1d-9a65-488f3d610c1b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:20.947485 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-8e7a46a5-cadd-4d1d-9a65-488f3d610c1b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 03:31:20.947485 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:20.947485 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 03:31:20.947485 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 03:31:20.947485 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 03:31:20.947485 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 03:31:20.947485 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 03:31:20.947485 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:31:20.947485 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 03:31:20.947485 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:20.947485 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 03:31:20.947485 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:20.947485 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:20.947485 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:20.947485 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:20.947485 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:20.947485 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:20.948530 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:20.948530 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:20.948530 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:20.948530 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:20.948530 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:20.948530 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:20.948530 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 03:31:20.948530 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 03:31:20.948530 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 03:31:20.948530 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 03:31:20.948530 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:20.948530 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:20.948530 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:20.948530 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:20.948530 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:20.948530 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:20.949362 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:20.949362 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:20.949362 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:20.949362 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:20.949362 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:20.949362 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:20.949362 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:20.949362 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:20.949362 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:20.949362 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:20.949362 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 03:31:20.949362 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:31:20.949362 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 03:31:20.949362 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:20.949362 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 414/815] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:31:20 2022] GET /identity/v3/services/network => generated 88 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:20.955449 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86e0b1-86c3-4f4e-b0f6-820946b8f23a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:20.992745 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:21.039879 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60f256-cec8-413c-992a-837e1972ae10 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:21.040162 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60f256-cec8-413c-992a-837e1972ae10 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:21.040349 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c60f256-cec8-413c-992a-837e1972ae10 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:21.041969 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 415/816] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 03:31:21.046845 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da392b-4360-475d-a346-a0f224ae96b6 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:21.047132 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da392b-4360-475d-a346-a0f224ae96b6 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:21.047411 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21da392b-4360-475d-a346-a0f224ae96b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:21.071266 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-21da392b-4360-475d-a346-a0f224ae96b6 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:21.072701 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-21da392b-4360-475d-a346-a0f224ae96b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:21.085734 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86e0b1-86c3-4f4e-b0f6-820946b8f23a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:21.157321 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0105c75-2972-4491-a7d3-deacb9b8208a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:21.158000 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0105c75-2972-4491-a7d3-deacb9b8208a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:21.158278 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0105c75-2972-4491-a7d3-deacb9b8208a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:21.158580 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0105c75-2972-4491-a7d3-deacb9b8208a None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:21.159376 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0105c75-2972-4491-a7d3-deacb9b8208a None admin] RBAC: Adding query filter params (name=network) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:21.160335 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0105c75-2972-4491-a7d3-deacb9b8208a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:21.161071 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0105c75-2972-4491-a7d3-deacb9b8208a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:21.166450 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 402/817] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jul 21 03:31:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:21.171951 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0105c75-2972-4491-a7d3-deacb9b8208a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:21.217110 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 416/818] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 03:31:21.269949 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da392b-4360-475d-a346-a0f224ae96b6 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:21.273216 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:21.340140 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:21.340666 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0105c75-2972-4491-a7d3-deacb9b8208a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:21.385136 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21da392b-4360-475d-a346-a0f224ae96b6 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:21.420909 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37134cc0-8e92-4a4e-8083-47d801f62c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:21.421988 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37134cc0-8e92-4a4e-8083-47d801f62c29 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:21.422280 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37134cc0-8e92-4a4e-8083-47d801f62c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:21.422867 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37134cc0-8e92-4a4e-8083-47d801f62c29 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:21.423596 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37134cc0-8e92-4a4e-8083-47d801f62c29 None admin] RBAC: Adding query filter params (type=network) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:21.423908 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37134cc0-8e92-4a4e-8083-47d801f62c29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:21.425374 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37134cc0-8e92-4a4e-8083-47d801f62c29 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:21.427151 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af803e-f8ab-42a5-87fa-1fa46027617a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:21.429152 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af803e-f8ab-42a5-87fa-1fa46027617a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:21.429629 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af803e-f8ab-42a5-87fa-1fa46027617a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:21.430013 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af803e-f8ab-42a5-87fa-1fa46027617a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:21.431380 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 403/819] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jul 21 03:31:21 2022] GET /identity/v3/services?type=network => generated 350 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:31:21.437336 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37134cc0-8e92-4a4e-8083-47d801f62c29 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:21.447911 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af803e-f8ab-42a5-87fa-1fa46027617a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:31:21.457570 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-a0af803e-f8ab-42a5-87fa-1fa46027617a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 03:31:21.457570 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:21.457570 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:21.457570 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:21.457570 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:21.457570 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:21.457570 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:21.457570 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:21.457570 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:21.457570 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:21.457570 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:21.457570 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:21.457570 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:31:21.457570 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:31:21.457570 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:31:21.457570 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:31:21.458546 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:31:21.458546 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:31:21.458546 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:31:21.458546 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:31:21.458546 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:21.458546 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:21.458546 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:21.458546 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:21.458546 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:21.458546 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:21.458546 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:21.458546 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:21.458546 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:21.458546 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:21.458546 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:21.458546 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:21.459457 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:21.459457 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:21.459457 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:21.459457 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:21.459457 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:31:21.459457 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:31:21.459457 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:31:21.459457 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:31:21.459457 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:31:21.459457 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:31:21.459457 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 03:31:21.459457 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:21.462153 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 417/820] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jul 21 03:31:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:31:21.468586 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af803e-f8ab-42a5-87fa-1fa46027617a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:21.583592 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af803e-f8ab-42a5-87fa-1fa46027617a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:21.609424 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:21.623865 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afcecd8-e779-43e5-b192-e0f32949140d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:21.625125 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afcecd8-e779-43e5-b192-e0f32949140d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:21.625610 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afcecd8-e779-43e5-b192-e0f32949140d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:21.626156 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afcecd8-e779-43e5-b192-e0f32949140d None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:21.627135 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afcecd8-e779-43e5-b192-e0f32949140d None admin] RBAC: Adding query filter params (name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:21.627662 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afcecd8-e779-43e5-b192-e0f32949140d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:21.629295 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afcecd8-e779-43e5-b192-e0f32949140d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:21.639773 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 418/821] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jul 21 03:31:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:31:21.645592 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afcecd8-e779-43e5-b192-e0f32949140d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:21.717446 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37134cc0-8e92-4a4e-8083-47d801f62c29 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:21.755428 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afcecd8-e779-43e5-b192-e0f32949140d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:21.791721 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a54a0-3456-4e81-9485-7de8cb11bae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:21.792370 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a7d0e0-73db-4ad5-89c0-40a69fafc544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:21.792492 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a54a0-3456-4e81-9485-7de8cb11bae6 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:21.792685 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a54a0-3456-4e81-9485-7de8cb11bae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:21.793041 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a54a0-3456-4e81-9485-7de8cb11bae6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:21.793809 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124a54a0-3456-4e81-9485-7de8cb11bae6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:21.794158 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7d0e0-73db-4ad5-89c0-40a69fafc544 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:21.794672 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7d0e0-73db-4ad5-89c0-40a69fafc544 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:21.795155 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7d0e0-73db-4ad5-89c0-40a69fafc544 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:21.795256 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124a54a0-3456-4e81-9485-7de8cb11bae6 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:21.807437 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a7d0e0-73db-4ad5-89c0-40a69fafc544 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:21.809155 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a7d0e0-73db-4ad5-89c0-40a69fafc544 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:21.814174 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:21.828692 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-56a7d0e0-73db-4ad5-89c0-40a69fafc544 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:21.828692 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:21.828692 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:21.828692 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:21.828692 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:21.828692 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:21.828692 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:21.828692 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:21.828692 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:21.828692 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:21.828692 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:21.828692 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:21.828692 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:31:21.828692 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:31:21.828692 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:31:21.829753 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:31:21.829753 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:21.829753 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:21.829753 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:21.829753 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:21.829753 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:21.829753 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:21.829753 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:21.829753 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:21.829753 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:21.829753 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:21.829753 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:21.829753 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:21.829753 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:21.829753 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:21.829753 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:21.829753 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:21.830691 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:31:21.830691 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:31:21.830691 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:21.830691 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:21.835023 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 419/822] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:21.840731 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a7d0e0-73db-4ad5-89c0-40a69fafc544 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:21.841758 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 404/823] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Jul 21 03:31:21 2022] POST /identity/v3/endpoints => generated 327 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:31:21.893827 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:21.973301 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a7d0e0-73db-4ad5-89c0-40a69fafc544 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:22.133890 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0075d5-b33c-477b-96ba-84122afa7ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:22.134610 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0075d5-b33c-477b-96ba-84122afa7ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:22.134891 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0075d5-b33c-477b-96ba-84122afa7ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:22.135161 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0075d5-b33c-477b-96ba-84122afa7ec8 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:22.135889 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0075d5-b33c-477b-96ba-84122afa7ec8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:22.136190 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0075d5-b33c-477b-96ba-84122afa7ec8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:22.137542 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0075d5-b33c-477b-96ba-84122afa7ec8 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:22.150909 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 420/824] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:31:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:31:22.156236 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0075d5-b33c-477b-96ba-84122afa7ec8 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:22.156719 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363232a-7bdf-4d2c-a113-b4a719b55caf None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:22.157015 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363232a-7bdf-4d2c-a113-b4a719b55caf None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:22.157297 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363232a-7bdf-4d2c-a113-b4a719b55caf None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:22.158932 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 405/825] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:31:22.164925 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde9554-56bd-41b4-9338-2e6d06363a70 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:22.165497 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde9554-56bd-41b4-9338-2e6d06363a70 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:22.166105 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde9554-56bd-41b4-9338-2e6d06363a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:22.185471 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ddde9554-56bd-41b4-9338-2e6d06363a70 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:22.187133 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ddde9554-56bd-41b4-9338-2e6d06363a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:22.261808 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0075d5-b33c-477b-96ba-84122afa7ec8 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:22.267037 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 406/826] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:22 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 03:31:22.269753 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:22.298680 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde9554-56bd-41b4-9338-2e6d06363a70 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:22.301260 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dbf651-dbc8-4a88-a0a9-d7be0286f58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:22.302086 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbf651-dbc8-4a88-a0a9-d7be0286f58e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:22.302365 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbf651-dbc8-4a88-a0a9-d7be0286f58e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:22.302661 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbf651-dbc8-4a88-a0a9-d7be0286f58e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:22.311757 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dbf651-dbc8-4a88-a0a9-d7be0286f58e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:22.314130 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dbf651-dbc8-4a88-a0a9-d7be0286f58e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:22.332070 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-69dbf651-dbc8-4a88-a0a9-d7be0286f58e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 03:31:22.332070 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:22.332070 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:22.332070 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:22.332070 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:22.332070 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:22.332070 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:22.332070 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:22.332070 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:22.332070 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:22.332070 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:22.332070 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:22.332070 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 03:31:22.332070 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 03:31:22.332070 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 03:31:22.332070 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 03:31:22.333063 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:22.333063 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:22.333063 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 03:31:22.333063 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:31:22.333063 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 03:31:22.333063 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:31:22.333063 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:22.333063 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:22.333063 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:22.333063 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:22.333063 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:22.333063 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:22.333063 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:22.333063 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:22.333063 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:22.333063 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:22.333063 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:22.333063 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:22.335289 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:22.335289 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:22.335289 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 03:31:22.335289 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 03:31:22.335289 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 03:31:22.335289 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 03:31:22.335289 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 03:31:22.335289 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 03:31:22.335289 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 03:31:22.335289 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:22.335289 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 421/827] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Jul 21 03:31:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:22.339847 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dbf651-dbc8-4a88-a0a9-d7be0286f58e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:22.434935 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde9554-56bd-41b4-9338-2e6d06363a70 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:22.465469 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dbf651-dbc8-4a88-a0a9-d7be0286f58e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:22.468065 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:22.479113 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d690b3-3c2b-43c2-854a-f923e4f2ab1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:22.480190 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d690b3-3c2b-43c2-854a-f923e4f2ab1a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:22.480477 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d690b3-3c2b-43c2-854a-f923e4f2ab1a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:22.480755 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d690b3-3c2b-43c2-854a-f923e4f2ab1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:22.495229 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d690b3-3c2b-43c2-854a-f923e4f2ab1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:31:22.503967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-b9d690b3-3c2b-43c2-854a-f923e4f2ab1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:31:22.503967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:22.503967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:22.503967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:22.503967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:22.503967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:22.503967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:22.503967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:22.503967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:22.503967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:22.503967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:22.503967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:22.503967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:31:22.503967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:31:22.503967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:31:22.503967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:31:22.504888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:31:22.504888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:31:22.504888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:31:22.504888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:31:22.504888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:22.504888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:22.504888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:22.504888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:22.504888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:22.504888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:22.504888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:22.504888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:22.504888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:22.504888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:22.504888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:22.504888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:22.505750 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:22.505750 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:22.505750 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:22.505750 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:22.505750 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:31:22.505750 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:31:22.505750 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:31:22.505750 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:31:22.505750 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:31:22.505750 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:31:22.505750 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:31:22.505750 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:22.513570 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320e8a2-79aa-48c2-a351-cafb023a0b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:22.513570 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320e8a2-79aa-48c2-a351-cafb023a0b07 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:22.513570 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320e8a2-79aa-48c2-a351-cafb023a0b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:22.513570 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1320e8a2-79aa-48c2-a351-cafb023a0b07 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:22.513965 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1320e8a2-79aa-48c2-a351-cafb023a0b07 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:22.513965 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1320e8a2-79aa-48c2-a351-cafb023a0b07 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:22.513965 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1320e8a2-79aa-48c2-a351-cafb023a0b07 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:22.514503 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 407/828] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 03:31:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:31:22.515842 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d690b3-3c2b-43c2-854a-f923e4f2ab1a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:22.537539 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 422/829] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Jul 21 03:31:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:22.538423 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320e8a2-79aa-48c2-a351-cafb023a0b07 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:22.590853 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:22.639747 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1320e8a2-79aa-48c2-a351-cafb023a0b07 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:22.649833 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d690b3-3c2b-43c2-854a-f923e4f2ab1a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:22.680422 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338abcaf-905d-439f-8a8d-7810992e1d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:22.681375 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338abcaf-905d-439f-8a8d-7810992e1d64 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:22.681664 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338abcaf-905d-439f-8a8d-7810992e1d64 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:22.681943 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338abcaf-905d-439f-8a8d-7810992e1d64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:22.686565 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98208420-bc37-48f6-936f-6d34d6753365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:22.687513 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98208420-bc37-48f6-936f-6d34d6753365 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:22.688003 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98208420-bc37-48f6-936f-6d34d6753365 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:22.688483 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98208420-bc37-48f6-936f-6d34d6753365 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:22.689438 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98208420-bc37-48f6-936f-6d34d6753365 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:22.689968 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98208420-bc37-48f6-936f-6d34d6753365 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:22.692219 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98208420-bc37-48f6-936f-6d34d6753365 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:22.708282 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 408/830] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:31:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:31:22.709830 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98208420-bc37-48f6-936f-6d34d6753365 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:22.760915 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338abcaf-905d-439f-8a8d-7810992e1d64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:22.762007 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:22.762370 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338abcaf-905d-439f-8a8d-7810992e1d64 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:22.775664 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:22.821294 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98208420-bc37-48f6-936f-6d34d6753365 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:22.859455 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5ac749-b93a-4e81-9562-24f7781ac8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:22.860370 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ac749-b93a-4e81-9562-24f7781ac8c5 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:22.860659 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ac749-b93a-4e81-9562-24f7781ac8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:22.861230 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5ac749-b93a-4e81-9562-24f7781ac8c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:22.872620 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 423/831] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:31:22 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 03:31:22.872620 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c81ac-216a-404e-92d0-bd7b186e9b82 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:22.872620 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c81ac-216a-404e-92d0-bd7b186e9b82 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:22.872620 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c81ac-216a-404e-92d0-bd7b186e9b82 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:22.873123 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ac749-b93a-4e81-9562-24f7781ac8c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:22.874057 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 424/832] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:31:22.878160 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5ac749-b93a-4e81-9562-24f7781ac8c5 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:22.878373 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c81ac-216a-404e-92d0-bd7b186e9b82 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:22.903624 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-3d5ac749-b93a-4e81-9562-24f7781ac8c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:22.903624 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:22.903624 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:22.903624 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:22.903624 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:22.903624 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:22.903624 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:22.903624 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:22.903624 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:22.903624 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:22.903624 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:22.903624 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:22.903624 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:31:22.903624 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:31:22.903624 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:31:22.904570 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:31:22.904570 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:22.904570 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:22.904570 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:22.904570 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:22.904570 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:22.904570 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:22.904570 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:22.904570 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:22.904570 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:22.904570 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:22.904570 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:22.904570 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:22.904570 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:22.904570 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:22.904570 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:22.904570 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:22.905451 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:31:22.905451 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:31:22.905451 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:22.905451 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:22.905451 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 409/833] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:31:22.906169 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88585a6-f67e-4f6f-979c-6a50f148af5e None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:22.906327 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88585a6-f67e-4f6f-979c-6a50f148af5e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:22.906649 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88585a6-f67e-4f6f-979c-6a50f148af5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:22.923606 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-e88585a6-f67e-4f6f-979c-6a50f148af5e None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:22.924805 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e88585a6-f67e-4f6f-979c-6a50f148af5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:22.994883 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c81ac-216a-404e-92d0-bd7b186e9b82 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:23.000320 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 410/834] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:22 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 03:31:23.001374 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88585a6-f67e-4f6f-979c-6a50f148af5e None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:23.006081 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:23.032820 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c0791-b5c2-40a4-9065-11e65c2f0087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:23.033616 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c0791-b5c2-40a4-9065-11e65c2f0087 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:23.033906 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c0791-b5c2-40a4-9065-11e65c2f0087 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:23.034186 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c0791-b5c2-40a4-9065-11e65c2f0087 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:23.045012 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745c0791-b5c2-40a4-9065-11e65c2f0087 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:23.046406 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:23.046540 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745c0791-b5c2-40a4-9065-11e65c2f0087 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:23.064591 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-745c0791-b5c2-40a4-9065-11e65c2f0087 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:23.064591 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:23.064591 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:23.064591 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:23.064591 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:23.064591 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:23.064591 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:23.064591 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:23.064591 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:23.064591 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:23.064591 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:23.064591 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:23.064591 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:31:23.064591 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:31:23.064591 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:31:23.065477 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:31:23.065477 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:23.065477 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:23.065477 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:23.065477 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:23.065477 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:23.065477 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:23.065477 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:23.065477 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:23.065477 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:23.065477 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:23.065477 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:23.065477 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:23.065477 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:23.065477 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:23.065477 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:23.065477 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:23.066356 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:31:23.066356 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:31:23.066356 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:23.066356 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:23.066356 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 425/835] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:23.066657 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c0791-b5c2-40a4-9065-11e65c2f0087 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:23.131413 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88585a6-f67e-4f6f-979c-6a50f148af5e None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:23.168135 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbdae03-54a3-4b89-b7f5-8813820b34fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:23.168810 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbdae03-54a3-4b89-b7f5-8813820b34fc None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:23.169098 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbdae03-54a3-4b89-b7f5-8813820b34fc None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:23.169378 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbdae03-54a3-4b89-b7f5-8813820b34fc None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:23.170112 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbdae03-54a3-4b89-b7f5-8813820b34fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:23.170429 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbdae03-54a3-4b89-b7f5-8813820b34fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:23.171857 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbdae03-54a3-4b89-b7f5-8813820b34fc None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:23.179391 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c0791-b5c2-40a4-9065-11e65c2f0087 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:23.183925 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 411/836] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:31:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:23.184723 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbdae03-54a3-4b89-b7f5-8813820b34fc None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:23.216730 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338b3c0-f894-4f93-a46a-860ef838661f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:23.217533 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338b3c0-f894-4f93-a46a-860ef838661f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:23.217823 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338b3c0-f894-4f93-a46a-860ef838661f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:23.218102 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338b3c0-f894-4f93-a46a-860ef838661f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:23.218794 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2338b3c0-f894-4f93-a46a-860ef838661f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:23.220161 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2338b3c0-f894-4f93-a46a-860ef838661f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:23.232840 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-2338b3c0-f894-4f93-a46a-860ef838661f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 03:31:23.232840 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:23.232840 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 03:31:23.232840 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 03:31:23.232840 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 03:31:23.232840 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 03:31:23.232840 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 03:31:23.232840 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:31:23.232840 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 03:31:23.232840 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:23.232840 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 03:31:23.232840 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:23.232840 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:23.232840 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:23.232840 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:23.232840 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:23.232840 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:23.234594 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:23.234594 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:23.234594 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:23.234594 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:23.234594 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:23.234594 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:23.234594 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 03:31:23.234594 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 03:31:23.234594 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 03:31:23.234594 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 03:31:23.234594 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:23.234594 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:23.234594 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:23.234594 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:23.234594 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:23.234594 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:23.236036 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:23.236036 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:23.236036 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:23.236036 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:23.236036 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:23.236036 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:23.236036 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:23.236036 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:23.236036 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:23.236036 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:23.236036 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 03:31:23.236036 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:31:23.236036 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 03:31:23.236036 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:23.236036 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 426/837] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jul 21 03:31:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:23.237394 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338b3c0-f894-4f93-a46a-860ef838661f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:23.269867 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:23.298524 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:23.309244 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbdae03-54a3-4b89-b7f5-8813820b34fc None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:23.342134 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf03608-7b5c-4718-8817-04108941de3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:23.342610 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338b3c0-f894-4f93-a46a-860ef838661f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:23.342815 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf03608-7b5c-4718-8817-04108941de3e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:23.343104 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf03608-7b5c-4718-8817-04108941de3e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:23.343380 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf03608-7b5c-4718-8817-04108941de3e None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:23.344103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf03608-7b5c-4718-8817-04108941de3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:23.344405 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf03608-7b5c-4718-8817-04108941de3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:23.345776 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf03608-7b5c-4718-8817-04108941de3e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:23.357637 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 412/838] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:31:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:23.358408 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf03608-7b5c-4718-8817-04108941de3e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:23.376428 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736595e-1d5d-429a-a111-c0dc9de6f8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:23.377224 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736595e-1d5d-429a-a111-c0dc9de6f8f9 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:23.377514 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736595e-1d5d-429a-a111-c0dc9de6f8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:23.377794 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736595e-1d5d-429a-a111-c0dc9de6f8f9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:23.385271 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2736595e-1d5d-429a-a111-c0dc9de6f8f9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:23.386719 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2736595e-1d5d-429a-a111-c0dc9de6f8f9 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:23.401225 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-2736595e-1d5d-429a-a111-c0dc9de6f8f9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 03:31:23.401225 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:23.401225 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:23.401225 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:23.401225 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:23.401225 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:23.401225 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:23.401225 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:23.401225 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:23.401225 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:23.401225 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:23.401225 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:23.401225 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 03:31:23.401225 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 03:31:23.401225 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 03:31:23.401225 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 03:31:23.402188 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:23.402188 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:23.402188 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 03:31:23.402188 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:31:23.402188 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 03:31:23.402188 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:31:23.402188 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:23.402188 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:23.402188 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:23.402188 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:23.402188 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:23.402188 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:23.402188 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:23.402188 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:23.402188 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:23.402188 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:23.402188 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:23.402188 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:23.403717 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:23.403717 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:23.403717 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 03:31:23.403717 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 03:31:23.403717 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 03:31:23.403717 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 03:31:23.403717 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 03:31:23.403717 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 03:31:23.403717 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 03:31:23.403717 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:23.403717 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 427/839] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Jul 21 03:31:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:23.403717 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673dac2b-ff89-4e8e-a023-a2533c292fd2 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:23.404501 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673dac2b-ff89-4e8e-a023-a2533c292fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:23.404501 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673dac2b-ff89-4e8e-a023-a2533c292fd2 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:23.405346 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 428/840] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:31:23.406031 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673dac2b-ff89-4e8e-a023-a2533c292fd2 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:23.462232 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf03608-7b5c-4718-8817-04108941de3e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:23.491623 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:23.496549 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f0da4-643d-4d28-86f8-ddfbd2b91a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:23.497218 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f0da4-643d-4d28-86f8-ddfbd2b91a3b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:23.497505 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f0da4-643d-4d28-86f8-ddfbd2b91a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:23.497776 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f0da4-643d-4d28-86f8-ddfbd2b91a3b None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:23.498503 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576f0da4-643d-4d28-86f8-ddfbd2b91a3b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:23.498813 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576f0da4-643d-4d28-86f8-ddfbd2b91a3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:23.500193 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576f0da4-643d-4d28-86f8-ddfbd2b91a3b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:23.504580 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 413/841] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jul 21 03:31:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:23.505335 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f0da4-643d-4d28-86f8-ddfbd2b91a3b None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:23.507770 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673dac2b-ff89-4e8e-a023-a2533c292fd2 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:23.525496 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:23.541786 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e95cf-8774-4d13-a2dc-dca01bb0ba1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:23.542605 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e95cf-8774-4d13-a2dc-dca01bb0ba1d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:23.542890 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e95cf-8774-4d13-a2dc-dca01bb0ba1d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:23.543159 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e95cf-8774-4d13-a2dc-dca01bb0ba1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:23.549821 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e95cf-8774-4d13-a2dc-dca01bb0ba1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:23.551270 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e95cf-8774-4d13-a2dc-dca01bb0ba1d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:23.567646 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-722e95cf-8774-4d13-a2dc-dca01bb0ba1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:31:23.567646 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:23.567646 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:23.567646 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:23.567646 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:23.567646 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:23.567646 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:23.567646 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:23.567646 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:23.567646 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:23.567646 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:23.567646 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:23.567646 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 03:31:23.567646 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 03:31:23.567646 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 03:31:23.568677 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 03:31:23.568677 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:23.568677 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:23.568677 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:23.568677 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:23.568677 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:23.568677 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:23.568677 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:23.568677 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:23.568677 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:23.568677 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:23.568677 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:23.568677 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:23.568677 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:23.568677 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:23.568677 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:23.568677 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:23.569572 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 03:31:23.569572 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 03:31:23.569572 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 03:31:23.569572 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 03:31:23.569572 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 03:31:23.569572 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 03:31:23.569572 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:31:23.569572 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:23.569572 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 429/842] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:31:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:23.570061 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c46c5-4af8-4316-a574-e5d51b62b426 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:23.570350 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c46c5-4af8-4316-a574-e5d51b62b426 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:23.570651 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c46c5-4af8-4316-a574-e5d51b62b426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:23.587268 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-468c46c5-4af8-4316-a574-e5d51b62b426 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:23.588442 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-468c46c5-4af8-4316-a574-e5d51b62b426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:23.614889 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f0da4-643d-4d28-86f8-ddfbd2b91a3b None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:23.648259 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e90b4-4bf1-451c-a1c6-67567c7c74a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:23.648929 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e90b4-4bf1-451c-a1c6-67567c7c74a6 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:23.649214 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e90b4-4bf1-451c-a1c6-67567c7c74a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:23.649496 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e90b4-4bf1-451c-a1c6-67567c7c74a6 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:23.650361 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e90b4-4bf1-451c-a1c6-67567c7c74a6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:23.650719 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e90b4-4bf1-451c-a1c6-67567c7c74a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:23.652150 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e90b4-4bf1-451c-a1c6-67567c7c74a6 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:23.653921 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 430/843] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:23 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 03:31:23.655460 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c46c5-4af8-4316-a574-e5d51b62b426 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:23.669570 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 414/844] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Jul 21 03:31:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:23.670240 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e90b4-4bf1-451c-a1c6-67567c7c74a6 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:23.741000 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:23.747804 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:23.769967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e90b4-4bf1-451c-a1c6-67567c7c74a6 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:23.770425 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c46c5-4af8-4316-a574-e5d51b62b426 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:23.803479 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a055840-3203-47e3-a3d6-d5706ed5b412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:23.803857 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0e63b-f26c-409d-a8a6-6418c721a862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:23.804064 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a055840-3203-47e3-a3d6-d5706ed5b412 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:23.804348 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a055840-3203-47e3-a3d6-d5706ed5b412 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:23.804512 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0e63b-f26c-409d-a8a6-6418c721a862 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:23.804623 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a055840-3203-47e3-a3d6-d5706ed5b412 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:23.804799 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0e63b-f26c-409d-a8a6-6418c721a862 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:23.805075 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0e63b-f26c-409d-a8a6-6418c721a862 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:23.805323 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a055840-3203-47e3-a3d6-d5706ed5b412 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:23.805625 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a055840-3203-47e3-a3d6-d5706ed5b412 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:23.805854 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0e63b-f26c-409d-a8a6-6418c721a862 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:23.806162 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0e63b-f26c-409d-a8a6-6418c721a862 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:23.807013 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a055840-3203-47e3-a3d6-d5706ed5b412 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:23.807605 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec0e63b-f26c-409d-a8a6-6418c721a862 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:23.811342 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 431/845] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jul 21 03:31:23 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:23.812096 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a055840-3203-47e3-a3d6-d5706ed5b412 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:23.826023 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 415/846] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 03:31:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:23.826962 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0e63b-f26c-409d-a8a6-6418c721a862 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:23.926552 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a055840-3203-47e3-a3d6-d5706ed5b412 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:23.940860 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0e63b-f26c-409d-a8a6-6418c721a862 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:23.963790 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba584d3-1ca0-421d-bfb3-3fcbc2f6e3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:23.964445 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba584d3-1ca0-421d-bfb3-3fcbc2f6e3b7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:23.965293 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba584d3-1ca0-421d-bfb3-3fcbc2f6e3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:23.965293 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba584d3-1ca0-421d-bfb3-3fcbc2f6e3b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:23.976342 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:23.976799 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:23.983113 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f97dff-f45a-4fde-ad27-abaea97f6e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:23.983913 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f97dff-f45a-4fde-ad27-abaea97f6e4a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:23.984198 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f97dff-f45a-4fde-ad27-abaea97f6e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:23.984473 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f97dff-f45a-4fde-ad27-abaea97f6e4a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:23.995043 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f97dff-f45a-4fde-ad27-abaea97f6e4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:31:24.002696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-36f97dff-f45a-4fde-ad27-abaea97f6e4a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:31:24.002696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:24.002696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:24.002696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:24.002696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:24.002696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:24.002696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:24.002696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:24.002696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:24.002696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:24.002696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:24.002696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:24.002696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:31:24.002696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:31:24.002696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:31:24.002696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:31:24.003692 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:31:24.003692 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:31:24.003692 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:31:24.003692 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:31:24.003692 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:24.003692 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:24.003692 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:24.003692 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:24.003692 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:24.003692 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:24.003692 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:24.003692 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:24.003692 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:24.003692 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:24.003692 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:24.003692 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:24.004552 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:24.004552 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:24.004552 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:24.004552 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:24.004552 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:31:24.004552 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:31:24.004552 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:31:24.004552 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:31:24.004552 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:31:24.004552 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:31:24.004552 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:31:24.004552 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:24.004552 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 416/847] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 03:31:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:24.005247 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f97dff-f45a-4fde-ad27-abaea97f6e4a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:24.048755 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba584d3-1ca0-421d-bfb3-3fcbc2f6e3b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:24.050627 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba584d3-1ca0-421d-bfb3-3fcbc2f6e3b7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:24.161171 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 432/848] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:31:23 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 03:31:24.162413 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba584d3-1ca0-421d-bfb3-3fcbc2f6e3b7 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:24.208512 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:24.229549 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f97dff-f45a-4fde-ad27-abaea97f6e4a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:24.265208 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddffc18-facd-4e42-88be-41ad5873f9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:24.265901 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddffc18-facd-4e42-88be-41ad5873f9d7 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:24.266184 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddffc18-facd-4e42-88be-41ad5873f9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:24.266472 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddffc18-facd-4e42-88be-41ad5873f9d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:24.267326 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddffc18-facd-4e42-88be-41ad5873f9d7 None admin] RBAC: Adding query filter params (role.id=3d204e16b7214bf29bde33739ca9006a, scope.project.id=0432303daa8b4304a8e07032d6a80781, user.id=73fad109df9f449e8ac5f38749c01ace) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:24.267638 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddffc18-facd-4e42-88be-41ad5873f9d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:24.268893 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba584d3-1ca0-421d-bfb3-3fcbc2f6e3b7 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:24.269057 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddffc18-facd-4e42-88be-41ad5873f9d7 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:24.275893 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 417/849] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:31:24 2022] GET /identity/v3/role_assignments?user.id=73fad109df9f449e8ac5f38749c01ace&scope.project.id=0432303daa8b4304a8e07032d6a80781&role.id=3d204e16b7214bf29bde33739ca9006a => generated 608 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:24.276691 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddffc18-facd-4e42-88be-41ad5873f9d7 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:24.310911 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ef3d8-7dfe-48af-bfa2-69dbee8baea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:24.312119 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ef3d8-7dfe-48af-bfa2-69dbee8baea1 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:24.312700 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ef3d8-7dfe-48af-bfa2-69dbee8baea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:24.313190 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ef3d8-7dfe-48af-bfa2-69dbee8baea1 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:24.314189 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ef3d8-7dfe-48af-bfa2-69dbee8baea1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:24.314874 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ef3d8-7dfe-48af-bfa2-69dbee8baea1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:24.316678 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039ef3d8-7dfe-48af-bfa2-69dbee8baea1 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:24.327931 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 433/850] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:31:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:24.333608 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ef3d8-7dfe-48af-bfa2-69dbee8baea1 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:24.347558 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:24.403910 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddffc18-facd-4e42-88be-41ad5873f9d7 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:24.453669 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c0dc5-30fb-4edf-8213-7b5d0ba3a830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:24.453669 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c0dc5-30fb-4edf-8213-7b5d0ba3a830 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:24.453669 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c0dc5-30fb-4edf-8213-7b5d0ba3a830 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:24.453669 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c0dc5-30fb-4edf-8213-7b5d0ba3a830 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:24.464777 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c0dc5-30fb-4edf-8213-7b5d0ba3a830 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:24.466527 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c0dc5-30fb-4edf-8213-7b5d0ba3a830 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:24.478260 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ef3d8-7dfe-48af-bfa2-69dbee8baea1 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:24.481386 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:24.484386 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-f06c0dc5-30fb-4edf-8213-7b5d0ba3a830 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:24.484386 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:24.484386 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:24.484386 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:24.484386 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:24.484386 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:24.484386 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:24.484386 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:24.484386 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:24.484386 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:24.484386 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:24.484386 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:24.484386 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:31:24.484386 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:31:24.484386 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:31:24.485244 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:31:24.485244 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:24.485244 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:24.485244 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:24.485244 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:24.485244 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:24.485244 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:24.485244 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:24.485244 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:24.485244 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:24.485244 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:24.485244 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:24.485244 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:24.485244 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:24.485244 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:24.485244 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:24.485244 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:24.486256 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:31:24.486256 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:31:24.486256 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:24.486256 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:24.486256 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 418/851] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:24.494434 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c0dc5-30fb-4edf-8213-7b5d0ba3a830 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:24.530383 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ceda77-072e-45ac-9e31-16647c29755f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:24.531221 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ceda77-072e-45ac-9e31-16647c29755f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:24.531545 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ceda77-072e-45ac-9e31-16647c29755f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:24.531775 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ceda77-072e-45ac-9e31-16647c29755f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:24.552524 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ceda77-072e-45ac-9e31-16647c29755f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:24.555135 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ceda77-072e-45ac-9e31-16647c29755f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:24.579380 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-48ceda77-072e-45ac-9e31-16647c29755f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:24.579380 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:24.579380 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:24.579380 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:24.579380 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:24.579380 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:24.579380 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:24.579380 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:24.579380 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:24.579380 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:24.579380 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:24.579380 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:24.579380 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:31:24.579380 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:31:24.579380 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:31:24.580394 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:31:24.580394 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:24.580394 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:24.580394 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:24.580394 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:24.580394 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:24.580394 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:24.580394 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:24.580394 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:24.580394 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:24.580394 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:24.580394 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:24.580394 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:24.580394 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:24.580394 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:24.580394 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:24.580394 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:24.581265 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:31:24.581265 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:31:24.581265 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:24.581265 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:24.581265 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 434/852] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:24.591416 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ceda77-072e-45ac-9e31-16647c29755f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:24.622191 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c0dc5-30fb-4edf-8213-7b5d0ba3a830 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:24.632447 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:24.660280 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a291c5-50df-4f64-b3f4-eb22488c473c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:24.660876 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a291c5-50df-4f64-b3f4-eb22488c473c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:24.661131 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a291c5-50df-4f64-b3f4-eb22488c473c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:24.661404 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a291c5-50df-4f64-b3f4-eb22488c473c None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:24.662175 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a291c5-50df-4f64-b3f4-eb22488c473c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:24.663064 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a291c5-50df-4f64-b3f4-eb22488c473c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:24.664633 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a291c5-50df-4f64-b3f4-eb22488c473c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:24.682059 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 419/853] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:31:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:31:24.683218 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a291c5-50df-4f64-b3f4-eb22488c473c None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:24.718054 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ceda77-072e-45ac-9e31-16647c29755f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:24.759948 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051eda60-c5af-48e6-9ef0-5e95da3d5292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:24.760918 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051eda60-c5af-48e6-9ef0-5e95da3d5292 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:24.761210 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051eda60-c5af-48e6-9ef0-5e95da3d5292 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:24.761485 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051eda60-c5af-48e6-9ef0-5e95da3d5292 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:24.762210 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051eda60-c5af-48e6-9ef0-5e95da3d5292 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:24.762777 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051eda60-c5af-48e6-9ef0-5e95da3d5292 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:24.764552 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051eda60-c5af-48e6-9ef0-5e95da3d5292 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:24.782537 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 435/854] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:31:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:24.785864 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051eda60-c5af-48e6-9ef0-5e95da3d5292 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:24.807851 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:24.831915 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a291c5-50df-4f64-b3f4-eb22488c473c None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:24.877523 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475e84c-887c-4888-817d-794dcf49a34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:24.878296 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475e84c-887c-4888-817d-794dcf49a34c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:24.878647 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475e84c-887c-4888-817d-794dcf49a34c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:24.878922 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475e84c-887c-4888-817d-794dcf49a34c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:24.886354 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4475e84c-887c-4888-817d-794dcf49a34c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:24.888016 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4475e84c-887c-4888-817d-794dcf49a34c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:24.906370 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-4475e84c-887c-4888-817d-794dcf49a34c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:31:24.906370 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:24.906370 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:24.906370 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:24.906370 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:24.906370 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:24.906370 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:24.906370 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:24.906370 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:24.906370 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:24.906370 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:24.906370 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:24.906370 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 03:31:24.906370 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 03:31:24.906370 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 03:31:24.907333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 03:31:24.907333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:24.907333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:24.907333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:24.907333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:24.907333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:24.907333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:24.907333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:24.907333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:24.907333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:24.907333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:24.907333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:24.907333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:24.907333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:24.907333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:24.907333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:24.907333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:24.908221 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 03:31:24.908221 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 03:31:24.908221 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 03:31:24.908221 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 03:31:24.908221 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 03:31:24.908221 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 03:31:24.908221 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:31:24.908221 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:24.910549 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 420/855] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:31:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:31:24.917157 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475e84c-887c-4888-817d-794dcf49a34c None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:24.924098 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051eda60-c5af-48e6-9ef0-5e95da3d5292 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:24.954539 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:24.971799 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da816ae5-f616-42d3-bc40-c72e7a802680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:24.972523 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da816ae5-f616-42d3-bc40-c72e7a802680 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:24.972809 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da816ae5-f616-42d3-bc40-c72e7a802680 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:24.973100 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da816ae5-f616-42d3-bc40-c72e7a802680 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:24.983663 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da816ae5-f616-42d3-bc40-c72e7a802680 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:24.985908 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da816ae5-f616-42d3-bc40-c72e7a802680 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:25.005032 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-da816ae5-f616-42d3-bc40-c72e7a802680 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 03:31:25.005032 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:25.005032 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:25.005032 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:25.005032 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:25.005032 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:25.005032 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:25.005032 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:25.005032 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:25.005032 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:25.005032 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:25.005032 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:25.005032 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 03:31:25.005032 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 03:31:25.005032 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 03:31:25.005032 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 03:31:25.006017 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:25.006017 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:25.006017 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 03:31:25.006017 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:31:25.006017 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 03:31:25.006017 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:31:25.006017 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:25.006017 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:25.006017 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:25.006017 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:25.006017 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:25.006017 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:25.006017 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:25.006017 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:25.006017 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:25.006017 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:25.006017 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:25.006017 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:25.007008 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:25.007008 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:25.007008 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 03:31:25.007008 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 03:31:25.007008 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 03:31:25.007008 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 03:31:25.007008 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 03:31:25.007008 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 03:31:25.007008 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 03:31:25.007008 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:25.010518 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 436/856] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 03:31:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:25.012070 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da816ae5-f616-42d3-bc40-c72e7a802680 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:25.056578 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475e84c-887c-4888-817d-794dcf49a34c None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:25.100802 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e6c7e-2c67-4623-987a-7280e92ee367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:25.102049 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e6c7e-2c67-4623-987a-7280e92ee367 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:25.102335 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e6c7e-2c67-4623-987a-7280e92ee367 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:25.102668 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870e6c7e-2c67-4623-987a-7280e92ee367 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:25.103461 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870e6c7e-2c67-4623-987a-7280e92ee367 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:25.104037 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870e6c7e-2c67-4623-987a-7280e92ee367 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:25.105722 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870e6c7e-2c67-4623-987a-7280e92ee367 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:25.113432 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:25.130297 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 421/857] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 03:31:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:25.131694 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e6c7e-2c67-4623-987a-7280e92ee367 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:25.149943 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da816ae5-f616-42d3-bc40-c72e7a802680 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:25.195713 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a9be9-d948-4e27-a26f-d50d1ab96e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:25.196396 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a9be9-d948-4e27-a26f-d50d1ab96e3e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:25.196689 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a9be9-d948-4e27-a26f-d50d1ab96e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:25.196972 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a9be9-d948-4e27-a26f-d50d1ab96e3e None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:25.198003 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7a9be9-d948-4e27-a26f-d50d1ab96e3e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:25.198324 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7a9be9-d948-4e27-a26f-d50d1ab96e3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:25.200435 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7a9be9-d948-4e27-a26f-d50d1ab96e3e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:25.226659 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 437/858] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Jul 21 03:31:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:25.230688 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a9be9-d948-4e27-a26f-d50d1ab96e3e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:25.256561 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:25.274222 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870e6c7e-2c67-4623-987a-7280e92ee367 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:25.318374 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b423560c-8dfe-4344-8945-b6057c228e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:25.319866 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423560c-8dfe-4344-8945-b6057c228e96 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:25.320157 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423560c-8dfe-4344-8945-b6057c228e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:25.320439 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423560c-8dfe-4344-8945-b6057c228e96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:25.321282 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b423560c-8dfe-4344-8945-b6057c228e96 None admin] RBAC: Adding query filter params (role.id=27e53d6c56f24c25a8c8057bfd36bcf1, scope.project.id=0432303daa8b4304a8e07032d6a80781, user.id=cefbe2d0c739428ab0d4dfeaed6c37ab) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:25.321596 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b423560c-8dfe-4344-8945-b6057c228e96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:25.323843 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b423560c-8dfe-4344-8945-b6057c228e96 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:25.338107 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 422/859] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:31:25 2022] GET /identity/v3/role_assignments?user.id=cefbe2d0c739428ab0d4dfeaed6c37ab&scope.project.id=0432303daa8b4304a8e07032d6a80781&role.id=27e53d6c56f24c25a8c8057bfd36bcf1 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:25.345831 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7a9be9-d948-4e27-a26f-d50d1ab96e3e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:25.379982 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:25.386791 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc98e9-cb93-4343-b13a-e6c15e1882fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:25.387649 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc98e9-cb93-4343-b13a-e6c15e1882fe None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:25.388057 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc98e9-cb93-4343-b13a-e6c15e1882fe None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:25.388348 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc98e9-cb93-4343-b13a-e6c15e1882fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:25.467034 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cc98e9-cb93-4343-b13a-e6c15e1882fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:25.468511 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cc98e9-cb93-4343-b13a-e6c15e1882fe None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:25.585427 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 438/860] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:31:25 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 03:31:25.591017 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b423560c-8dfe-4344-8945-b6057c228e96 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:25.695821 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b423560c-8dfe-4344-8945-b6057c228e96 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:25.730254 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbee32d-5d39-43e3-85d4-7cd509d2c335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:25.731104 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbee32d-5d39-43e3-85d4-7cd509d2c335 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:25.731529 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbee32d-5d39-43e3-85d4-7cd509d2c335 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:25.731873 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbee32d-5d39-43e3-85d4-7cd509d2c335 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:25.743391 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbee32d-5d39-43e3-85d4-7cd509d2c335 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:25.744942 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbee32d-5d39-43e3-85d4-7cd509d2c335 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:25.762791 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-efbee32d-5d39-43e3-85d4-7cd509d2c335 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:25.762791 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:25.762791 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:25.762791 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:25.762791 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:25.762791 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:25.762791 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:25.762791 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:25.762791 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:25.762791 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:25.762791 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:25.762791 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:25.762791 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:31:25.762791 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:31:25.762791 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:31:25.763861 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:31:25.763861 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:25.763861 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:25.763861 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:25.763861 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:25.763861 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:25.763861 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:25.763861 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:25.763861 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:25.763861 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:25.763861 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:25.763861 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:25.763861 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:25.763861 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:25.763861 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:25.763861 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:25.763861 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:25.765010 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:31:25.765010 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:31:25.765010 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:25.765010 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:25.765805 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 423/861] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:25.771387 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc98e9-cb93-4343-b13a-e6c15e1882fe None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:25.803772 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:25.877328 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc98e9-cb93-4343-b13a-e6c15e1882fe None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:25.913556 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570e52d-d590-4e67-b80a-eb77eb32c683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:25.914225 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570e52d-d590-4e67-b80a-eb77eb32c683 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:25.914539 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570e52d-d590-4e67-b80a-eb77eb32c683 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:25.914826 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570e52d-d590-4e67-b80a-eb77eb32c683 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:25.915611 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f570e52d-d590-4e67-b80a-eb77eb32c683 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:25.915933 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f570e52d-d590-4e67-b80a-eb77eb32c683 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:25.917300 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f570e52d-d590-4e67-b80a-eb77eb32c683 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:25.926184 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f0784-c920-467c-90bb-195ca78cb2a3 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:25.926739 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f0784-c920-467c-90bb-195ca78cb2a3 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:25.927226 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f0784-c920-467c-90bb-195ca78cb2a3 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:25.931258 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 439/863] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:31:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:25.931524 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 424/863] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 03:31:25.935641 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f0784-c920-467c-90bb-195ca78cb2a3 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:25.936059 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06e28a-dc2c-4d19-a234-f07a8db70a70 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:25.936359 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06e28a-dc2c-4d19-a234-f07a8db70a70 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:25.936697 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06e28a-dc2c-4d19-a234-f07a8db70a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:25.957395 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-aa06e28a-dc2c-4d19-a234-f07a8db70a70 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:25.958927 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-aa06e28a-dc2c-4d19-a234-f07a8db70a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:25.966812 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:26.035355 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 440/864] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:25 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 03:31:26.056740 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f0784-c920-467c-90bb-195ca78cb2a3 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:26.059879 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06e28a-dc2c-4d19-a234-f07a8db70a70 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:26.084203 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:26.097056 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82127ad6-d946-41bf-9d8f-090f0c6786a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:26.097513 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82127ad6-d946-41bf-9d8f-090f0c6786a1 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:26.097803 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82127ad6-d946-41bf-9d8f-090f0c6786a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:26.098082 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82127ad6-d946-41bf-9d8f-090f0c6786a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:26.105890 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82127ad6-d946-41bf-9d8f-090f0c6786a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:26.107399 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82127ad6-d946-41bf-9d8f-090f0c6786a1 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:26.122824 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-82127ad6-d946-41bf-9d8f-090f0c6786a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:31:26.122824 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:26.122824 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:26.122824 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:26.122824 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:26.122824 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:26.122824 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:26.122824 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:26.122824 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:26.122824 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:26.122824 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:26.122824 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:26.122824 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 03:31:26.122824 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 03:31:26.122824 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 03:31:26.123765 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 03:31:26.123765 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:26.123765 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:26.123765 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:26.123765 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:26.123765 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:26.123765 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:26.123765 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:26.123765 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:26.123765 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:26.123765 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:26.123765 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:26.123765 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:26.123765 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:26.123765 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:26.123765 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:26.123765 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:26.124672 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 03:31:26.124672 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 03:31:26.124672 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 03:31:26.124672 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 03:31:26.124672 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 03:31:26.124672 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 03:31:26.124672 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:31:26.124672 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:26.124672 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 425/865] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:31:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:31:26.136099 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82127ad6-d946-41bf-9d8f-090f0c6786a1 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:26.170807 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06e28a-dc2c-4d19-a234-f07a8db70a70 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:26.207599 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355d9a6-594d-40a2-b0f9-be07d71f25f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:26.208567 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355d9a6-594d-40a2-b0f9-be07d71f25f9 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:26.209017 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355d9a6-594d-40a2-b0f9-be07d71f25f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:26.209344 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355d9a6-594d-40a2-b0f9-be07d71f25f9 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:26.210091 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355d9a6-594d-40a2-b0f9-be07d71f25f9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:26.211545 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355d9a6-594d-40a2-b0f9-be07d71f25f9 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:26.222169 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:26.238485 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 441/866] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jul 21 03:31:26 2022] POST /identity/v3/services => generated 251 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:31:26.274019 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82127ad6-d946-41bf-9d8f-090f0c6786a1 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:26.323423 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8839a26-6668-4527-8a74-5f100b3bc959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:26.324104 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8839a26-6668-4527-8a74-5f100b3bc959 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:26.324389 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8839a26-6668-4527-8a74-5f100b3bc959 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:26.324668 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8839a26-6668-4527-8a74-5f100b3bc959 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:26.325474 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8839a26-6668-4527-8a74-5f100b3bc959 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:26.325788 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8839a26-6668-4527-8a74-5f100b3bc959 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:26.327334 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8839a26-6668-4527-8a74-5f100b3bc959 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:26.341523 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 426/867] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 03:31:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:26.351599 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355d9a6-594d-40a2-b0f9-be07d71f25f9 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:26.443796 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987f511-5d4d-4c3d-9dac-33b459afed64 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:26.444109 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987f511-5d4d-4c3d-9dac-33b459afed64 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:26.444296 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1987f511-5d4d-4c3d-9dac-33b459afed64 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:26.445789 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 427/868] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:31:26.451151 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1cc2e-c7a5-4065-a4c0-fb129545c380 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:26.451693 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1cc2e-c7a5-4065-a4c0-fb129545c380 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:26.452174 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1cc2e-c7a5-4065-a4c0-fb129545c380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:26.455317 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:26.471465 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355d9a6-594d-40a2-b0f9-be07d71f25f9 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:26.476094 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-25f1cc2e-c7a5-4065-a4c0-fb129545c380 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:26.477460 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-25f1cc2e-c7a5-4065-a4c0-fb129545c380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:26.516358 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac9f04-c2c4-48e8-be08-8c37a8af368c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:26.517456 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac9f04-c2c4-48e8-be08-8c37a8af368c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:26.517889 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac9f04-c2c4-48e8-be08-8c37a8af368c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:26.518276 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac9f04-c2c4-48e8-be08-8c37a8af368c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:26.519300 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aac9f04-c2c4-48e8-be08-8c37a8af368c None admin] RBAC: Adding query filter params (role.id=27e53d6c56f24c25a8c8057bfd36bcf1, scope.project.id=0432303daa8b4304a8e07032d6a80781, user.id=ce8bc228892e45c0a7d1b529c2f9a8f2) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:26.519822 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aac9f04-c2c4-48e8-be08-8c37a8af368c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:26.521362 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aac9f04-c2c4-48e8-be08-8c37a8af368c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:26.533731 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 442/869] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:31:26 2022] GET /identity/v3/role_assignments?user.id=ce8bc228892e45c0a7d1b529c2f9a8f2&scope.project.id=0432303daa8b4304a8e07032d6a80781&role.id=27e53d6c56f24c25a8c8057bfd36bcf1 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:26.570924 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 428/870] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:26 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 03:31:26.592628 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac9f04-c2c4-48e8-be08-8c37a8af368c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:26.707012 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac9f04-c2c4-48e8-be08-8c37a8af368c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:26.750107 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf82ddf-87bd-4736-badb-37ae2bc2e556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:26.751197 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf82ddf-87bd-4736-badb-37ae2bc2e556 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:26.751641 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf82ddf-87bd-4736-badb-37ae2bc2e556 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:26.751920 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf82ddf-87bd-4736-badb-37ae2bc2e556 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:26.764183 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf82ddf-87bd-4736-badb-37ae2bc2e556 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:31:26.773187 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-aaf82ddf-87bd-4736-badb-37ae2bc2e556 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 03:31:26.773187 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:26.773187 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:26.773187 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:26.773187 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:26.773187 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:26.773187 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:26.773187 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:26.773187 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:26.773187 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:26.773187 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:26.773187 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:26.773187 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:31:26.773187 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:31:26.773187 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:31:26.773187 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:31:26.774100 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:31:26.774100 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:31:26.774100 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:31:26.774100 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:31:26.774100 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:26.774100 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:26.774100 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:26.774100 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:26.774100 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:26.774100 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:26.774100 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:26.774100 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:26.774100 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:26.774100 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:26.774100 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:26.774100 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:26.775019 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:26.775019 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:26.775019 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:26.775019 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:26.775019 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:31:26.775019 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:31:26.775019 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:31:26.775019 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:31:26.775019 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:31:26.775019 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:31:26.775019 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 03:31:26.775019 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:26.775019 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 443/871] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Jul 21 03:31:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:26.780540 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1cc2e-c7a5-4065-a4c0-fb129545c380 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:26.832152 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:26.884068 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1cc2e-c7a5-4065-a4c0-fb129545c380 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:26.918662 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7754d65-389b-4d0b-8b67-971e12e1ed20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:26.919335 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7754d65-389b-4d0b-8b67-971e12e1ed20 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:26.919621 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7754d65-389b-4d0b-8b67-971e12e1ed20 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:26.919896 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7754d65-389b-4d0b-8b67-971e12e1ed20 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:26.920653 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7754d65-389b-4d0b-8b67-971e12e1ed20 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:26.920962 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7754d65-389b-4d0b-8b67-971e12e1ed20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:26.922338 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7754d65-389b-4d0b-8b67-971e12e1ed20 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:26.930978 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 429/872] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Jul 21 03:31:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:26.936519 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf82ddf-87bd-4736-badb-37ae2bc2e556 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:26.947245 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:27.045766 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf82ddf-87bd-4736-badb-37ae2bc2e556 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:27.081948 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8d79d-7da3-4b00-9137-93513f4d781d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:27.083166 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8d79d-7da3-4b00-9137-93513f4d781d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:27.083661 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8d79d-7da3-4b00-9137-93513f4d781d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:27.084722 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8d79d-7da3-4b00-9137-93513f4d781d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:27.096288 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c8d79d-7da3-4b00-9137-93513f4d781d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:27.098039 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c8d79d-7da3-4b00-9137-93513f4d781d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:27.117164 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-c3c8d79d-7da3-4b00-9137-93513f4d781d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:27.117164 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:27.117164 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:27.117164 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:27.117164 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:27.117164 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:27.117164 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:27.117164 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:27.117164 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:27.117164 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:27.117164 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:27.117164 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:27.117164 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:31:27.117164 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:31:27.117164 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:31:27.118121 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:31:27.118121 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:27.118121 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:27.118121 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:27.118121 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:27.118121 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:27.118121 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:27.118121 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:27.118121 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:27.118121 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:27.118121 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:27.118121 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:27.118121 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:27.118121 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:27.118121 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:27.118121 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:27.118121 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:27.119229 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:31:27.119229 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:31:27.119229 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:27.119229 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:27.121145 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 444/873] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:27.126904 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7754d65-389b-4d0b-8b67-971e12e1ed20 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:27.228241 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7754d65-389b-4d0b-8b67-971e12e1ed20 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:27.241715 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:27.263247 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8518983-74fd-4d5a-a091-4ecec1485f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:27.264429 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8518983-74fd-4d5a-a091-4ecec1485f11 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:27.264715 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8518983-74fd-4d5a-a091-4ecec1485f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:27.264993 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8518983-74fd-4d5a-a091-4ecec1485f11 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:27.265804 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8518983-74fd-4d5a-a091-4ecec1485f11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:27.266031 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8518983-74fd-4d5a-a091-4ecec1485f11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:27.267519 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8518983-74fd-4d5a-a091-4ecec1485f11 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:27.280044 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 430/874] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:31:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:27.285465 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8d79d-7da3-4b00-9137-93513f4d781d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:27.345815 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:27.391816 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8d79d-7da3-4b00-9137-93513f4d781d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:27.427650 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b399f-2f29-494f-b582-9a9d1c5f1003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:27.429024 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b399f-2f29-494f-b582-9a9d1c5f1003 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:27.429312 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b399f-2f29-494f-b582-9a9d1c5f1003 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:27.429590 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b399f-2f29-494f-b582-9a9d1c5f1003 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:27.438313 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35b399f-2f29-494f-b582-9a9d1c5f1003 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:27.439819 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35b399f-2f29-494f-b582-9a9d1c5f1003 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:27.455650 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-d35b399f-2f29-494f-b582-9a9d1c5f1003 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 03:31:27.455650 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:27.455650 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:27.455650 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:27.455650 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:27.455650 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:27.455650 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:27.455650 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:27.455650 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:27.455650 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:27.455650 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:27.455650 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:27.455650 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 03:31:27.455650 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 03:31:27.455650 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 03:31:27.455650 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 03:31:27.456576 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:27.456576 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:27.456576 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 03:31:27.456576 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:31:27.456576 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 03:31:27.456576 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:31:27.456576 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:27.456576 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:27.456576 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:27.456576 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:27.456576 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:27.456576 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:27.456576 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:27.456576 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:27.456576 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:27.456576 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:27.456576 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:27.456576 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:27.458137 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:27.458137 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:27.458137 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 03:31:27.458137 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 03:31:27.458137 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 03:31:27.458137 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 03:31:27.458137 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 03:31:27.458137 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 03:31:27.458137 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 03:31:27.458137 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:27.458137 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 445/875] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Jul 21 03:31:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:27.462720 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8518983-74fd-4d5a-a091-4ecec1485f11 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:27.556489 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771bf57-94df-4392-9e48-c0049c8e699c None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:27.556831 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771bf57-94df-4392-9e48-c0049c8e699c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:27.557102 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e771bf57-94df-4392-9e48-c0049c8e699c None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:27.562322 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 446/876] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 03:31:27.563536 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97729d94-b58b-4404-aae4-e39617e7ac1b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:27.563829 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97729d94-b58b-4404-aae4-e39617e7ac1b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:27.564112 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97729d94-b58b-4404-aae4-e39617e7ac1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:27.573830 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8518983-74fd-4d5a-a091-4ecec1485f11 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:27.587201 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-97729d94-b58b-4404-aae4-e39617e7ac1b None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:27.588400 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-97729d94-b58b-4404-aae4-e39617e7ac1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:27.611681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a6d260-58c6-4f2a-89f0-98d83793fb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:27.612285 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6d260-58c6-4f2a-89f0-98d83793fb30 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:27.612571 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6d260-58c6-4f2a-89f0-98d83793fb30 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:27.612844 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a6d260-58c6-4f2a-89f0-98d83793fb30 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:27.613815 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a6d260-58c6-4f2a-89f0-98d83793fb30 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:27.614240 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a6d260-58c6-4f2a-89f0-98d83793fb30 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:27.616259 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a6d260-58c6-4f2a-89f0-98d83793fb30 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:27.635031 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 431/877] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Jul 21 03:31:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:27.641944 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a6d260-58c6-4f2a-89f0-98d83793fb30 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:27.670843 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 447/878] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:27 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 03:31:27.675735 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:27.689768 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97729d94-b58b-4404-aae4-e39617e7ac1b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:27.742752 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:27.766514 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a6d260-58c6-4f2a-89f0-98d83793fb30 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:27.795664 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367d541-9f85-43d9-9676-aa91b559ea57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:27.796489 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367d541-9f85-43d9-9676-aa91b559ea57 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:27.796873 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367d541-9f85-43d9-9676-aa91b559ea57 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:27.797258 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367d541-9f85-43d9-9676-aa91b559ea57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:27.797973 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97729d94-b58b-4404-aae4-e39617e7ac1b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:27.837964 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc08cc27-2f04-43e5-b1bb-a7fe98a4b4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:27.838825 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08cc27-2f04-43e5-b1bb-a7fe98a4b4d4 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:27.839115 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08cc27-2f04-43e5-b1bb-a7fe98a4b4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:27.839585 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08cc27-2f04-43e5-b1bb-a7fe98a4b4d4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:27.840263 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc08cc27-2f04-43e5-b1bb-a7fe98a4b4d4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:27.841756 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc08cc27-2f04-43e5-b1bb-a7fe98a4b4d4 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:27.859934 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-cc08cc27-2f04-43e5-b1bb-a7fe98a4b4d4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 03:31:27.859934 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:27.859934 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 03:31:27.859934 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 03:31:27.859934 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 03:31:27.859934 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 03:31:27.859934 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 03:31:27.859934 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:31:27.859934 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 03:31:27.859934 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:27.859934 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 03:31:27.859934 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:27.859934 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:27.859934 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:27.859934 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:27.859934 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:27.860933 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:27.860933 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:27.860933 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:27.860933 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:27.860933 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:27.860933 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:27.860933 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:27.860933 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 03:31:27.860933 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 03:31:27.860933 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 03:31:27.860933 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 03:31:27.860933 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:27.860933 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:27.860933 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:27.860933 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:27.860933 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:27.861803 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:27.861803 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:27.861803 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:27.861803 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:27.861803 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:27.861803 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:27.861803 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:27.861803 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:27.861803 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:27.861803 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:27.861803 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:27.861803 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 03:31:27.861803 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:31:27.861803 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 03:31:27.861803 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:27.861803 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 448/879] 10.222.0.20 () {56 vars in 1132 bytes} [Thu Jul 21 03:31:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:27.869377 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc08cc27-2f04-43e5-b1bb-a7fe98a4b4d4 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:27.886525 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367d541-9f85-43d9-9676-aa91b559ea57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:27.886525 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367d541-9f85-43d9-9676-aa91b559ea57 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:27.917283 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:27.991762 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc08cc27-2f04-43e5-b1bb-a7fe98a4b4d4 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:27.999476 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 432/880] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:31:27 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 03:31:28.000518 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367d541-9f85-43d9-9676-aa91b559ea57 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:28.007459 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:28.034263 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91394aab-ca45-477c-9592-79f329408c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:28.034962 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91394aab-ca45-477c-9592-79f329408c21 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:28.035251 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91394aab-ca45-477c-9592-79f329408c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:28.035570 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91394aab-ca45-477c-9592-79f329408c21 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:28.036283 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91394aab-ca45-477c-9592-79f329408c21 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:28.036595 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91394aab-ca45-477c-9592-79f329408c21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:28.038525 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91394aab-ca45-477c-9592-79f329408c21 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:28.043568 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 449/881] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Jul 21 03:31:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:31:28.048710 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91394aab-ca45-477c-9592-79f329408c21 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:28.117521 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367d541-9f85-43d9-9676-aa91b559ea57 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:28.150216 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:28.156658 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de617648-041e-468f-99eb-6422de4c266e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:28.157807 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de617648-041e-468f-99eb-6422de4c266e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:28.158349 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de617648-041e-468f-99eb-6422de4c266e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:28.158876 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de617648-041e-468f-99eb-6422de4c266e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:28.161958 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91394aab-ca45-477c-9592-79f329408c21 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:28.171151 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de617648-041e-468f-99eb-6422de4c266e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:28.172964 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de617648-041e-468f-99eb-6422de4c266e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:28.192765 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-de617648-041e-468f-99eb-6422de4c266e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:28.192765 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:28.192765 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:28.192765 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:28.192765 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:28.192765 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:28.192765 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:28.192765 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:28.192765 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:28.192765 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:28.192765 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:28.192765 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:28.192765 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:31:28.192765 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:31:28.192765 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:31:28.194266 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:31:28.194266 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:28.194266 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:28.194266 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:28.194266 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:28.194266 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:28.194266 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:28.194266 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:28.194266 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:28.194266 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:28.194266 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:28.194266 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:28.194266 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:28.194266 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:28.194266 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:28.194266 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:28.194266 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:28.195189 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:31:28.195189 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:31:28.195189 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:28.195189 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:28.201974 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 433/882] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:28.202804 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de617648-041e-468f-99eb-6422de4c266e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:28.207321 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e38d31-fa3f-4168-abd3-be0ab84636ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:28.208272 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e38d31-fa3f-4168-abd3-be0ab84636ee None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:28.208758 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e38d31-fa3f-4168-abd3-be0ab84636ee None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:28.209959 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e38d31-fa3f-4168-abd3-be0ab84636ee None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:28.211038 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e38d31-fa3f-4168-abd3-be0ab84636ee None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:28.211646 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e38d31-fa3f-4168-abd3-be0ab84636ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:28.214036 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e38d31-fa3f-4168-abd3-be0ab84636ee None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:28.220898 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 450/883] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Jul 21 03:31:28 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:31:28.327949 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de617648-041e-468f-99eb-6422de4c266e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:28.368424 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056fccd-54bc-420a-8d23-98f00a299b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:28.369026 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056fccd-54bc-420a-8d23-98f00a299b07 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:28.369314 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056fccd-54bc-420a-8d23-98f00a299b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:28.369598 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056fccd-54bc-420a-8d23-98f00a299b07 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:28.370335 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3056fccd-54bc-420a-8d23-98f00a299b07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:28.370676 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3056fccd-54bc-420a-8d23-98f00a299b07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:28.372069 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3056fccd-54bc-420a-8d23-98f00a299b07 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:28.384379 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 434/884] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:31:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:31:28.390009 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e38d31-fa3f-4168-abd3-be0ab84636ee None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:28.395072 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d19822-972c-4f62-986a-f326d174983d None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:28.395825 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d19822-972c-4f62-986a-f326d174983d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:28.396295 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d19822-972c-4f62-986a-f326d174983d None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:28.399405 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 435/885] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:31:28.408761 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b334229-4740-4413-ba2d-7672b7aea5fc None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:28.409060 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b334229-4740-4413-ba2d-7672b7aea5fc None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:28.409342 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b334229-4740-4413-ba2d-7672b7aea5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:28.432108 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-8b334229-4740-4413-ba2d-7672b7aea5fc None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:28.433964 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8b334229-4740-4413-ba2d-7672b7aea5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:28.445141 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:28.482996 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:28.509073 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e38d31-fa3f-4168-abd3-be0ab84636ee None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:28.526603 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 436/886] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:28 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 03:31:28.550244 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4686442e-ee7e-4668-8fb0-66c623d16822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:28.551430 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686442e-ee7e-4668-8fb0-66c623d16822 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:28.551915 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686442e-ee7e-4668-8fb0-66c623d16822 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:28.552386 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4686442e-ee7e-4668-8fb0-66c623d16822 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:28.555471 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b334229-4740-4413-ba2d-7672b7aea5fc None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:28.561017 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4686442e-ee7e-4668-8fb0-66c623d16822 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:28.562745 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4686442e-ee7e-4668-8fb0-66c623d16822 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:28.577573 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-4686442e-ee7e-4668-8fb0-66c623d16822 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:31:28.577573 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:28.577573 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:28.577573 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:28.577573 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:28.577573 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:28.577573 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:28.577573 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:28.577573 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:28.577573 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:28.577573 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:28.577573 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:28.577573 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 03:31:28.577573 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 03:31:28.577573 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 03:31:28.578448 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 03:31:28.578448 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:28.578448 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:28.578448 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:28.578448 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:28.578448 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:28.578448 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:28.578448 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:28.578448 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:28.578448 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:28.578448 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:28.578448 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:28.578448 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:28.578448 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:28.578448 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:28.578448 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:28.578448 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:28.579751 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 03:31:28.579751 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 03:31:28.579751 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 03:31:28.579751 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 03:31:28.579751 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 03:31:28.579751 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 03:31:28.579751 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:31:28.579751 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:28.582067 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 451/887] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:31:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:28.588013 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4686442e-ee7e-4668-8fb0-66c623d16822 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:28.670301 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b334229-4740-4413-ba2d-7672b7aea5fc None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:28.723613 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a7549-82f3-49e8-816c-45447bccc0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:28.725078 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a7549-82f3-49e8-816c-45447bccc0cd None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:28.725963 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:28.727285 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a7549-82f3-49e8-816c-45447bccc0cd None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:28.727804 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a7549-82f3-49e8-816c-45447bccc0cd None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:28.728723 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a7549-82f3-49e8-816c-45447bccc0cd None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:28.729235 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4686442e-ee7e-4668-8fb0-66c623d16822 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:28.730695 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a7549-82f3-49e8-816c-45447bccc0cd None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:28.747073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-eb8a7549-82f3-49e8-816c-45447bccc0cd None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 03:31:28.747073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:28.747073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 03:31:28.747073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 03:31:28.747073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 03:31:28.747073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 03:31:28.747073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 03:31:28.747073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:31:28.747073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 03:31:28.747073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:28.747073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 03:31:28.747073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:28.747073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:28.747073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:28.747073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:28.747073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:28.747073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:28.748310 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:28.748310 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:28.748310 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:28.748310 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:28.748310 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:28.748310 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:28.748310 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 03:31:28.748310 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 03:31:28.748310 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 03:31:28.748310 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 03:31:28.748310 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:28.748310 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:28.748310 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:28.748310 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:28.748310 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:28.748310 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:28.749333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:28.749333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:28.749333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:28.749333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:28.749333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:28.749333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:28.749333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:28.749333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:28.749333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:28.749333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:28.749333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 03:31:28.749333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:31:28.749333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 03:31:28.749333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:28.754615 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 437/888] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jul 21 03:31:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:31:28.756953 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a7549-82f3-49e8-816c-45447bccc0cd None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:28.777542 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc539a0-c2ad-4c91-a0e8-440995b0792b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:28.778208 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc539a0-c2ad-4c91-a0e8-440995b0792b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:28.778517 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc539a0-c2ad-4c91-a0e8-440995b0792b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:28.778799 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc539a0-c2ad-4c91-a0e8-440995b0792b None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:28.779734 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc539a0-c2ad-4c91-a0e8-440995b0792b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:28.780059 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc539a0-c2ad-4c91-a0e8-440995b0792b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:28.782421 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc539a0-c2ad-4c91-a0e8-440995b0792b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:28.797183 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 452/889] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 03:31:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:28.799015 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e94581-9881-415c-ae21-677faa8a2321 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:28.799314 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e94581-9881-415c-ae21-677faa8a2321 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:28.799595 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e94581-9881-415c-ae21-677faa8a2321 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:28.801343 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 453/890] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:31:28.802696 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e94581-9881-415c-ae21-677faa8a2321 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:28.809300 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:28.873453 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a7549-82f3-49e8-816c-45447bccc0cd None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:28.909262 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a708d-541d-4234-89fa-c37547f437af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:28.909933 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a708d-541d-4234-89fa-c37547f437af None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:28.910217 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a708d-541d-4234-89fa-c37547f437af None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:28.910518 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a708d-541d-4234-89fa-c37547f437af None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:28.911229 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a708d-541d-4234-89fa-c37547f437af None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:28.911542 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a708d-541d-4234-89fa-c37547f437af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:28.912970 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a708d-541d-4234-89fa-c37547f437af None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:28.918552 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 438/891] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jul 21 03:31:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:28.918955 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d584f6-e602-4fad-b756-69d2effda373 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:28.919244 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d584f6-e602-4fad-b756-69d2effda373 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:28.919521 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d584f6-e602-4fad-b756-69d2effda373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:28.930737 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e94581-9881-415c-ae21-677faa8a2321 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:28.936751 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-03d584f6-e602-4fad-b756-69d2effda373 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:28.937940 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-03d584f6-e602-4fad-b756-69d2effda373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:28.967498 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d80295-6351-490e-88be-8a95531d98e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:28.968150 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d80295-6351-490e-88be-8a95531d98e7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:28.968438 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d80295-6351-490e-88be-8a95531d98e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:28.968884 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d80295-6351-490e-88be-8a95531d98e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:28.969529 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d80295-6351-490e-88be-8a95531d98e7 None admin] RBAC: Adding query filter params (role.id=b6ab65019dfc4679a967f9b3f4a6ffde, scope.project.id=0432303daa8b4304a8e07032d6a80781, user.id=73fad109df9f449e8ac5f38749c01ace) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:28.969840 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d80295-6351-490e-88be-8a95531d98e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:28.971341 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d80295-6351-490e-88be-8a95531d98e7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:28.978308 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 454/892] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:31:28 2022] GET /identity/v3/role_assignments?user.id=73fad109df9f449e8ac5f38749c01ace&scope.project.id=0432303daa8b4304a8e07032d6a80781&role.id=b6ab65019dfc4679a967f9b3f4a6ffde => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:28.992003 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d80295-6351-490e-88be-8a95531d98e7 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:29.012263 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 439/893] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:28 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 03:31:29.034509 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d584f6-e602-4fad-b756-69d2effda373 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:29.035309 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:29.071407 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:29.123937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d80295-6351-490e-88be-8a95531d98e7 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:29.164969 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aff7db-5f5b-4723-827d-37ba24733dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:29.165640 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aff7db-5f5b-4723-827d-37ba24733dc9 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:29.165925 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aff7db-5f5b-4723-827d-37ba24733dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:29.166202 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aff7db-5f5b-4723-827d-37ba24733dc9 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:29.166954 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aff7db-5f5b-4723-827d-37ba24733dc9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:29.167264 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aff7db-5f5b-4723-827d-37ba24733dc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:29.167492 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d584f6-e602-4fad-b756-69d2effda373 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:29.168716 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aff7db-5f5b-4723-827d-37ba24733dc9 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:29.174920 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 455/894] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jul 21 03:31:28 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:29.184316 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aff7db-5f5b-4723-827d-37ba24733dc9 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:29.283323 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:29.295794 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aff7db-5f5b-4723-827d-37ba24733dc9 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:29.320177 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea64d31-d757-43bc-bdae-34205ee3db85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:29.321020 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea64d31-d757-43bc-bdae-34205ee3db85 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:29.321307 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea64d31-d757-43bc-bdae-34205ee3db85 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:29.321584 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea64d31-d757-43bc-bdae-34205ee3db85 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:29.322609 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea64d31-d757-43bc-bdae-34205ee3db85 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:29.332069 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea64d31-d757-43bc-bdae-34205ee3db85 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:29.336152 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55912df8-2ca2-4e37-a41f-ae6ae305dca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:29.337968 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55912df8-2ca2-4e37-a41f-ae6ae305dca7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:29.338254 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55912df8-2ca2-4e37-a41f-ae6ae305dca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:29.338556 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55912df8-2ca2-4e37-a41f-ae6ae305dca7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:29.339796 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55912df8-2ca2-4e37-a41f-ae6ae305dca7 None admin] RBAC: Adding query filter params (interface=public, service_id=f51de7b99a064e87b858db894b5f0e16, region_id=RegionOne) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:29.340112 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55912df8-2ca2-4e37-a41f-ae6ae305dca7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:29.341534 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55912df8-2ca2-4e37-a41f-ae6ae305dca7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:29.350212 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 456/895] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Jul 21 03:31:29 2022] GET /identity/v3/endpoints?service_id=f51de7b99a064e87b858db894b5f0e16&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:31:29.355387 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55912df8-2ca2-4e37-a41f-ae6ae305dca7 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:29.376103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-9ea64d31-d757-43bc-bdae-34205ee3db85 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 03:31:29.376103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:29.376103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 03:31:29.376103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 03:31:29.376103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 03:31:29.376103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 03:31:29.376103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 03:31:29.376103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:31:29.376103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 03:31:29.376103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:29.376103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 03:31:29.376103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:29.376103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:29.376103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:29.376103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:29.376103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:29.376103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:29.377215 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:29.377215 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:29.377215 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:29.377215 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:29.377215 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:29.377215 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:29.377215 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 03:31:29.377215 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 03:31:29.377215 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 03:31:29.377215 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 03:31:29.377215 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:29.377215 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:29.377215 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:29.377215 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:29.377215 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:29.377215 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:29.378690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:29.378690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:29.378690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:29.378690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:29.378690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:29.378690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:29.378690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:29.378690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:29.378690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:29.378690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:29.378690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 03:31:29.378690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:31:29.378690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 03:31:29.378690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:29.378690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 440/896] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Jul 21 03:31:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:31:29.391816 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea64d31-d757-43bc-bdae-34205ee3db85 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:29.471754 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55912df8-2ca2-4e37-a41f-ae6ae305dca7 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:29.519147 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f88f70-6614-4d65-a7bc-8cefbfa4cdf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:29.519834 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f88f70-6614-4d65-a7bc-8cefbfa4cdf8 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:29.521362 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f88f70-6614-4d65-a7bc-8cefbfa4cdf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:29.522179 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f88f70-6614-4d65-a7bc-8cefbfa4cdf8 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:29.523176 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f88f70-6614-4d65-a7bc-8cefbfa4cdf8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:29.524553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f88f70-6614-4d65-a7bc-8cefbfa4cdf8 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:29.554936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 457/897] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Jul 21 03:31:29 2022] GET /identity/v3/services => generated 1011 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:31:29.594958 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:29.602613 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea64d31-d757-43bc-bdae-34205ee3db85 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:29.681503 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178694a-44fd-431f-aded-0dd4d4d63def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:29.681964 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178694a-44fd-431f-aded-0dd4d4d63def None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:29.682251 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178694a-44fd-431f-aded-0dd4d4d63def None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:29.690490 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178694a-44fd-431f-aded-0dd4d4d63def None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:29.690490 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4178694a-44fd-431f-aded-0dd4d4d63def None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:29.690490 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4178694a-44fd-431f-aded-0dd4d4d63def None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:29.690490 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4178694a-44fd-431f-aded-0dd4d4d63def None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:29.691068 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 441/898] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Jul 21 03:31:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:29.697062 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f88f70-6614-4d65-a7bc-8cefbfa4cdf8 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:29.727263 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:29.817503 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f88f70-6614-4d65-a7bc-8cefbfa4cdf8 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:29.852899 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed062d2c-6caf-4ca6-84a0-067e17b8eac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:29.853572 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed062d2c-6caf-4ca6-84a0-067e17b8eac7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:29.853863 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed062d2c-6caf-4ca6-84a0-067e17b8eac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:29.854142 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed062d2c-6caf-4ca6-84a0-067e17b8eac7 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:29.854916 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed062d2c-6caf-4ca6-84a0-067e17b8eac7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:29.855189 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed062d2c-6caf-4ca6-84a0-067e17b8eac7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:29.856557 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed062d2c-6caf-4ca6-84a0-067e17b8eac7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:29.861557 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 458/899] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Jul 21 03:31:29 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:30.310956 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58552e-025e-4a61-9fe9-46a3351f2995 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:30.311588 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58552e-025e-4a61-9fe9-46a3351f2995 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:30.311588 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58552e-025e-4a61-9fe9-46a3351f2995 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:30.313135 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 442/900] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:31:30.318251 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c28f92-7d10-45e1-9239-307a5998f0f2 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:30.318609 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c28f92-7d10-45e1-9239-307a5998f0f2 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:30.318894 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c28f92-7d10-45e1-9239-307a5998f0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:30.336105 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-02c28f92-7d10-45e1-9239-307a5998f0f2 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:30.337291 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-02c28f92-7d10-45e1-9239-307a5998f0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:30.407976 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 459/901] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:30 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 03:31:30.430822 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58552e-025e-4a61-9fe9-46a3351f2995 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:30.534958 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58552e-025e-4a61-9fe9-46a3351f2995 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:30.569664 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6bb22-0139-427f-abce-73b22ab55697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:30.570255 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6bb22-0139-427f-abce-73b22ab55697 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:30.570567 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6bb22-0139-427f-abce-73b22ab55697 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:30.570845 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6bb22-0139-427f-abce-73b22ab55697 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:30.571581 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6bb22-0139-427f-abce-73b22ab55697 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:30.573029 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6bb22-0139-427f-abce-73b22ab55697 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:30.590099 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 443/902] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jul 21 03:31:30 2022] POST /identity/v3/services => generated 269 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:31:31.135453 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a417feb-d73e-43e8-b72b-1d7f893fc0fe None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:31.135999 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a417feb-d73e-43e8-b72b-1d7f893fc0fe None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:31.135999 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a417feb-d73e-43e8-b72b-1d7f893fc0fe None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:31.137648 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 460/903] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:31:31.142778 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd2e55-5399-4758-9b5d-a520240ff7ed None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:31.143076 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd2e55-5399-4758-9b5d-a520240ff7ed None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:31.143362 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd2e55-5399-4758-9b5d-a520240ff7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:31.160797 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-cdbd2e55-5399-4758-9b5d-a520240ff7ed None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:31.161986 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-cdbd2e55-5399-4758-9b5d-a520240ff7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:31.175400 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:31.236916 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 444/904] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:31 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 03:31:31.260002 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a417feb-d73e-43e8-b72b-1d7f893fc0fe None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:31.273058 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:31.367990 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a417feb-d73e-43e8-b72b-1d7f893fc0fe None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:31.403450 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e4316-9403-47bd-9911-b29840d98737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:31.404245 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e4316-9403-47bd-9911-b29840d98737 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:31.404539 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e4316-9403-47bd-9911-b29840d98737 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:31.404821 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e4316-9403-47bd-9911-b29840d98737 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:31.416156 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269e4316-9403-47bd-9911-b29840d98737 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:31:31.424626 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-269e4316-9403-47bd-9911-b29840d98737 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 03:31:31.424626 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:31.424626 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:31.424626 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:31.424626 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:31.424626 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:31.424626 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:31.424626 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:31.424626 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:31.424626 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:31.424626 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:31.424626 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:31.424626 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:31:31.424626 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:31:31.424626 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:31:31.424626 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:31:31.425622 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:31:31.425622 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:31:31.425622 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:31:31.425622 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:31:31.425622 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:31.425622 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:31.425622 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:31.425622 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:31.425622 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:31.425622 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:31.425622 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:31.425622 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:31.425622 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:31.425622 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:31.425622 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:31.425622 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:31.426955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:31.426955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:31.426955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:31.426955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:31.426955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:31:31.426955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:31:31.426955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:31:31.426955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:31:31.426955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:31:31.426955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:31:31.426955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 03:31:31.426955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:31.426955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 461/905] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Jul 21 03:31:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:31.432677 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd2e55-5399-4758-9b5d-a520240ff7ed None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:31.533738 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbd2e55-5399-4758-9b5d-a520240ff7ed None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:31.568908 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678eece7-3218-4d77-95ea-555d99830a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:31.569649 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678eece7-3218-4d77-95ea-555d99830a93 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:31.569935 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678eece7-3218-4d77-95ea-555d99830a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:31.570214 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678eece7-3218-4d77-95ea-555d99830a93 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:31.571060 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678eece7-3218-4d77-95ea-555d99830a93 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:31.571372 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678eece7-3218-4d77-95ea-555d99830a93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:31.572761 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678eece7-3218-4d77-95ea-555d99830a93 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:31.581134 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 445/906] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Jul 21 03:31:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:31.587293 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e4316-9403-47bd-9911-b29840d98737 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:31.675011 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:31.698831 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e4316-9403-47bd-9911-b29840d98737 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:31.740014 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e166dc-bb32-490a-9fa6-2d5301dde461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:31.740894 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e166dc-bb32-490a-9fa6-2d5301dde461 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:31.741345 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e166dc-bb32-490a-9fa6-2d5301dde461 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:31.741689 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e166dc-bb32-490a-9fa6-2d5301dde461 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:31.752304 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e166dc-bb32-490a-9fa6-2d5301dde461 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:31.753764 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e166dc-bb32-490a-9fa6-2d5301dde461 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:31.773061 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-b1e166dc-bb32-490a-9fa6-2d5301dde461 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:31.773061 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:31.773061 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:31.773061 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:31.773061 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:31.773061 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:31.773061 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:31.773061 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:31.773061 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:31.773061 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:31.773061 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:31.773061 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:31.773061 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:31:31.773061 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:31:31.773061 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:31:31.774029 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:31:31.774029 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:31.774029 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:31.774029 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:31.774029 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:31.774029 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:31.774029 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:31.774029 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:31.774029 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:31.774029 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:31.774029 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:31.774029 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:31.774029 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:31.774029 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:31.774029 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:31.774029 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:31.774029 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:31.775390 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:31:31.775390 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:31:31.775390 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:31.775390 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:31.775390 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 462/907] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:31.780644 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678eece7-3218-4d77-95ea-555d99830a93 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:31.793379 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:31.818874 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b60d0a-64d0-4b2f-85fe-d52119e674cd None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:31.819199 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b60d0a-64d0-4b2f-85fe-d52119e674cd None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:31.819409 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b60d0a-64d0-4b2f-85fe-d52119e674cd None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:31.821868 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 463/908] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 03:31:31.826223 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e1e57-51ad-48ce-a378-322f57960191 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:31.826659 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e1e57-51ad-48ce-a378-322f57960191 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:31.827162 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e1e57-51ad-48ce-a378-322f57960191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:31.844490 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-9f9e1e57-51ad-48ce-a378-322f57960191 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:31.845998 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9f9e1e57-51ad-48ce-a378-322f57960191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:31.893846 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678eece7-3218-4d77-95ea-555d99830a93 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:31.934297 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1213b-6b7e-4d5e-be8c-e762ca8152ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:31.935168 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1213b-6b7e-4d5e-be8c-e762ca8152ee None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:31.935450 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1213b-6b7e-4d5e-be8c-e762ca8152ee None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:31.935732 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add1213b-6b7e-4d5e-be8c-e762ca8152ee None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:31.936458 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1213b-6b7e-4d5e-be8c-e762ca8152ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:31.936763 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1213b-6b7e-4d5e-be8c-e762ca8152ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:31.938169 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add1213b-6b7e-4d5e-be8c-e762ca8152ee None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:31.946143 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 464/909] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:31 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 03:31:31.947518 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124b828-761c-4a11-837f-d6c52966d679 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:31.947816 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124b828-761c-4a11-837f-d6c52966d679 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:31.948096 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124b828-761c-4a11-837f-d6c52966d679 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:31.950011 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 465/910] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:31:31.957995 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace80b52-cd61-456c-8204-d5ed407db652 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:31.957995 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace80b52-cd61-456c-8204-d5ed407db652 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:31.957995 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace80b52-cd61-456c-8204-d5ed407db652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:31.958689 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 446/911] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:31:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:31.960496 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1213b-6b7e-4d5e-be8c-e762ca8152ee None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:31.975704 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-ace80b52-cd61-456c-8204-d5ed407db652 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:31.976897 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ace80b52-cd61-456c-8204-d5ed407db652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:32.030799 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:32.032095 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:32.055541 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 466/912] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:31 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 03:31:32.056667 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace80b52-cd61-456c-8204-d5ed407db652 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:32.073038 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add1213b-6b7e-4d5e-be8c-e762ca8152ee None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:32.108421 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70bd7c-c8b2-4a19-ae1e-b319e3aa4655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:32.109236 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70bd7c-c8b2-4a19-ae1e-b319e3aa4655 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:32.109522 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70bd7c-c8b2-4a19-ae1e-b319e3aa4655 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:32.109798 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb70bd7c-c8b2-4a19-ae1e-b319e3aa4655 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:32.117134 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb70bd7c-c8b2-4a19-ae1e-b319e3aa4655 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:32.118630 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb70bd7c-c8b2-4a19-ae1e-b319e3aa4655 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:32.134108 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-fb70bd7c-c8b2-4a19-ae1e-b319e3aa4655 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 03:31:32.134108 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:32.134108 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:32.134108 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:32.134108 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:32.134108 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:32.134108 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:32.134108 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:32.134108 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:32.134108 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:32.134108 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:32.134108 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:32.134108 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 03:31:32.134108 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 03:31:32.134108 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 03:31:32.134108 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 03:31:32.135239 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:32.135239 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:32.135239 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 03:31:32.135239 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:31:32.135239 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 03:31:32.135239 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:31:32.135239 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:32.135239 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:32.135239 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:32.135239 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:32.135239 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:32.135239 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:32.135239 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:32.135239 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:32.135239 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:32.135239 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:32.135239 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:32.135239 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:32.136339 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:32.136339 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:32.136339 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 03:31:32.136339 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 03:31:32.136339 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 03:31:32.136339 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 03:31:32.136339 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 03:31:32.136339 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 03:31:32.136339 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 03:31:32.136339 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:32.136339 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 447/913] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Jul 21 03:31:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:32.136988 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70bd7c-c8b2-4a19-ae1e-b319e3aa4655 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:32.179083 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace80b52-cd61-456c-8204-d5ed407db652 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:32.215815 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac24512-0598-40ca-8296-4f4bcc95aa10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:32.216544 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac24512-0598-40ca-8296-4f4bcc95aa10 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:32.216832 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac24512-0598-40ca-8296-4f4bcc95aa10 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:32.217112 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac24512-0598-40ca-8296-4f4bcc95aa10 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:32.217775 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac24512-0598-40ca-8296-4f4bcc95aa10 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:32.219165 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac24512-0598-40ca-8296-4f4bcc95aa10 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:32.232315 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-4ac24512-0598-40ca-8296-4f4bcc95aa10 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 03:31:32.232315 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:32.232315 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 03:31:32.232315 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 03:31:32.232315 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 03:31:32.232315 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 03:31:32.232315 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 03:31:32.232315 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:31:32.232315 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 03:31:32.232315 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:32.232315 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 03:31:32.232315 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:32.232315 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:32.232315 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:32.232315 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:32.232315 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:32.232315 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:32.233322 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:32.233322 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:32.233322 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:32.233322 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:32.233322 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:32.233322 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:32.233322 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 03:31:32.233322 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 03:31:32.233322 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 03:31:32.233322 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 03:31:32.233322 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:32.233322 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:32.233322 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:32.233322 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:32.233322 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:32.233322 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:32.234145 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:32.234145 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:32.234145 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:32.234145 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:32.234145 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:32.234145 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:32.234145 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:32.234145 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:32.234145 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:32.234145 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:32.234145 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 03:31:32.234145 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:31:32.234145 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 03:31:32.234145 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:32.234145 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 467/914] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jul 21 03:31:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:32.235250 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac24512-0598-40ca-8296-4f4bcc95aa10 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:32.250445 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb70bd7c-c8b2-4a19-ae1e-b319e3aa4655 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:32.278501 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:32.284659 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:32.288704 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b42cb-92e2-45f2-92d3-3a6e8de3c64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:32.289573 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b42cb-92e2-45f2-92d3-3a6e8de3c64a None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:32.289855 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b42cb-92e2-45f2-92d3-3a6e8de3c64a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:32.290130 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b42cb-92e2-45f2-92d3-3a6e8de3c64a None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:32.290886 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b42cb-92e2-45f2-92d3-3a6e8de3c64a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:32.292248 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b42cb-92e2-45f2-92d3-3a6e8de3c64a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:32.311081 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 448/915] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jul 21 03:31:32 2022] POST /identity/v3/services => generated 241 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:31:32.311081 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b42cb-92e2-45f2-92d3-3a6e8de3c64a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:32.362979 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac24512-0598-40ca-8296-4f4bcc95aa10 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:32.417929 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb376d8-7a20-439d-8640-baaa1de85271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:32.418655 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb376d8-7a20-439d-8640-baaa1de85271 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:32.418945 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb376d8-7a20-439d-8640-baaa1de85271 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:32.419222 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb376d8-7a20-439d-8640-baaa1de85271 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:32.420705 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb376d8-7a20-439d-8640-baaa1de85271 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:32.421030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb376d8-7a20-439d-8640-baaa1de85271 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:32.422927 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb376d8-7a20-439d-8640-baaa1de85271 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:32.449977 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 468/916] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Jul 21 03:31:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:32.456920 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb376d8-7a20-439d-8640-baaa1de85271 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:32.463202 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b42cb-92e2-45f2-92d3-3a6e8de3c64a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:32.509733 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9c68a-9277-468a-bbd2-8ef3a3f49930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:32.510384 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9c68a-9277-468a-bbd2-8ef3a3f49930 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:32.510712 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9c68a-9277-468a-bbd2-8ef3a3f49930 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:32.510995 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9c68a-9277-468a-bbd2-8ef3a3f49930 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:32.511715 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb9c68a-9277-468a-bbd2-8ef3a3f49930 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:32.512028 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb9c68a-9277-468a-bbd2-8ef3a3f49930 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:32.513419 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb9c68a-9277-468a-bbd2-8ef3a3f49930 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:32.518828 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 449/917] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jul 21 03:31:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:32.524980 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9c68a-9277-468a-bbd2-8ef3a3f49930 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:32.580457 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:32.599106 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:32.603835 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb376d8-7a20-439d-8640-baaa1de85271 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:32.643667 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9c68a-9277-468a-bbd2-8ef3a3f49930 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:32.651339 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae1b1a-82ec-4783-95fa-b32b46a34d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:32.652860 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae1b1a-82ec-4783-95fa-b32b46a34d66 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:32.653326 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae1b1a-82ec-4783-95fa-b32b46a34d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:32.653794 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae1b1a-82ec-4783-95fa-b32b46a34d66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:32.668053 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edae1b1a-82ec-4783-95fa-b32b46a34d66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:32.670527 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edae1b1a-82ec-4783-95fa-b32b46a34d66 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:32.682700 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eddddb-9afa-441d-b8f0-3ec752c8ce67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:32.683513 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eddddb-9afa-441d-b8f0-3ec752c8ce67 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:32.683875 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eddddb-9afa-441d-b8f0-3ec752c8ce67 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:32.684270 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eddddb-9afa-441d-b8f0-3ec752c8ce67 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:32.685082 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eddddb-9afa-441d-b8f0-3ec752c8ce67 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:32.685462 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eddddb-9afa-441d-b8f0-3ec752c8ce67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:32.687005 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eddddb-9afa-441d-b8f0-3ec752c8ce67 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:32.694039 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-edae1b1a-82ec-4783-95fa-b32b46a34d66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:32.694039 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:32.694039 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:32.694039 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:32.694039 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:32.694039 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:32.694039 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:32.694039 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:32.694039 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:32.694039 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:32.694039 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:32.694039 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:32.694039 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:31:32.694039 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:31:32.694039 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:31:32.694965 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:31:32.694965 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:32.694965 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:32.694965 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:32.694965 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:32.694965 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:32.694965 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:32.694965 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:32.694965 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:32.694965 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:32.694965 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:32.694965 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:32.694965 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:32.694965 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:32.694965 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:32.694965 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:32.694965 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:32.695855 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:31:32.695855 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:31:32.695855 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:32.695855 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:32.698216 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 469/918] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:32.702511 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 450/919] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jul 21 03:31:32 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:32.704028 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae1b1a-82ec-4783-95fa-b32b46a34d66 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:32.705657 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eddddb-9afa-441d-b8f0-3ec752c8ce67 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:32.810135 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae1b1a-82ec-4783-95fa-b32b46a34d66 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:32.813753 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eddddb-9afa-441d-b8f0-3ec752c8ce67 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:32.828985 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:32.847819 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4ecde8-6444-4c97-8805-2206c41f11b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:32.848888 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ecde8-6444-4c97-8805-2206c41f11b0 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:32.849363 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ecde8-6444-4c97-8805-2206c41f11b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:32.850369 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4ecde8-6444-4c97-8805-2206c41f11b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:32.850918 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c4962-413a-4a67-ac2f-fa06be89c81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:32.851547 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ecde8-6444-4c97-8805-2206c41f11b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:32.851667 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c4962-413a-4a67-ac2f-fa06be89c81b None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:32.851846 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c4962-413a-4a67-ac2f-fa06be89c81b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:32.852128 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c4962-413a-4a67-ac2f-fa06be89c81b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:32.852496 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ecde8-6444-4c97-8805-2206c41f11b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:32.852867 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c4962-413a-4a67-ac2f-fa06be89c81b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:32.854228 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4ecde8-6444-4c97-8805-2206c41f11b0 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:32.854343 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c4962-413a-4a67-ac2f-fa06be89c81b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:32.869659 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 470/920] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:31:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:32.871015 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48892b9d-c5cd-459b-8149-0180c6b19edf None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:32.871311 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48892b9d-c5cd-459b-8149-0180c6b19edf None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:32.871593 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48892b9d-c5cd-459b-8149-0180c6b19edf None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:32.873017 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 471/921] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:31:32.877552 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48892b9d-c5cd-459b-8149-0180c6b19edf None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:32.890675 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 451/922] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Jul 21 03:31:32 2022] POST /identity/v3/endpoints => generated 346 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:31:32.890675 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97596ba4-5e48-4ddc-b2a4-6b231a6b6785 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:32.890675 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97596ba4-5e48-4ddc-b2a4-6b231a6b6785 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:32.890675 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97596ba4-5e48-4ddc-b2a4-6b231a6b6785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:32.908293 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:32.910122 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-97596ba4-5e48-4ddc-b2a4-6b231a6b6785 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:32.911588 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-97596ba4-5e48-4ddc-b2a4-6b231a6b6785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:33.012128 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 452/923] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 03:31:33.029101 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48892b9d-c5cd-459b-8149-0180c6b19edf None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:33.036135 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97596ba4-5e48-4ddc-b2a4-6b231a6b6785 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:33.075516 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06effe25-f571-4527-9ee7-3e535af30c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:33.076594 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06effe25-f571-4527-9ee7-3e535af30c65 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:33.076929 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06effe25-f571-4527-9ee7-3e535af30c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:33.077207 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06effe25-f571-4527-9ee7-3e535af30c65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:33.085848 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06effe25-f571-4527-9ee7-3e535af30c65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:33.087332 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06effe25-f571-4527-9ee7-3e535af30c65 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:33.102217 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-06effe25-f571-4527-9ee7-3e535af30c65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:31:33.102217 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:33.102217 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:33.102217 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:33.102217 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:33.102217 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:33.102217 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:33.102217 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:33.102217 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:33.102217 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:33.102217 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:33.102217 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:33.102217 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 03:31:33.102217 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 03:31:33.102217 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 03:31:33.103395 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 03:31:33.103395 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:33.103395 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:33.103395 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:33.103395 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:33.103395 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:33.103395 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:33.103395 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:33.103395 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:33.103395 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:33.103395 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:33.103395 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:33.103395 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:33.103395 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:33.103395 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:33.103395 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:33.103395 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:33.104364 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 03:31:33.104364 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 03:31:33.104364 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 03:31:33.104364 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 03:31:33.104364 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 03:31:33.104364 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 03:31:33.104364 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:31:33.104364 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:33.105362 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 472/924] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:31:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:33.112696 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06effe25-f571-4527-9ee7-3e535af30c65 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:33.158113 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:33.167904 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97596ba4-5e48-4ddc-b2a4-6b231a6b6785 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:33.196980 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:33.218642 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e92744-bb32-4bbc-ad31-6174e6b9ab9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:33.220015 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e92744-bb32-4bbc-ad31-6174e6b9ab9d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:33.220815 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e92744-bb32-4bbc-ad31-6174e6b9ab9d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:33.221289 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e92744-bb32-4bbc-ad31-6174e6b9ab9d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:33.222130 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e92744-bb32-4bbc-ad31-6174e6b9ab9d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:33.223713 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e92744-bb32-4bbc-ad31-6174e6b9ab9d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:33.242102 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-81e92744-bb32-4bbc-ad31-6174e6b9ab9d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 03:31:33.242102 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:33.242102 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 03:31:33.242102 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 03:31:33.242102 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 03:31:33.242102 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 03:31:33.242102 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 03:31:33.242102 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:31:33.242102 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 03:31:33.242102 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:33.242102 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 03:31:33.242102 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:33.242102 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:33.242102 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:33.242102 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:33.242102 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:33.243558 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:33.243558 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:33.243558 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:33.243558 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:33.243558 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:33.243558 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:33.243558 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:33.243558 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 03:31:33.243558 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 03:31:33.243558 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 03:31:33.243558 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 03:31:33.243558 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:33.243558 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:33.243558 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:33.243558 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:33.243558 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:33.244609 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:33.244609 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:33.244609 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:33.244609 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:33.244609 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:33.244609 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:33.244609 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:33.244609 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:33.244609 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:33.244609 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:33.244609 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:33.244609 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 03:31:33.244609 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:31:33.244609 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 03:31:33.244609 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:33.247747 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 453/925] 10.222.0.20 () {56 vars in 1132 bytes} [Thu Jul 21 03:31:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:31:33.250636 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06effe25-f571-4527-9ee7-3e535af30c65 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:33.253735 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e92744-bb32-4bbc-ad31-6174e6b9ab9d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:33.293565 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129ffb0-bdd7-4c04-8fd9-01b957a2588d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:33.295536 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129ffb0-bdd7-4c04-8fd9-01b957a2588d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:33.296193 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129ffb0-bdd7-4c04-8fd9-01b957a2588d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:33.297316 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129ffb0-bdd7-4c04-8fd9-01b957a2588d None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:33.298756 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8129ffb0-bdd7-4c04-8fd9-01b957a2588d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:33.299436 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8129ffb0-bdd7-4c04-8fd9-01b957a2588d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:33.300956 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8129ffb0-bdd7-4c04-8fd9-01b957a2588d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:33.316776 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 473/926] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 03:31:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:33.322070 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129ffb0-bdd7-4c04-8fd9-01b957a2588d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:33.383886 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e92744-bb32-4bbc-ad31-6174e6b9ab9d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:33.421676 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0458290e-8627-4278-84f2-5a6975a04b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:33.422667 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458290e-8627-4278-84f2-5a6975a04b3e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:33.423600 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458290e-8627-4278-84f2-5a6975a04b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:33.424029 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458290e-8627-4278-84f2-5a6975a04b3e None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:33.425155 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0458290e-8627-4278-84f2-5a6975a04b3e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:33.425610 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0458290e-8627-4278-84f2-5a6975a04b3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:33.428150 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0458290e-8627-4278-84f2-5a6975a04b3e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:33.435558 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 454/927] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Jul 21 03:31:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:33.440020 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129ffb0-bdd7-4c04-8fd9-01b957a2588d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:33.442352 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0458290e-8627-4278-84f2-5a6975a04b3e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:33.471270 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:33.475517 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:33.478214 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da1a75-6428-472f-a7fd-5f2d3b0b0395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:33.479533 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da1a75-6428-472f-a7fd-5f2d3b0b0395 None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:33.480027 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da1a75-6428-472f-a7fd-5f2d3b0b0395 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:33.480510 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da1a75-6428-472f-a7fd-5f2d3b0b0395 None admin] PATH_INFO: `/v3/projects/0432303daa8b4304a8e07032d6a80781/users/73fad109df9f449e8ac5f38749c01ace/roles/b6ab65019dfc4679a967f9b3f4a6ffde` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:33.483072 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41da1a75-6428-472f-a7fd-5f2d3b0b0395 None admin] RBAC: Authorizing `identity:create_grant(project_id=0432303daa8b4304a8e07032d6a80781, user_id=73fad109df9f449e8ac5f38749c01ace, role_id=b6ab65019dfc4679a967f9b3f4a6ffde)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:33.484705 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41da1a75-6428-472f-a7fd-5f2d3b0b0395 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:33.501396 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 474/928] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 03:31:33 2022] PUT /identity/v3/projects/0432303daa8b4304a8e07032d6a80781/users/73fad109df9f449e8ac5f38749c01ace/roles/b6ab65019dfc4679a967f9b3f4a6ffde => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:31:33.579308 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0458290e-8627-4278-84f2-5a6975a04b3e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:33.617057 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce55609-6cf8-4cae-b57f-bbb251eb1195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:33.618102 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce55609-6cf8-4cae-b57f-bbb251eb1195 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:33.618619 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce55609-6cf8-4cae-b57f-bbb251eb1195 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:33.619081 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce55609-6cf8-4cae-b57f-bbb251eb1195 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:33.620049 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce55609-6cf8-4cae-b57f-bbb251eb1195 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:33.620561 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce55609-6cf8-4cae-b57f-bbb251eb1195 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:33.622174 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce55609-6cf8-4cae-b57f-bbb251eb1195 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:33.628673 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 455/929] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Jul 21 03:31:33 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:33.635687 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da1a75-6428-472f-a7fd-5f2d3b0b0395 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:33.750214 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da1a75-6428-472f-a7fd-5f2d3b0b0395 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:33.785853 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f221a652-a291-4b5c-98e9-bdaabced7abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:33.786795 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221a652-a291-4b5c-98e9-bdaabced7abe None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:33.787263 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221a652-a291-4b5c-98e9-bdaabced7abe None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:33.787688 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221a652-a291-4b5c-98e9-bdaabced7abe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:33.788670 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f221a652-a291-4b5c-98e9-bdaabced7abe None admin] RBAC: Adding query filter params (interface=public, service_id=bef3fea4a41b498099c35d24f30efdfe, region_id=RegionOne) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:33.789154 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f221a652-a291-4b5c-98e9-bdaabced7abe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:33.790670 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f221a652-a291-4b5c-98e9-bdaabced7abe None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:33.796393 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 475/930] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Jul 21 03:31:33 2022] GET /identity/v3/endpoints?service_id=bef3fea4a41b498099c35d24f30efdfe&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:33.803696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce55609-6cf8-4cae-b57f-bbb251eb1195 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:33.895832 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:33.910022 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce55609-6cf8-4cae-b57f-bbb251eb1195 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:33.945941 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0edbdc-8ec0-4713-b4ca-04ad9108adcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:33.947003 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0edbdc-8ec0-4713-b4ca-04ad9108adcc None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:33.947514 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0edbdc-8ec0-4713-b4ca-04ad9108adcc None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:33.948058 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0edbdc-8ec0-4713-b4ca-04ad9108adcc None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:33.948956 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0edbdc-8ec0-4713-b4ca-04ad9108adcc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:33.950596 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0edbdc-8ec0-4713-b4ca-04ad9108adcc None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:33.957309 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 456/931] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Jul 21 03:31:33 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:31:34.438912 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6d5ec-a37c-422c-bc80-5624ce6daceb None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:34.439953 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6d5ec-a37c-422c-bc80-5624ce6daceb None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:34.440466 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6d5ec-a37c-422c-bc80-5624ce6daceb None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:34.442289 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 476/932] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:31:34.447956 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44269a8f-8cdb-4b29-b3bf-785b58e175b1 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:34.448472 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44269a8f-8cdb-4b29-b3bf-785b58e175b1 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:34.448978 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44269a8f-8cdb-4b29-b3bf-785b58e175b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:34.466566 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-44269a8f-8cdb-4b29-b3bf-785b58e175b1 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:34.468097 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-44269a8f-8cdb-4b29-b3bf-785b58e175b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:34.542232 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 457/933] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 03:31:34.565788 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6d5ec-a37c-422c-bc80-5624ce6daceb None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:34.626004 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:34.673336 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c6d5ec-a37c-422c-bc80-5624ce6daceb None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:34.709547 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c189c672-9c0c-499b-aff5-8e3224be086f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:34.710313 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189c672-9c0c-499b-aff5-8e3224be086f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:34.710636 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189c672-9c0c-499b-aff5-8e3224be086f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:34.710918 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c189c672-9c0c-499b-aff5-8e3224be086f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:34.711593 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c189c672-9c0c-499b-aff5-8e3224be086f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:34.713012 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c189c672-9c0c-499b-aff5-8e3224be086f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:34.726987 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-c189c672-9c0c-499b-aff5-8e3224be086f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 03:31:34.726987 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:34.726987 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 03:31:34.726987 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 03:31:34.726987 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 03:31:34.726987 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 03:31:34.726987 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 03:31:34.726987 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:31:34.726987 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 03:31:34.726987 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:34.726987 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 03:31:34.726987 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:34.726987 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:34.726987 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:34.726987 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:34.726987 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:34.726987 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:34.728043 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:34.728043 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:34.728043 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:34.728043 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:34.728043 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:34.728043 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:34.728043 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 03:31:34.728043 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 03:31:34.728043 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 03:31:34.728043 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 03:31:34.728043 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:34.728043 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:34.728043 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:34.728043 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:34.728043 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:34.728043 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:34.728863 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:34.728863 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:34.728863 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:34.728863 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:34.728863 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:34.728863 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:34.728863 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:34.728863 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:34.728863 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:34.728863 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:34.728863 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 03:31:34.728863 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:31:34.728863 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 03:31:34.728863 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:34.728863 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 477/934] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Jul 21 03:31:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:34.736331 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44269a8f-8cdb-4b29-b3bf-785b58e175b1 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:34.821110 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:34.840103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44269a8f-8cdb-4b29-b3bf-785b58e175b1 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:34.879234 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a3f0bb-d68d-4d46-a6f8-d79ce2f00458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:34.879902 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3f0bb-d68d-4d46-a6f8-d79ce2f00458 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:34.880189 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3f0bb-d68d-4d46-a6f8-d79ce2f00458 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:34.880467 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a3f0bb-d68d-4d46-a6f8-d79ce2f00458 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:34.881720 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a3f0bb-d68d-4d46-a6f8-d79ce2f00458 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:34.882025 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a3f0bb-d68d-4d46-a6f8-d79ce2f00458 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:34.883494 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a3f0bb-d68d-4d46-a6f8-d79ce2f00458 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:34.888622 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 458/935] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Jul 21 03:31:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:34.895531 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c189c672-9c0c-499b-aff5-8e3224be086f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:35.000985 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c189c672-9c0c-499b-aff5-8e3224be086f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:35.020621 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:35.035115 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd092fe6-c17d-44f6-902f-1f8ba73d5e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:35.036076 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd092fe6-c17d-44f6-902f-1f8ba73d5e46 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:35.036366 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd092fe6-c17d-44f6-902f-1f8ba73d5e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:35.036645 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd092fe6-c17d-44f6-902f-1f8ba73d5e46 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:35.037873 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd092fe6-c17d-44f6-902f-1f8ba73d5e46 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:35.038180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd092fe6-c17d-44f6-902f-1f8ba73d5e46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:35.039589 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd092fe6-c17d-44f6-902f-1f8ba73d5e46 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:35.044938 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 478/936] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Jul 21 03:31:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:35.051539 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a3f0bb-d68d-4d46-a6f8-d79ce2f00458 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:35.150847 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020df4d6-46cb-4546-bc40-7aa32e3168a6 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:35.151190 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020df4d6-46cb-4546-bc40-7aa32e3168a6 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:35.151451 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020df4d6-46cb-4546-bc40-7aa32e3168a6 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:35.153080 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 479/937] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 03:31:35.158059 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712cb28-beb6-43d3-b96e-59ed35cf4673 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:35.158349 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712cb28-beb6-43d3-b96e-59ed35cf4673 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:35.158665 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712cb28-beb6-43d3-b96e-59ed35cf4673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:35.167440 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a3f0bb-d68d-4d46-a6f8-d79ce2f00458 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:35.180967 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-5712cb28-beb6-43d3-b96e-59ed35cf4673 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:35.182802 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5712cb28-beb6-43d3-b96e-59ed35cf4673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:35.205695 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989bd264-30b6-4731-990e-dccd93870441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:35.206808 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bd264-30b6-4731-990e-dccd93870441 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:35.207289 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bd264-30b6-4731-990e-dccd93870441 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:35.207736 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989bd264-30b6-4731-990e-dccd93870441 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:35.208922 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989bd264-30b6-4731-990e-dccd93870441 None admin] RBAC: Adding query filter params (interface=public, service_id=b076258ecd76423ab5f02663ccc32d29, region_id=RegionOne) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:35.209496 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989bd264-30b6-4731-990e-dccd93870441 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:35.211161 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989bd264-30b6-4731-990e-dccd93870441 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:35.219324 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 459/938] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Jul 21 03:31:35 2022] GET /identity/v3/endpoints?service_id=b076258ecd76423ab5f02663ccc32d29&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:35.225174 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989bd264-30b6-4731-990e-dccd93870441 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:35.240947 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:35.266638 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 480/939] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 03:31:35.293232 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712cb28-beb6-43d3-b96e-59ed35cf4673 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:35.355712 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989bd264-30b6-4731-990e-dccd93870441 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:35.390299 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1989589-0746-403e-97e1-2403d92b57c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:35.391275 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1989589-0746-403e-97e1-2403d92b57c7 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:35.391737 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1989589-0746-403e-97e1-2403d92b57c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:35.392190 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1989589-0746-403e-97e1-2403d92b57c7 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:35.393216 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1989589-0746-403e-97e1-2403d92b57c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:35.394833 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1989589-0746-403e-97e1-2403d92b57c7 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:35.402288 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 460/940] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Jul 21 03:31:35 2022] GET /identity/v3/services => generated 1497 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 03:31:35.419226 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712cb28-beb6-43d3-b96e-59ed35cf4673 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:35.435598 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:35.459420 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fef3656-74f3-46cd-8b50-b65c6ab380ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:35.460097 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef3656-74f3-46cd-8b50-b65c6ab380ec None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:35.460388 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef3656-74f3-46cd-8b50-b65c6ab380ec None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:35.460668 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fef3656-74f3-46cd-8b50-b65c6ab380ec None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:35.461391 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fef3656-74f3-46cd-8b50-b65c6ab380ec None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:35.462884 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fef3656-74f3-46cd-8b50-b65c6ab380ec None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:35.464286 dv-cinder-850318-2-smb devstack@keystone.service[80332]: WARNING keystone.server.flask.common [None req-3fef3656-74f3-46cd-8b50-b65c6ab380ec None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 21 03:31:35.486704 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.sql.core [None req-3fef3656-74f3-46cd-8b50-b65c6ab380ec None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 21 03:31:35.486704 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 21 03:31:35.486704 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [parameters: {'id': '3d1067f20228402dbd4fa84b0b27a106', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 21 03:31:35.486704 dv-cinder-850318-2-smb devstack@keystone.service[80332]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80332) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 21 03:31:35.495161 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-3fef3656-74f3-46cd-8b50-b65c6ab380ec None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3d1067f20228402dbd4fa84b0b27a106.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3d1067f20228402dbd4fa84b0b27a106. Jul 21 03:31:35.495161 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:35.495161 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 03:31:35.495161 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 03:31:35.495161 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 03:31:35.495161 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 03:31:35.495161 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 03:31:35.495161 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 03:31:35.495161 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 03:31:35.495161 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application conn.query(q) Jul 21 03:31:35.495161 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 03:31:35.495161 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 03:31:35.495161 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 03:31:35.496180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application result.read() Jul 21 03:31:35.496180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 03:31:35.496180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 03:31:35.496180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 03:31:35.496180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 03:31:35.496180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 03:31:35.496180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 03:31:35.496180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 03:31:35.496180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 03:31:35.496180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 21 03:31:35.496180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:35.496180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 21 03:31:35.496180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:35.496180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:35.496180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 21 03:31:35.496180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 21 03:31:35.496180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 21 03:31:35.496180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 21 03:31:35.497400 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 03:31:35.497400 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application next(self.gen) Jul 21 03:31:35.497400 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 21 03:31:35.497400 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application yield resource Jul 21 03:31:35.497400 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 03:31:35.497400 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application next(self.gen) Jul 21 03:31:35.497400 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 21 03:31:35.497400 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self.session.rollback() Jul 21 03:31:35.497400 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 21 03:31:35.497400 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self.force_reraise() Jul 21 03:31:35.497400 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 21 03:31:35.497400 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise self.value Jul 21 03:31:35.497400 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 21 03:31:35.497400 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 21 03:31:35.497400 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 21 03:31:35.497400 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application session.commit() Jul 21 03:31:35.497400 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 21 03:31:35.498674 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 21 03:31:35.498674 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 21 03:31:35.498674 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._prepare_impl() Jul 21 03:31:35.498674 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 21 03:31:35.498674 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self.session.flush() Jul 21 03:31:35.498674 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 21 03:31:35.498674 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._flush(objects) Jul 21 03:31:35.498674 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 21 03:31:35.498674 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 21 03:31:35.498674 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 21 03:31:35.498674 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application compat.raise_( Jul 21 03:31:35.498674 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 03:31:35.498674 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception Jul 21 03:31:35.498674 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 21 03:31:35.498674 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application flush_context.execute() Jul 21 03:31:35.498674 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 21 03:31:35.498674 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rec.execute(self) Jul 21 03:31:35.499675 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 21 03:31:35.499675 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 21 03:31:35.499675 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 21 03:31:35.499675 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 21 03:31:35.499675 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 21 03:31:35.499675 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 21 03:31:35.499675 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 21 03:31:35.499675 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 21 03:31:35.499675 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 21 03:31:35.499675 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 21 03:31:35.499675 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 21 03:31:35.499675 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 21 03:31:35.499675 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 21 03:31:35.499675 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 21 03:31:35.499675 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 21 03:31:35.500441 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 21 03:31:35.500441 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 03:31:35.500441 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception Jul 21 03:31:35.500441 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 03:31:35.500441 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 03:31:35.500441 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 03:31:35.500441 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 03:31:35.500441 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 03:31:35.500441 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 03:31:35.500441 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 03:31:35.500441 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application conn.query(q) Jul 21 03:31:35.500441 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 03:31:35.500441 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 03:31:35.500441 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 03:31:35.500441 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application result.read() Jul 21 03:31:35.500441 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 03:31:35.500441 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 03:31:35.501291 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 03:31:35.501291 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 03:31:35.501291 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 03:31:35.501291 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 03:31:35.501291 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 03:31:35.501291 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 03:31:35.501291 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 21 03:31:35.501291 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 21 03:31:35.501291 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [parameters: {'id': '3d1067f20228402dbd4fa84b0b27a106', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 21 03:31:35.501291 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 21 03:31:35.501291 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:35.501291 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 03:31:35.501291 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:35.501291 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:35.501291 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 21 03:31:35.507369 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 21 03:31:35.507369 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 21 03:31:35.507369 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 21 03:31:35.507369 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 21 03:31:35.507369 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:35.507369 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 03:31:35.507369 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:35.507369 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:35.507369 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:35.507369 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:35.507369 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:35.507369 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:35.507369 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:35.507369 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:35.507369 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:35.507369 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:35.507369 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:35.508497 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:35.508497 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 21 03:31:35.508497 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 21 03:31:35.508497 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:35.508497 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:35.508497 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 21 03:31:35.508497 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 21 03:31:35.508497 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3d1067f20228402dbd4fa84b0b27a106. Jul 21 03:31:35.508497 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:35.508497 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 481/941] 10.222.0.20 () {60 vars in 1140 bytes} [Thu Jul 21 03:31:35 2022] POST /identity/v3/projects => generated 262 bytes in 204 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:31:35.509113 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1989589-0746-403e-97e1-2403d92b57c7 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:35.595293 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:35.621879 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1989589-0746-403e-97e1-2403d92b57c7 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:35.637193 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2d202-376f-444b-839e-9ec72c7dacab None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:35.637715 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2d202-376f-444b-839e-9ec72c7dacab None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:35.638004 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2d202-376f-444b-839e-9ec72c7dacab None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:35.642343 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 482/942] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 03:31:35.648440 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326d869-2acc-496a-8f90-b54e62defa8b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:35.648725 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326d869-2acc-496a-8f90-b54e62defa8b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:35.649008 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326d869-2acc-496a-8f90-b54e62defa8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:35.659957 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f1e6f-c501-413d-a93e-7acabff18e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:35.662634 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f1e6f-c501-413d-a93e-7acabff18e5d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:35.663432 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f1e6f-c501-413d-a93e-7acabff18e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:35.663895 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f1e6f-c501-413d-a93e-7acabff18e5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:35.667106 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-0326d869-2acc-496a-8f90-b54e62defa8b None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:35.668617 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0326d869-2acc-496a-8f90-b54e62defa8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:35.672745 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276f1e6f-c501-413d-a93e-7acabff18e5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:35.674399 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276f1e6f-c501-413d-a93e-7acabff18e5d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:35.694687 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-276f1e6f-c501-413d-a93e-7acabff18e5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:31:35.694687 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:35.694687 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:35.694687 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:35.694687 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:35.694687 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:35.694687 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:35.694687 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:35.694687 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:35.694687 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:35.694687 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:35.694687 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:35.694687 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 03:31:35.694687 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 03:31:35.694687 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 03:31:35.695635 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 03:31:35.695635 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:35.695635 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:35.695635 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:35.695635 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:35.695635 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:35.695635 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:35.695635 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:35.695635 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:35.695635 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:35.695635 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:35.695635 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:35.695635 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:35.695635 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:35.695635 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:35.695635 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:35.695635 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:35.696535 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 03:31:35.696535 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 03:31:35.696535 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 03:31:35.696535 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 03:31:35.696535 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 03:31:35.696535 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 03:31:35.696535 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:31:35.696535 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:35.699420 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 461/943] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:31:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:35.704375 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f1e6f-c501-413d-a93e-7acabff18e5d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:35.755098 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 483/944] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 03:31:35.780567 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326d869-2acc-496a-8f90-b54e62defa8b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:35.826893 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f1e6f-c501-413d-a93e-7acabff18e5d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:35.862554 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d1dd9-f221-4039-9cd3-7c8bed22e493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:35.863455 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d1dd9-f221-4039-9cd3-7c8bed22e493 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:35.863978 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d1dd9-f221-4039-9cd3-7c8bed22e493 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:35.864439 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d1dd9-f221-4039-9cd3-7c8bed22e493 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:35.865474 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d1dd9-f221-4039-9cd3-7c8bed22e493 None admin] RBAC: Adding query filter params (name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:35.866149 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d1dd9-f221-4039-9cd3-7c8bed22e493 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:35.867975 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d1dd9-f221-4039-9cd3-7c8bed22e493 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:35.869893 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:35.889217 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:35.891446 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 462/945] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jul 21 03:31:35 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:31:35.892280 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326d869-2acc-496a-8f90-b54e62defa8b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:35.933638 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f27690-116c-4c28-b7e1-83626bca3d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:35.934499 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f27690-116c-4c28-b7e1-83626bca3d23 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:35.934783 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f27690-116c-4c28-b7e1-83626bca3d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:35.935055 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f27690-116c-4c28-b7e1-83626bca3d23 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:35.947813 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f27690-116c-4c28-b7e1-83626bca3d23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:31:35.956358 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-e9f27690-116c-4c28-b7e1-83626bca3d23 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 03:31:35.956358 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:35.956358 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:35.956358 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:35.956358 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:35.956358 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:35.956358 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:35.956358 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:35.956358 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:35.956358 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:35.956358 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:35.956358 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:35.956358 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:31:35.956358 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:31:35.956358 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:31:35.956358 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:31:35.957359 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:31:35.957359 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:31:35.957359 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:31:35.957359 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:31:35.957359 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:35.957359 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:35.957359 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:35.957359 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:35.957359 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:35.957359 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:35.957359 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:35.957359 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:35.957359 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:35.957359 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:35.957359 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:35.957359 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:35.958753 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:35.958753 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:35.958753 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:35.958753 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:35.958753 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:31:35.958753 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:31:35.958753 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:31:35.958753 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:31:35.958753 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:31:35.958753 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:31:35.958753 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 03:31:35.958753 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:35.958753 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 484/946] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Jul 21 03:31:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:31:35.964692 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d1dd9-f221-4039-9cd3-7c8bed22e493 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:36.079387 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d1dd9-f221-4039-9cd3-7c8bed22e493 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:36.115600 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43876f10-a3eb-4cd3-aa48-d8504e98a49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:36.116209 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43876f10-a3eb-4cd3-aa48-d8504e98a49c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:36.116490 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43876f10-a3eb-4cd3-aa48-d8504e98a49c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:36.116761 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43876f10-a3eb-4cd3-aa48-d8504e98a49c None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:36.117509 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43876f10-a3eb-4cd3-aa48-d8504e98a49c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:36.117811 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43876f10-a3eb-4cd3-aa48-d8504e98a49c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:36.119212 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43876f10-a3eb-4cd3-aa48-d8504e98a49c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:36.127936 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 463/947] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Jul 21 03:31:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:36.134051 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f27690-116c-4c28-b7e1-83626bca3d23 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:36.146133 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7177a8-46c0-4d36-9f7b-6a250a1993be None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:36.146495 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7177a8-46c0-4d36-9f7b-6a250a1993be None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:36.146766 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7177a8-46c0-4d36-9f7b-6a250a1993be None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:36.148627 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 464/948] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 03:31:36.153606 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0e15f-2a40-49a3-b16f-fac0f2f96967 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:36.155210 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0e15f-2a40-49a3-b16f-fac0f2f96967 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:36.155210 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0e15f-2a40-49a3-b16f-fac0f2f96967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:36.172890 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-3ec0e15f-2a40-49a3-b16f-fac0f2f96967 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:36.174232 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3ec0e15f-2a40-49a3-b16f-fac0f2f96967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:36.226882 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:36.244813 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 465/949] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 03:31:36.260869 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f27690-116c-4c28-b7e1-83626bca3d23 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:36.269436 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec0e15f-2a40-49a3-b16f-fac0f2f96967 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:36.308660 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c6ac68-1fab-4e0b-87fe-6adeb719e2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:36.309759 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6ac68-1fab-4e0b-87fe-6adeb719e2b1 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:36.310243 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6ac68-1fab-4e0b-87fe-6adeb719e2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:36.310733 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c6ac68-1fab-4e0b-87fe-6adeb719e2b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:36.325467 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c6ac68-1fab-4e0b-87fe-6adeb719e2b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:36.327949 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c6ac68-1fab-4e0b-87fe-6adeb719e2b1 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:36.350213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-c4c6ac68-1fab-4e0b-87fe-6adeb719e2b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:36.350213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:36.350213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:36.350213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:36.350213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:36.350213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:36.350213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:36.350213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:36.350213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:36.350213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:36.350213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:36.350213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:36.350213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:31:36.350213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:31:36.350213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:31:36.351333 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:31:36.351333 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:36.351333 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:36.351333 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:36.351333 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:36.351333 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:36.351333 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:36.351333 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:36.351333 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:36.351333 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:36.351333 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:36.351333 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:36.351333 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:36.351333 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:36.351333 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:36.351333 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:36.351333 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:36.352424 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:31:36.352424 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:31:36.352424 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:36.352424 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:36.354969 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 485/950] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:36.359830 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c6ac68-1fab-4e0b-87fe-6adeb719e2b1 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:36.376330 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:36.386707 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec0e15f-2a40-49a3-b16f-fac0f2f96967 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:36.433416 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae16515-0b47-4d00-8572-d92c5b066bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:36.434991 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae16515-0b47-4d00-8572-d92c5b066bc5 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:36.435654 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae16515-0b47-4d00-8572-d92c5b066bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:36.436127 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae16515-0b47-4d00-8572-d92c5b066bc5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:36.437812 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae16515-0b47-4d00-8572-d92c5b066bc5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:36.439507 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae16515-0b47-4d00-8572-d92c5b066bc5 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:36.457049 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-cae16515-0b47-4d00-8572-d92c5b066bc5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 03:31:36.457049 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:36.457049 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 03:31:36.457049 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 03:31:36.457049 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 03:31:36.457049 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 03:31:36.457049 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 03:31:36.457049 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:31:36.457049 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 03:31:36.457049 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:36.457049 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 03:31:36.457049 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:36.457049 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:36.457049 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:36.457049 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:36.457049 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:36.458052 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:36.458052 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:36.458052 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:36.458052 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:36.458052 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:36.458052 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:36.458052 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:36.458052 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 03:31:36.458052 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 03:31:36.458052 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 03:31:36.458052 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 03:31:36.458052 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:36.458052 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:36.458052 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:36.458052 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:36.458052 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:36.458952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:36.458952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:36.458952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:36.458952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:36.458952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:36.458952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:36.458952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:36.458952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:36.458952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:36.458952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:36.458952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:36.458952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 03:31:36.458952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:31:36.458952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 03:31:36.458952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:36.462835 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 466/951] 10.222.0.20 () {56 vars in 1132 bytes} [Thu Jul 21 03:31:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:36.465093 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae16515-0b47-4d00-8572-d92c5b066bc5 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:36.480229 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c6ac68-1fab-4e0b-87fe-6adeb719e2b1 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:36.519092 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40691976-1823-4ea2-a372-40887e5ee1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:36.519953 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40691976-1823-4ea2-a372-40887e5ee1be None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:36.520119 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40691976-1823-4ea2-a372-40887e5ee1be None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:36.520516 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40691976-1823-4ea2-a372-40887e5ee1be None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:36.521347 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40691976-1823-4ea2-a372-40887e5ee1be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:36.521732 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40691976-1823-4ea2-a372-40887e5ee1be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:36.523467 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40691976-1823-4ea2-a372-40887e5ee1be None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:36.530593 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:36.542484 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 486/952] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:31:36.543595 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40691976-1823-4ea2-a372-40887e5ee1be None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:36.592341 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae16515-0b47-4d00-8572-d92c5b066bc5 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:36.623641 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:36.632884 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd575a6-21ab-4bca-b744-580d8ba67b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:36.634196 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd575a6-21ab-4bca-b744-580d8ba67b1b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:36.634670 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd575a6-21ab-4bca-b744-580d8ba67b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:36.635130 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd575a6-21ab-4bca-b744-580d8ba67b1b None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:36.636141 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd575a6-21ab-4bca-b744-580d8ba67b1b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:36.636604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd575a6-21ab-4bca-b744-580d8ba67b1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:36.638240 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd575a6-21ab-4bca-b744-580d8ba67b1b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:36.644270 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 467/953] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Jul 21 03:31:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:31:36.650495 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd575a6-21ab-4bca-b744-580d8ba67b1b None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:36.665238 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40691976-1823-4ea2-a372-40887e5ee1be None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:36.705753 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d79e05-11f1-4cae-bd97-7ecaa290276d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:36.706965 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d79e05-11f1-4cae-bd97-7ecaa290276d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:36.707489 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d79e05-11f1-4cae-bd97-7ecaa290276d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:36.710976 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d79e05-11f1-4cae-bd97-7ecaa290276d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:36.719805 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d79e05-11f1-4cae-bd97-7ecaa290276d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:36.721655 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d79e05-11f1-4cae-bd97-7ecaa290276d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:36.738702 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-c8d79e05-11f1-4cae-bd97-7ecaa290276d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 03:31:36.738702 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:36.738702 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:36.738702 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:36.738702 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:36.738702 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:36.738702 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:36.738702 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:36.738702 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:36.738702 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:36.738702 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:36.738702 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:36.738702 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 03:31:36.738702 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 03:31:36.738702 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 03:31:36.738702 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 03:31:36.739782 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:36.739782 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:36.739782 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 03:31:36.739782 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:31:36.739782 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 03:31:36.739782 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:31:36.739782 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:36.739782 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:36.739782 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:36.739782 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:36.739782 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:36.739782 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:36.739782 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:36.739782 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:36.739782 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:36.739782 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:36.739782 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:36.739782 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:36.741308 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:36.741308 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:36.741308 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 03:31:36.741308 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 03:31:36.741308 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 03:31:36.741308 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 03:31:36.741308 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 03:31:36.741308 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 03:31:36.741308 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 03:31:36.741308 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:36.743765 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 487/954] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Jul 21 03:31:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:36.754506 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d79e05-11f1-4cae-bd97-7ecaa290276d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:36.772515 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd575a6-21ab-4bca-b744-580d8ba67b1b None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:36.789646 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:36.815264 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea742a6-ec7a-4db7-ab0f-af7e66532aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:36.815933 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea742a6-ec7a-4db7-ab0f-af7e66532aba None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:36.816216 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea742a6-ec7a-4db7-ab0f-af7e66532aba None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:36.816572 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea742a6-ec7a-4db7-ab0f-af7e66532aba None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:36.817190 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea742a6-ec7a-4db7-ab0f-af7e66532aba None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:36.817495 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea742a6-ec7a-4db7-ab0f-af7e66532aba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:36.819132 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea742a6-ec7a-4db7-ab0f-af7e66532aba None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:36.824421 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 468/955] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Jul 21 03:31:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:31:36.829730 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea742a6-ec7a-4db7-ab0f-af7e66532aba None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:36.853457 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d79e05-11f1-4cae-bd97-7ecaa290276d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:36.884095 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:36.889268 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac1d2d-a26a-473b-8977-172363b3b6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:36.890106 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac1d2d-a26a-473b-8977-172363b3b6ff None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:36.890726 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac1d2d-a26a-473b-8977-172363b3b6ff None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:36.891205 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cac1d2d-a26a-473b-8977-172363b3b6ff None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:36.892203 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac1d2d-a26a-473b-8977-172363b3b6ff None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:36.892681 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac1d2d-a26a-473b-8977-172363b3b6ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:36.894342 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cac1d2d-a26a-473b-8977-172363b3b6ff None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:36.917958 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 488/956] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Jul 21 03:31:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:36.919521 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac1d2d-a26a-473b-8977-172363b3b6ff None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:36.946297 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea742a6-ec7a-4db7-ab0f-af7e66532aba None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:36.984093 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a05054-9e6d-46ea-8d97-8f5c19fdfd1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:36.984790 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a05054-9e6d-46ea-8d97-8f5c19fdfd1a None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:36.985079 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a05054-9e6d-46ea-8d97-8f5c19fdfd1a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:36.985383 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a05054-9e6d-46ea-8d97-8f5c19fdfd1a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:36.986115 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a05054-9e6d-46ea-8d97-8f5c19fdfd1a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:36.987535 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a05054-9e6d-46ea-8d97-8f5c19fdfd1a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:37.018802 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 469/957] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Jul 21 03:31:36 2022] POST /identity/v3/endpoints => generated 347 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:31:37.025167 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cac1d2d-a26a-473b-8977-172363b3b6ff None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:37.071104 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5742a1b-cf5f-42e2-910e-a9f1ab41bed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:37.072166 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5742a1b-cf5f-42e2-910e-a9f1ab41bed3 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:37.072683 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5742a1b-cf5f-42e2-910e-a9f1ab41bed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:37.073189 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5742a1b-cf5f-42e2-910e-a9f1ab41bed3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:37.141936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:37.153731 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5742a1b-cf5f-42e2-910e-a9f1ab41bed3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:37.155782 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5742a1b-cf5f-42e2-910e-a9f1ab41bed3 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:37.264312 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 489/958] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:31:36 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 03:31:37.269906 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a05054-9e6d-46ea-8d97-8f5c19fdfd1a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:37.307189 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:37.376204 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a05054-9e6d-46ea-8d97-8f5c19fdfd1a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:37.412568 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73334d65-cc62-45b6-9df0-42a89c9ebb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:37.413747 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73334d65-cc62-45b6-9df0-42a89c9ebb60 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:37.414236 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73334d65-cc62-45b6-9df0-42a89c9ebb60 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:37.414738 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73334d65-cc62-45b6-9df0-42a89c9ebb60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:37.425678 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73334d65-cc62-45b6-9df0-42a89c9ebb60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:37.427479 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73334d65-cc62-45b6-9df0-42a89c9ebb60 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:37.446240 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-73334d65-cc62-45b6-9df0-42a89c9ebb60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:37.446240 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:37.446240 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:37.446240 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:37.446240 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:37.446240 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:37.446240 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:37.446240 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:37.446240 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:37.446240 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:37.446240 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:37.446240 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:37.446240 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:31:37.446240 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:31:37.446240 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:31:37.447236 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:31:37.447236 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:37.447236 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:37.447236 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:37.447236 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:37.447236 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:37.447236 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:37.447236 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:37.447236 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:37.447236 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:37.447236 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:37.447236 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:37.447236 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:37.447236 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:37.447236 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:37.447236 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:37.447236 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:37.448136 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:31:37.448136 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:31:37.448136 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:37.448136 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:37.450397 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 470/959] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:37.462711 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5742a1b-cf5f-42e2-910e-a9f1ab41bed3 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:37.554946 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:37.573065 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5742a1b-cf5f-42e2-910e-a9f1ab41bed3 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:37.575813 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378939a-6d9a-4fd5-b28d-cf3465baab9a None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:37.576104 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378939a-6d9a-4fd5-b28d-cf3465baab9a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:37.576385 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c378939a-6d9a-4fd5-b28d-cf3465baab9a None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:37.578026 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 471/960] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:31:37.583117 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2fe7e-33b1-46c8-9332-56198af56888 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:37.583815 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2fe7e-33b1-46c8-9332-56198af56888 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:37.584701 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba2fe7e-33b1-46c8-9332-56198af56888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:37.604213 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-eba2fe7e-33b1-46c8-9332-56198af56888 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:37.606149 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-eba2fe7e-33b1-46c8-9332-56198af56888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:37.609922 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe78b3-3a7c-40e5-b235-69056a46b539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:37.610851 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe78b3-3a7c-40e5-b235-69056a46b539 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:37.611318 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe78b3-3a7c-40e5-b235-69056a46b539 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:37.611789 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe78b3-3a7c-40e5-b235-69056a46b539 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:37.612691 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe78b3-3a7c-40e5-b235-69056a46b539 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:37.613189 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe78b3-3a7c-40e5-b235-69056a46b539 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:37.614760 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe78b3-3a7c-40e5-b235-69056a46b539 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:37.632130 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 490/961] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:31:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:37.634435 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe78b3-3a7c-40e5-b235-69056a46b539 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:37.692491 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 472/962] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 03:31:37.716295 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2fe7e-33b1-46c8-9332-56198af56888 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:37.737538 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:37.774362 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe78b3-3a7c-40e5-b235-69056a46b539 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:37.816235 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5e8d3-bd59-4c76-a052-3dbde0937b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:37.817337 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5e8d3-bd59-4c76-a052-3dbde0937b1a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:37.817800 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5e8d3-bd59-4c76-a052-3dbde0937b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:37.819046 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5e8d3-bd59-4c76-a052-3dbde0937b1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:37.829258 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b5e8d3-bd59-4c76-a052-3dbde0937b1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:37.831748 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b5e8d3-bd59-4c76-a052-3dbde0937b1a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:37.848616 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba2fe7e-33b1-46c8-9332-56198af56888 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:37.853380 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-c7b5e8d3-bd59-4c76-a052-3dbde0937b1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:31:37.853380 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:37.853380 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:37.853380 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:37.853380 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:37.853380 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:37.853380 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:37.853380 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:37.853380 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:37.853380 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:37.853380 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:37.853380 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:37.853380 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 03:31:37.853380 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 03:31:37.853380 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 03:31:37.854247 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 03:31:37.854247 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:37.854247 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:37.854247 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:37.854247 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:37.854247 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:37.854247 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:37.854247 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:37.854247 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:37.854247 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:37.854247 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:37.854247 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:37.854247 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:37.854247 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:37.854247 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:37.854247 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:37.854247 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:37.855188 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 03:31:37.855188 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 03:31:37.855188 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 03:31:37.855188 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 03:31:37.855188 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 03:31:37.855188 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 03:31:37.855188 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:31:37.855188 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:37.858277 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 491/963] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:31:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:37.864162 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5e8d3-bd59-4c76-a052-3dbde0937b1a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:37.875475 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:37.896972 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89db3a-9b65-4a25-89d2-010fc94b372a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:37.898597 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89db3a-9b65-4a25-89d2-010fc94b372a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:37.899250 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89db3a-9b65-4a25-89d2-010fc94b372a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:37.900036 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89db3a-9b65-4a25-89d2-010fc94b372a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:37.901233 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a89db3a-9b65-4a25-89d2-010fc94b372a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:37.903016 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a89db3a-9b65-4a25-89d2-010fc94b372a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:37.918289 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-4a89db3a-9b65-4a25-89d2-010fc94b372a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 03:31:37.918289 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:37.918289 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 03:31:37.918289 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 03:31:37.918289 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 03:31:37.918289 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 03:31:37.918289 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 03:31:37.918289 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:31:37.918289 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 03:31:37.918289 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:37.918289 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 03:31:37.918289 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:37.918289 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:37.918289 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:37.918289 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:37.918289 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:37.918289 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:37.919512 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:37.919512 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:37.919512 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:37.919512 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:37.919512 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:37.919512 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:37.919512 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 03:31:37.919512 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 03:31:37.919512 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 03:31:37.919512 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 03:31:37.919512 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:37.919512 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:37.919512 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:37.919512 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:37.919512 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:37.919512 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:37.920339 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:37.920339 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:37.920339 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:37.920339 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:37.920339 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:37.920339 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:37.920339 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:37.920339 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:37.920339 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:37.920339 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:37.920339 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 03:31:37.920339 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:31:37.920339 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 03:31:37.920339 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:37.923159 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 473/964] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Jul 21 03:31:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:31:37.929332 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89db3a-9b65-4a25-89d2-010fc94b372a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:37.988840 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5e8d3-bd59-4c76-a052-3dbde0937b1a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:38.028524 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7e95c-3a52-4a15-b105-9875cbe8e961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:38.029570 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7e95c-3a52-4a15-b105-9875cbe8e961 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:38.030157 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7e95c-3a52-4a15-b105-9875cbe8e961 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:38.030669 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e7e95c-3a52-4a15-b105-9875cbe8e961 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:38.031784 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e7e95c-3a52-4a15-b105-9875cbe8e961 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:38.032311 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e7e95c-3a52-4a15-b105-9875cbe8e961 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:38.034229 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:38.034714 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e7e95c-3a52-4a15-b105-9875cbe8e961 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:38.055265 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 492/965] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 03:31:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:31:38.055763 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89db3a-9b65-4a25-89d2-010fc94b372a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:38.056715 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7e95c-3a52-4a15-b105-9875cbe8e961 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:38.091355 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82765917-4290-4f78-8916-73a40e096cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:38.092024 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82765917-4290-4f78-8916-73a40e096cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:38.092303 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82765917-4290-4f78-8916-73a40e096cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:38.092583 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82765917-4290-4f78-8916-73a40e096cc0 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:38.094017 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82765917-4290-4f78-8916-73a40e096cc0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:38.094017 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82765917-4290-4f78-8916-73a40e096cc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:38.095095 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82765917-4290-4f78-8916-73a40e096cc0 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:38.100617 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 474/966] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Jul 21 03:31:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:31:38.101715 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287fe651-45f3-4442-a999-4064d7097f50 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:38.102004 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287fe651-45f3-4442-a999-4064d7097f50 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:38.102280 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287fe651-45f3-4442-a999-4064d7097f50 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:38.107561 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 475/967] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:31:38.107561 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287fe651-45f3-4442-a999-4064d7097f50 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:38.131919 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:38.169988 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e7e95c-3a52-4a15-b105-9875cbe8e961 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:38.204732 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109a673d-af4e-44c4-a98b-6ed47e4cb09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:38.205304 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a673d-af4e-44c4-a98b-6ed47e4cb09e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:38.205587 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a673d-af4e-44c4-a98b-6ed47e4cb09e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:38.205857 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109a673d-af4e-44c4-a98b-6ed47e4cb09e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:38.206717 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a673d-af4e-44c4-a98b-6ed47e4cb09e None admin] RBAC: Adding query filter params (role.id=b6ab65019dfc4679a967f9b3f4a6ffde, scope.project.id=0432303daa8b4304a8e07032d6a80781, user.id=73fad109df9f449e8ac5f38749c01ace) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:38.207288 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a673d-af4e-44c4-a98b-6ed47e4cb09e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:38.208432 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109a673d-af4e-44c4-a98b-6ed47e4cb09e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:38.222494 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 493/968] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:31:38 2022] GET /identity/v3/role_assignments?user.id=73fad109df9f449e8ac5f38749c01ace&scope.project.id=0432303daa8b4304a8e07032d6a80781&role.id=b6ab65019dfc4679a967f9b3f4a6ffde => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:38.222494 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f906b-2c1e-4bdf-b1f3-4b1d4e048e63 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:38.222494 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f906b-2c1e-4bdf-b1f3-4b1d4e048e63 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:38.222494 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f906b-2c1e-4bdf-b1f3-4b1d4e048e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:38.230311 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287fe651-45f3-4442-a999-4064d7097f50 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:38.235452 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-469f906b-2c1e-4bdf-b1f3-4b1d4e048e63 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:38.236719 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-469f906b-2c1e-4bdf-b1f3-4b1d4e048e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:38.275453 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828b824-6ddc-4cf3-a07a-096854cfd18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:38.276167 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828b824-6ddc-4cf3-a07a-096854cfd18f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:38.276454 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828b824-6ddc-4cf3-a07a-096854cfd18f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:38.276729 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828b824-6ddc-4cf3-a07a-096854cfd18f None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:38.277518 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9828b824-6ddc-4cf3-a07a-096854cfd18f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:38.277830 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9828b824-6ddc-4cf3-a07a-096854cfd18f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:38.279290 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9828b824-6ddc-4cf3-a07a-096854cfd18f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:38.285642 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 476/969] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Jul 21 03:31:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:31:38.291593 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828b824-6ddc-4cf3-a07a-096854cfd18f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:38.310882 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:38.332226 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 494/970] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 03:31:38.358869 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f906b-2c1e-4bdf-b1f3-4b1d4e048e63 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:38.411899 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828b824-6ddc-4cf3-a07a-096854cfd18f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:38.434772 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:38.462155 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133b9a5-a520-403d-ae51-439ddccd6791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:38.463147 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133b9a5-a520-403d-ae51-439ddccd6791 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:38.463437 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133b9a5-a520-403d-ae51-439ddccd6791 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:38.463718 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133b9a5-a520-403d-ae51-439ddccd6791 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:38.464684 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e133b9a5-a520-403d-ae51-439ddccd6791 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:38.466069 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e133b9a5-a520-403d-ae51-439ddccd6791 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:38.484673 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f906b-2c1e-4bdf-b1f3-4b1d4e048e63 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:38.492374 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 477/971] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Jul 21 03:31:38 2022] POST /identity/v3/endpoints => generated 349 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:31:38.535444 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08381e94-8226-4214-8b8e-f64498f959be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:38.536534 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08381e94-8226-4214-8b8e-f64498f959be None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:38.537578 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08381e94-8226-4214-8b8e-f64498f959be None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:38.538138 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08381e94-8226-4214-8b8e-f64498f959be None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:38.539129 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08381e94-8226-4214-8b8e-f64498f959be None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:38.540940 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08381e94-8226-4214-8b8e-f64498f959be None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:38.557057 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.sql.core [None req-08381e94-8226-4214-8b8e-f64498f959be None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 21 03:31:38.557057 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 21 03:31:38.557057 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [parameters: {'user_id': '313b3cd4beff455d9485735ce18e7df4', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 21 03:31:38.557057 dv-cinder-850318-2-smb devstack@keystone.service[80332]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80332) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 21 03:31:38.566128 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-08381e94-8226-4214-8b8e-f64498f959be None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 21 03:31:38.566128 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:38.566128 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 03:31:38.566128 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 03:31:38.566128 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 03:31:38.566128 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 03:31:38.566128 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 03:31:38.566128 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 03:31:38.566128 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 03:31:38.566128 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application conn.query(q) Jul 21 03:31:38.566128 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 03:31:38.566128 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 03:31:38.566128 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 03:31:38.566128 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application result.read() Jul 21 03:31:38.566128 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 03:31:38.567143 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 03:31:38.567143 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 03:31:38.567143 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 03:31:38.567143 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 03:31:38.567143 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 03:31:38.567143 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 03:31:38.567143 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 03:31:38.567143 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 21 03:31:38.567143 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:38.567143 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 21 03:31:38.567143 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:38.567143 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:38.567143 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 21 03:31:38.567143 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 21 03:31:38.567143 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 21 03:31:38.567143 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 21 03:31:38.567143 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 03:31:38.567143 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application next(self.gen) Jul 21 03:31:38.568203 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 21 03:31:38.568203 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application yield resource Jul 21 03:31:38.568203 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 03:31:38.568203 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application next(self.gen) Jul 21 03:31:38.568203 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 21 03:31:38.568203 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self.session.rollback() Jul 21 03:31:38.568203 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 21 03:31:38.568203 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self.force_reraise() Jul 21 03:31:38.568203 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 21 03:31:38.568203 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise self.value Jul 21 03:31:38.568203 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 21 03:31:38.568203 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 21 03:31:38.568203 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 21 03:31:38.568203 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application session.commit() Jul 21 03:31:38.568203 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 21 03:31:38.568203 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 21 03:31:38.568203 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 21 03:31:38.569107 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._prepare_impl() Jul 21 03:31:38.569107 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 21 03:31:38.569107 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self.session.flush() Jul 21 03:31:38.569107 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 21 03:31:38.569107 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._flush(objects) Jul 21 03:31:38.569107 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 21 03:31:38.569107 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 21 03:31:38.569107 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 21 03:31:38.569107 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application compat.raise_( Jul 21 03:31:38.569107 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 03:31:38.569107 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception Jul 21 03:31:38.569107 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 21 03:31:38.569107 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application flush_context.execute() Jul 21 03:31:38.569107 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 21 03:31:38.569107 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rec.execute(self) Jul 21 03:31:38.569107 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 21 03:31:38.569107 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 21 03:31:38.570708 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 21 03:31:38.570708 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 21 03:31:38.570708 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 21 03:31:38.570708 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 21 03:31:38.570708 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 21 03:31:38.570708 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 21 03:31:38.570708 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 21 03:31:38.570708 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 21 03:31:38.570708 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 21 03:31:38.570708 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 21 03:31:38.570708 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 21 03:31:38.570708 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 21 03:31:38.570708 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 21 03:31:38.570708 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 21 03:31:38.570708 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 03:31:38.570708 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception Jul 21 03:31:38.572907 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 03:31:38.572907 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 03:31:38.572907 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 03:31:38.572907 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 03:31:38.572907 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 03:31:38.572907 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 03:31:38.572907 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 03:31:38.572907 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application conn.query(q) Jul 21 03:31:38.572907 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 03:31:38.572907 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 03:31:38.572907 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 03:31:38.572907 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application result.read() Jul 21 03:31:38.572907 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 03:31:38.572907 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 03:31:38.572907 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 03:31:38.572907 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 03:31:38.574936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 03:31:38.574936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 03:31:38.574936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 03:31:38.574936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 03:31:38.574936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 21 03:31:38.574936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 21 03:31:38.574936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [parameters: {'user_id': '313b3cd4beff455d9485735ce18e7df4', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 21 03:31:38.574936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 21 03:31:38.574936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:38.574936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 03:31:38.574936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:38.574936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:38.574936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:38.574936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:38.574936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:38.576800 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:38.576800 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:38.576800 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:38.576800 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:38.576800 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:38.576800 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:38.576800 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:38.576800 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 21 03:31:38.576800 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 21 03:31:38.576800 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:38.576800 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:38.576800 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 03:31:38.576800 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:31:38.576800 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 03:31:38.576800 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:31:38.576800 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 21 03:31:38.576800 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 21 03:31:38.579031 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 21 03:31:38.579031 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 21 03:31:38.579031 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 21 03:31:38.579031 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 21 03:31:38.579031 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 21 03:31:38.579031 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:38.579031 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 495/972] 10.222.0.20 () {60 vars in 1131 bytes} [Thu Jul 21 03:31:38 2022] POST /identity/v3/users => generated 160 bytes in 218 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:31:38.583081 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133b9a5-a520-403d-ae51-439ddccd6791 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:38.661884 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:38.704935 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e133b9a5-a520-403d-ae51-439ddccd6791 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:38.747366 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fcee2f-efa5-4a1d-9a0f-0846b0986484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:38.748322 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcee2f-efa5-4a1d-9a0f-0846b0986484 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:38.748710 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcee2f-efa5-4a1d-9a0f-0846b0986484 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:38.749154 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcee2f-efa5-4a1d-9a0f-0846b0986484 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:38.757781 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fcee2f-efa5-4a1d-9a0f-0846b0986484 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:38.759273 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fcee2f-efa5-4a1d-9a0f-0846b0986484 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:38.774920 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-c3fcee2f-efa5-4a1d-9a0f-0846b0986484 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 03:31:38.774920 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:38.774920 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:38.774920 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:38.774920 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:38.774920 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:38.774920 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:38.774920 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:38.774920 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:38.774920 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:38.774920 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:38.774920 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:38.774920 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 03:31:38.774920 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 03:31:38.774920 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 03:31:38.774920 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 03:31:38.775900 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:38.775900 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:38.775900 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 03:31:38.775900 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:31:38.775900 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 03:31:38.775900 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:31:38.775900 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:38.775900 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:38.775900 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:38.775900 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:38.775900 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:38.775900 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:38.775900 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:38.775900 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:38.775900 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:38.775900 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:38.775900 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:38.775900 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:38.777082 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:38.777082 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:38.777082 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 03:31:38.777082 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 03:31:38.777082 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 03:31:38.777082 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 03:31:38.777082 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 03:31:38.777082 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 03:31:38.777082 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 03:31:38.777082 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:38.777082 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 478/973] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:31:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:38.784197 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08381e94-8226-4214-8b8e-f64498f959be None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:38.892820 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08381e94-8226-4214-8b8e-f64498f959be None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:38.911750 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:38.929157 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6bc1fd-f063-442a-8a78-3eba596e54ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:38.930328 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6bc1fd-f063-442a-8a78-3eba596e54ca None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:38.931052 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6bc1fd-f063-442a-8a78-3eba596e54ca None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:38.931506 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6bc1fd-f063-442a-8a78-3eba596e54ca None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:38.932384 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6bc1fd-f063-442a-8a78-3eba596e54ca None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:38.932704 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6bc1fd-f063-442a-8a78-3eba596e54ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:38.934374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6bc1fd-f063-442a-8a78-3eba596e54ca None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:38.982613 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 496/974] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jul 21 03:31:38 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:39.182271 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7bc32-03ac-434d-bac7-befcd2d7e675 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:39.182604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7bc32-03ac-434d-bac7-befcd2d7e675 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:39.182994 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed7bc32-03ac-434d-bac7-befcd2d7e675 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:39.184741 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 479/975] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:31:39.189988 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edcbbb2-b0de-499e-b1e8-f3ada784fa51 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:39.190486 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edcbbb2-b0de-499e-b1e8-f3ada784fa51 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:39.190918 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edcbbb2-b0de-499e-b1e8-f3ada784fa51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:39.209605 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-2edcbbb2-b0de-499e-b1e8-f3ada784fa51 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:39.211383 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2edcbbb2-b0de-499e-b1e8-f3ada784fa51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:39.283880 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 497/976] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 03:31:39.306380 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7bc32-03ac-434d-bac7-befcd2d7e675 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:39.408942 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed7bc32-03ac-434d-bac7-befcd2d7e675 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:39.432197 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:39.445410 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb713192-40d2-43a4-9008-32f4298dfe56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:39.446248 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb713192-40d2-43a4-9008-32f4298dfe56 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:39.446656 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb713192-40d2-43a4-9008-32f4298dfe56 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:39.447007 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb713192-40d2-43a4-9008-32f4298dfe56 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:39.447769 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb713192-40d2-43a4-9008-32f4298dfe56 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:39.449273 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb713192-40d2-43a4-9008-32f4298dfe56 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:39.462100 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-cb713192-40d2-43a4-9008-32f4298dfe56 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 03:31:39.462100 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:39.462100 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 03:31:39.462100 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 03:31:39.462100 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 03:31:39.462100 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 03:31:39.462100 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 03:31:39.462100 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:31:39.462100 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 03:31:39.462100 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:39.462100 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 03:31:39.462100 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:39.462100 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:39.462100 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:39.462100 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:39.462100 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:39.462100 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:39.463373 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:39.463373 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:39.463373 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:39.463373 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:39.463373 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:39.463373 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:39.463373 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 03:31:39.463373 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 03:31:39.463373 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 03:31:39.463373 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 03:31:39.463373 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:39.463373 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:39.463373 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:39.463373 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:39.463373 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:39.463373 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:39.464428 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:39.464428 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:39.464428 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:39.464428 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:39.464428 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:39.464428 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:39.464428 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:39.464428 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:39.464428 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:39.464428 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:39.464428 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 03:31:39.464428 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:31:39.464428 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 03:31:39.464428 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:39.466616 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 480/977] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:31:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:39.470945 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edcbbb2-b0de-499e-b1e8-f3ada784fa51 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:39.569863 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edcbbb2-b0de-499e-b1e8-f3ada784fa51 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:39.577063 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:39.604870 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbb69c3-8e78-486a-8fe8-9e6e12ceb23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:39.605539 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb69c3-8e78-486a-8fe8-9e6e12ceb23d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:39.605828 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb69c3-8e78-486a-8fe8-9e6e12ceb23d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:39.606111 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbb69c3-8e78-486a-8fe8-9e6e12ceb23d None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:39.606845 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb69c3-8e78-486a-8fe8-9e6e12ceb23d None admin] RBAC: Adding query filter params (name=compute) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:39.607158 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb69c3-8e78-486a-8fe8-9e6e12ceb23d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:39.608516 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbb69c3-8e78-486a-8fe8-9e6e12ceb23d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:39.613420 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 498/978] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jul 21 03:31:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:31:39.619425 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb713192-40d2-43a4-9008-32f4298dfe56 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:39.727158 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb713192-40d2-43a4-9008-32f4298dfe56 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:39.761272 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f781a58e-2d99-4d2a-ba8a-f45f2890b740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:39.761937 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781a58e-2d99-4d2a-ba8a-f45f2890b740 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:39.762223 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781a58e-2d99-4d2a-ba8a-f45f2890b740 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:39.762527 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f781a58e-2d99-4d2a-ba8a-f45f2890b740 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:39.763242 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f781a58e-2d99-4d2a-ba8a-f45f2890b740 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:39.763550 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f781a58e-2d99-4d2a-ba8a-f45f2890b740 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:39.764932 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f781a58e-2d99-4d2a-ba8a-f45f2890b740 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:39.770623 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 481/979] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jul 21 03:31:39 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:40.388757 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad5648-6c6b-4c42-a0f4-989932728567 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:40.390486 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad5648-6c6b-4c42-a0f4-989932728567 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:40.390486 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad5648-6c6b-4c42-a0f4-989932728567 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:40.391864 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 499/980] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:31:40.397033 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba2602-15b0-451a-86c3-8fde16576d2e None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:40.397593 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba2602-15b0-451a-86c3-8fde16576d2e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:40.397877 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba2602-15b0-451a-86c3-8fde16576d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:40.414502 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-4bba2602-15b0-451a-86c3-8fde16576d2e None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:40.415689 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4bba2602-15b0-451a-86c3-8fde16576d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:40.465714 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:40.486969 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 482/981] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 03:31:40.509614 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad5648-6c6b-4c42-a0f4-989932728567 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:40.608500 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ad5648-6c6b-4c42-a0f4-989932728567 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:40.641374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de3522-753f-4bfa-8553-9dc309523e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:40.642087 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de3522-753f-4bfa-8553-9dc309523e7e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:40.642372 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de3522-753f-4bfa-8553-9dc309523e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:40.642569 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee976f-3f21-4d55-81ba-ca8be9b0eff5 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:40.642675 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de3522-753f-4bfa-8553-9dc309523e7e None admin] PATH_INFO: `/v3/services/image` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:40.642831 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee976f-3f21-4d55-81ba-ca8be9b0eff5 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:40.643117 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee976f-3f21-4d55-81ba-ca8be9b0eff5 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:40.643381 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de3522-753f-4bfa-8553-9dc309523e7e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:40.644611 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 483/982] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:31:40.644820 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de3522-753f-4bfa-8553-9dc309523e7e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:40.649687 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e3939-42df-4c01-a3cd-ccd83793a73c None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:40.649972 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e3939-42df-4c01-a3cd-ccd83793a73c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:40.650310 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1e3939-42df-4c01-a3cd-ccd83793a73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:40.656955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-f3de3522-753f-4bfa-8553-9dc309523e7e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 03:31:40.656955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:40.656955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 03:31:40.656955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 03:31:40.656955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 03:31:40.656955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 03:31:40.656955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 03:31:40.656955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:31:40.656955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 03:31:40.656955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:40.656955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 03:31:40.656955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:40.656955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:40.656955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:40.656955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:40.656955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:40.656955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:40.658006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:40.658006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:40.658006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:40.658006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:40.658006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:40.658006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:40.658006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 03:31:40.658006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 03:31:40.658006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 03:31:40.658006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 03:31:40.658006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:40.658006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:40.658006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:40.658006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:40.658006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:40.658006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:40.659303 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:40.659303 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:40.659303 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:40.659303 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:40.659303 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:40.659303 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:40.659303 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:40.659303 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:40.659303 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:40.659303 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:40.659303 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 03:31:40.659303 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:31:40.659303 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 03:31:40.659303 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:40.662906 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 500/983] 10.222.0.20 () {56 vars in 1105 bytes} [Thu Jul 21 03:31:40 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:40.663958 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de3522-753f-4bfa-8553-9dc309523e7e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:40.667275 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ca1e3939-42df-4c01-a3cd-ccd83793a73c None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:40.668472 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ca1e3939-42df-4c01-a3cd-ccd83793a73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:40.700752 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:40.744115 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 484/984] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 03:31:40.767388 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e3939-42df-4c01-a3cd-ccd83793a73c None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:40.774766 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de3522-753f-4bfa-8553-9dc309523e7e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:40.812495 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a127739-7377-4926-b6d9-29912539363c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:40.813156 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a127739-7377-4926-b6d9-29912539363c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:40.813446 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a127739-7377-4926-b6d9-29912539363c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:40.813723 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a127739-7377-4926-b6d9-29912539363c None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:40.814430 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a127739-7377-4926-b6d9-29912539363c None admin] RBAC: Adding query filter params (name=image) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:40.814770 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a127739-7377-4926-b6d9-29912539363c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:40.816130 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a127739-7377-4926-b6d9-29912539363c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:40.821697 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 501/985] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:40.827095 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a127739-7377-4926-b6d9-29912539363c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:40.868651 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1e3939-42df-4c01-a3cd-ccd83793a73c None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:40.885011 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:40.908204 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c866bb1-17a0-4da8-a257-ee8dea25b5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:40.908939 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c866bb1-17a0-4da8-a257-ee8dea25b5c6 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:40.909222 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c866bb1-17a0-4da8-a257-ee8dea25b5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:40.909498 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c866bb1-17a0-4da8-a257-ee8dea25b5c6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:40.910157 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c866bb1-17a0-4da8-a257-ee8dea25b5c6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:40.911574 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c866bb1-17a0-4da8-a257-ee8dea25b5c6 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:40.924979 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-8c866bb1-17a0-4da8-a257-ee8dea25b5c6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 03:31:40.924979 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:40.924979 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 03:31:40.924979 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 03:31:40.924979 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 03:31:40.924979 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 03:31:40.924979 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 03:31:40.924979 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:31:40.924979 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 03:31:40.924979 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:40.924979 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 03:31:40.924979 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:40.924979 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:40.924979 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:40.924979 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:40.924979 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:40.924979 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:40.925969 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:40.925969 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:40.925969 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:40.925969 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:40.925969 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:40.925969 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:40.925969 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 03:31:40.925969 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 03:31:40.925969 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 03:31:40.925969 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 03:31:40.925969 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:40.925969 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:40.925969 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:40.925969 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:40.925969 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:40.925969 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:40.926846 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:40.926846 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:40.926846 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:40.926846 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:40.926846 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:40.926846 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:40.926846 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:40.926846 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:40.926846 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:40.926846 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:40.926846 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 03:31:40.926846 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:31:40.926846 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 03:31:40.926846 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:40.926846 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 485/986] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Jul 21 03:31:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:31:40.930854 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:40.932614 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c866bb1-17a0-4da8-a257-ee8dea25b5c6 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:40.934974 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a127739-7377-4926-b6d9-29912539363c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:40.976324 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e8ebe-c5dc-45d1-8eda-ee1ee55d100a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:40.977048 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e8ebe-c5dc-45d1-8eda-ee1ee55d100a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:40.977334 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e8ebe-c5dc-45d1-8eda-ee1ee55d100a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:40.977609 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e8ebe-c5dc-45d1-8eda-ee1ee55d100a None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:40.978310 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e8ebe-c5dc-45d1-8eda-ee1ee55d100a None admin] RBAC: Adding query filter params (type=image) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:40.978665 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e8ebe-c5dc-45d1-8eda-ee1ee55d100a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:40.980020 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e8ebe-c5dc-45d1-8eda-ee1ee55d100a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:40.984983 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 502/987] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:40 2022] GET /identity/v3/services?type=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:31:41.041693 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c866bb1-17a0-4da8-a257-ee8dea25b5c6 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:41.078981 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83c4f8-5509-4da2-907c-815bd762bf70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:41.079667 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83c4f8-5509-4da2-907c-815bd762bf70 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:41.079952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83c4f8-5509-4da2-907c-815bd762bf70 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:41.080231 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83c4f8-5509-4da2-907c-815bd762bf70 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:41.080953 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83c4f8-5509-4da2-907c-815bd762bf70 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:41.081267 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83c4f8-5509-4da2-907c-815bd762bf70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:41.082696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83c4f8-5509-4da2-907c-815bd762bf70 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:41.093012 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 486/988] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Jul 21 03:31:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:31:41.094247 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e8ebe-c5dc-45d1-8eda-ee1ee55d100a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:41.201491 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e8ebe-c5dc-45d1-8eda-ee1ee55d100a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:41.234447 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968456e5-1517-459d-a74b-c987ae1c4717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:41.235130 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968456e5-1517-459d-a74b-c987ae1c4717 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:41.235412 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968456e5-1517-459d-a74b-c987ae1c4717 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:41.235684 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968456e5-1517-459d-a74b-c987ae1c4717 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:41.236386 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968456e5-1517-459d-a74b-c987ae1c4717 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:41.236690 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968456e5-1517-459d-a74b-c987ae1c4717 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:41.238032 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968456e5-1517-459d-a74b-c987ae1c4717 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:41.243755 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 503/989] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Jul 21 03:31:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:41.249488 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83c4f8-5509-4da2-907c-815bd762bf70 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:41.292174 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:41.352005 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83c4f8-5509-4da2-907c-815bd762bf70 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:41.384582 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b251528c-89db-410c-b318-f522600dc5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:41.385244 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251528c-89db-410c-b318-f522600dc5a1 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:41.385579 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251528c-89db-410c-b318-f522600dc5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:41.385860 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b251528c-89db-410c-b318-f522600dc5a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:41.386730 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b251528c-89db-410c-b318-f522600dc5a1 None admin] RBAC: Adding query filter params (interface=admin, service_id=b076258ecd76423ab5f02663ccc32d29, region_id=RegionOne) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:41.387049 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b251528c-89db-410c-b318-f522600dc5a1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:41.388426 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b251528c-89db-410c-b318-f522600dc5a1 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:41.393877 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 487/990] 10.222.0.20 () {56 vars in 1249 bytes} [Thu Jul 21 03:31:41 2022] GET /identity/v3/endpoints?service_id=b076258ecd76423ab5f02663ccc32d29&interface=admin®ion_id=RegionOne => generated 193 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:41.400168 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968456e5-1517-459d-a74b-c987ae1c4717 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:41.428268 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:41.503257 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968456e5-1517-459d-a74b-c987ae1c4717 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:41.536528 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b916f2-b77e-410b-81ba-d3bd1e7b5cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:41.537723 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b916f2-b77e-410b-81ba-d3bd1e7b5cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:41.538000 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b916f2-b77e-410b-81ba-d3bd1e7b5cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:41.538269 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b916f2-b77e-410b-81ba-d3bd1e7b5cf9 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:41.538976 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b916f2-b77e-410b-81ba-d3bd1e7b5cf9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:41.540383 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b916f2-b77e-410b-81ba-d3bd1e7b5cf9 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:41.546488 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 504/991] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Jul 21 03:31:41 2022] GET /identity/v3/services => generated 1497 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:31:41.816417 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bea6f0-42dd-44dc-b062-7ef85e3fe564 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:41.816934 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bea6f0-42dd-44dc-b062-7ef85e3fe564 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:41.816934 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bea6f0-42dd-44dc-b062-7ef85e3fe564 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:41.819063 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 488/992] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:31:41.824349 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbea89-e761-4e40-baee-ec202f172361 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:41.824778 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbea89-e761-4e40-baee-ec202f172361 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:41.824961 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbea89-e761-4e40-baee-ec202f172361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:41.841765 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-13dbea89-e761-4e40-baee-ec202f172361 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:41.843121 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-13dbea89-e761-4e40-baee-ec202f172361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:41.912645 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 505/993] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 03:31:41.934810 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bea6f0-42dd-44dc-b062-7ef85e3fe564 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:42.035904 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bea6f0-42dd-44dc-b062-7ef85e3fe564 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:42.038284 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:42.071171 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba686e9-f883-46cd-b9a8-78341176ace3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:42.071753 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba686e9-f883-46cd-b9a8-78341176ace3 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:42.072028 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba686e9-f883-46cd-b9a8-78341176ace3 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:42.072305 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba686e9-f883-46cd-b9a8-78341176ace3 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:42.073028 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba686e9-f883-46cd-b9a8-78341176ace3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:42.074399 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba686e9-f883-46cd-b9a8-78341176ace3 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:42.098717 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 489/994] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jul 21 03:31:41 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:31:43.004860 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d5928-5226-4b5b-ae54-6d458960492d None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:43.005383 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d5928-5226-4b5b-ae54-6d458960492d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:43.005383 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d5928-5226-4b5b-ae54-6d458960492d None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:43.007449 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 506/995] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:31:43.012352 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436009b3-7df5-41b5-b8b2-7f59f0024f13 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:43.012747 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436009b3-7df5-41b5-b8b2-7f59f0024f13 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:43.012926 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436009b3-7df5-41b5-b8b2-7f59f0024f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:43.029698 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-436009b3-7df5-41b5-b8b2-7f59f0024f13 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:43.030915 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-436009b3-7df5-41b5-b8b2-7f59f0024f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:43.110846 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 490/996] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:43 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 03:31:43.134141 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d5928-5226-4b5b-ae54-6d458960492d None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:43.160120 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:43.245566 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d5928-5226-4b5b-ae54-6d458960492d None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:43.279771 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3900d4ad-7561-4dfd-a709-7a0e9a68dabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:43.280365 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900d4ad-7561-4dfd-a709-7a0e9a68dabb None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:43.280653 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900d4ad-7561-4dfd-a709-7a0e9a68dabb None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:43.280933 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900d4ad-7561-4dfd-a709-7a0e9a68dabb None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:43.281664 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3900d4ad-7561-4dfd-a709-7a0e9a68dabb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:43.283059 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3900d4ad-7561-4dfd-a709-7a0e9a68dabb None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:43.301075 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 507/997] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jul 21 03:31:43 2022] POST /identity/v3/services => generated 242 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:31:43.580673 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe43629-24ec-434d-b5a6-0e5a1fb61620 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:43.580968 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe43629-24ec-434d-b5a6-0e5a1fb61620 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:43.581163 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe43629-24ec-434d-b5a6-0e5a1fb61620 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:43.582674 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 491/998] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:31:43.588238 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b621c1f-2f01-4529-81d0-8b9b51c41d54 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:43.588537 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b621c1f-2f01-4529-81d0-8b9b51c41d54 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:43.588825 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b621c1f-2f01-4529-81d0-8b9b51c41d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:43.605928 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-3b621c1f-2f01-4529-81d0-8b9b51c41d54 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:43.607149 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3b621c1f-2f01-4529-81d0-8b9b51c41d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:43.682408 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 508/999] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:43 2022] POST /identity/v3/auth/tokens => generated 1656 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 03:31:43.709152 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe43629-24ec-434d-b5a6-0e5a1fb61620 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:43.808534 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:43.819940 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe43629-24ec-434d-b5a6-0e5a1fb61620 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:43.856753 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd507b7-9fc0-45ef-9e9a-e8971cdfb6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:43.857566 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd507b7-9fc0-45ef-9e9a-e8971cdfb6b3 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:43.857854 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd507b7-9fc0-45ef-9e9a-e8971cdfb6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:43.858133 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd507b7-9fc0-45ef-9e9a-e8971cdfb6b3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:43.858818 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd507b7-9fc0-45ef-9e9a-e8971cdfb6b3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:43.860202 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd507b7-9fc0-45ef-9e9a-e8971cdfb6b3 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:43.872294 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-3dd507b7-9fc0-45ef-9e9a-e8971cdfb6b3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 03:31:43.872294 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:43.872294 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 03:31:43.872294 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 03:31:43.872294 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 03:31:43.872294 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 03:31:43.872294 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 03:31:43.872294 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:31:43.872294 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 03:31:43.872294 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:43.872294 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 03:31:43.872294 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:43.872294 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:43.872294 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:43.872294 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:43.872294 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:43.872294 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:43.873275 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:43.873275 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:43.873275 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:43.873275 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:43.873275 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:43.873275 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:43.873275 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 03:31:43.873275 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 03:31:43.873275 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 03:31:43.873275 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 03:31:43.873275 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:43.873275 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:43.873275 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:43.873275 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:43.873275 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:43.873275 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:43.874121 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:43.874121 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:43.874121 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:43.874121 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:43.874121 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:43.874121 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:43.874121 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:43.874121 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:43.874121 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:43.874121 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:43.874121 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 03:31:43.874121 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:31:43.874121 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 03:31:43.874121 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:43.875596 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 492/1000] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Jul 21 03:31:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:43.879570 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b621c1f-2f01-4529-81d0-8b9b51c41d54 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:43.887921 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:43.983887 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b621c1f-2f01-4529-81d0-8b9b51c41d54 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:44.018143 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cbf1fe-b702-42aa-8760-14a57d44f8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:44.018837 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbf1fe-b702-42aa-8760-14a57d44f8d4 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:44.019118 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbf1fe-b702-42aa-8760-14a57d44f8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:44.019400 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbf1fe-b702-42aa-8760-14a57d44f8d4 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:44.020114 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cbf1fe-b702-42aa-8760-14a57d44f8d4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:44.020427 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cbf1fe-b702-42aa-8760-14a57d44f8d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:44.022643 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cbf1fe-b702-42aa-8760-14a57d44f8d4 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:44.032442 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 509/1001] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Jul 21 03:31:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:31:44.033395 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd507b7-9fc0-45ef-9e9a-e8971cdfb6b3 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:44.124598 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52644753-0adc-417d-80ad-d070680eb21c None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:44.124893 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52644753-0adc-417d-80ad-d070680eb21c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:44.125126 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52644753-0adc-417d-80ad-d070680eb21c None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:44.126721 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 510/1002] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 03:31:44.132773 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34567bc-e051-40c3-81cb-c4de5d1cc3b6 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:44.133062 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34567bc-e051-40c3-81cb-c4de5d1cc3b6 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:44.133347 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34567bc-e051-40c3-81cb-c4de5d1cc3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:44.134491 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd507b7-9fc0-45ef-9e9a-e8971cdfb6b3 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:44.151275 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b34567bc-e051-40c3-81cb-c4de5d1cc3b6 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:44.152564 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b34567bc-e051-40c3-81cb-c4de5d1cc3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:44.169003 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4c3c6-b371-453d-abf8-8fb2014d253b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:44.169665 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4c3c6-b371-453d-abf8-8fb2014d253b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:44.169953 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4c3c6-b371-453d-abf8-8fb2014d253b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:44.170233 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4c3c6-b371-453d-abf8-8fb2014d253b None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:44.170975 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4c3c6-b371-453d-abf8-8fb2014d253b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:44.171282 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4c3c6-b371-453d-abf8-8fb2014d253b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:44.172658 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4c3c6-b371-453d-abf8-8fb2014d253b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:44.177965 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 493/1003] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Jul 21 03:31:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:31:44.183265 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4c3c6-b371-453d-abf8-8fb2014d253b None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:44.204308 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:44.223724 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:44.233753 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 511/1004] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:44 2022] POST /identity/v3/auth/tokens => generated 1656 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 03:31:44.253250 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34567bc-e051-40c3-81cb-c4de5d1cc3b6 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:44.302870 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4c3c6-b371-453d-abf8-8fb2014d253b None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:44.341536 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271fbf5d-14a7-45ac-bc26-26d670929429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:44.342743 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fbf5d-14a7-45ac-bc26-26d670929429 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:44.343197 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fbf5d-14a7-45ac-bc26-26d670929429 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:44.343645 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271fbf5d-14a7-45ac-bc26-26d670929429 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:44.344595 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271fbf5d-14a7-45ac-bc26-26d670929429 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:44.346280 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271fbf5d-14a7-45ac-bc26-26d670929429 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:44.359545 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34567bc-e051-40c3-81cb-c4de5d1cc3b6 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:44.363574 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 494/1005] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Jul 21 03:31:44 2022] POST /identity/v3/endpoints => generated 325 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:31:44.408470 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d26cb5-b103-4286-a304-6511100253f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:44.409211 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d26cb5-b103-4286-a304-6511100253f4 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:44.409557 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d26cb5-b103-4286-a304-6511100253f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:44.409841 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d26cb5-b103-4286-a304-6511100253f4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:44.410573 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d26cb5-b103-4286-a304-6511100253f4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:44.412153 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d26cb5-b103-4286-a304-6511100253f4 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:44.425373 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-a9d26cb5-b103-4286-a304-6511100253f4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 03:31:44.425373 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:44.425373 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 03:31:44.425373 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 03:31:44.425373 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 03:31:44.425373 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 03:31:44.425373 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 03:31:44.425373 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:31:44.425373 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 03:31:44.425373 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:44.425373 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 03:31:44.425373 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:44.425373 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:44.425373 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:44.425373 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:44.425373 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:44.425373 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:44.426528 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:44.426528 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:44.426528 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:44.426528 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:44.426528 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:44.426528 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:44.426528 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 03:31:44.426528 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 03:31:44.426528 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 03:31:44.426528 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 03:31:44.426528 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:44.426528 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:44.426528 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:44.426528 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:44.426528 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:44.426528 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:44.427886 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:44.427886 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:44.427886 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:44.427886 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:44.427886 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:44.427886 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:44.427886 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:44.427886 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:44.427886 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:44.427886 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:44.427886 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 03:31:44.427886 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:31:44.427886 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 03:31:44.427886 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:44.430839 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 512/1006] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:31:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:31:44.433545 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271fbf5d-14a7-45ac-bc26-26d670929429 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:44.523783 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:44.547695 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271fbf5d-14a7-45ac-bc26-26d670929429 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:44.583012 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8c37d-4e5e-47fa-a894-3e71322318bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:44.583721 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8c37d-4e5e-47fa-a894-3e71322318bd None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:44.584007 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8c37d-4e5e-47fa-a894-3e71322318bd None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:44.584280 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8c37d-4e5e-47fa-a894-3e71322318bd None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:44.584996 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf8c37d-4e5e-47fa-a894-3e71322318bd None admin] RBAC: Adding query filter params (name=compute) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:44.585301 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf8c37d-4e5e-47fa-a894-3e71322318bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:44.586702 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf8c37d-4e5e-47fa-a894-3e71322318bd None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:44.594521 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 495/1007] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jul 21 03:31:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:31:44.597806 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d26cb5-b103-4286-a304-6511100253f4 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:44.657474 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:44.704760 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d26cb5-b103-4286-a304-6511100253f4 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:44.739122 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bac37f-2708-4f0e-98ce-c2e3b3c7f611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:44.740615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bac37f-2708-4f0e-98ce-c2e3b3c7f611 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:44.741115 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bac37f-2708-4f0e-98ce-c2e3b3c7f611 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:44.741542 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bac37f-2708-4f0e-98ce-c2e3b3c7f611 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:44.742401 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bac37f-2708-4f0e-98ce-c2e3b3c7f611 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:44.742910 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bac37f-2708-4f0e-98ce-c2e3b3c7f611 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:44.744403 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bac37f-2708-4f0e-98ce-c2e3b3c7f611 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:44.754391 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 513/1008] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jul 21 03:31:44 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:31:44.755911 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8c37d-4e5e-47fa-a894-3e71322318bd None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:44.858556 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8c37d-4e5e-47fa-a894-3e71322318bd None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:44.892765 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47803ee-3445-46a2-9c92-ea6cb62ad444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:44.893428 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47803ee-3445-46a2-9c92-ea6cb62ad444 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:44.893723 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47803ee-3445-46a2-9c92-ea6cb62ad444 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:44.894002 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47803ee-3445-46a2-9c92-ea6cb62ad444 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:44.894827 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47803ee-3445-46a2-9c92-ea6cb62ad444 None admin] RBAC: Adding query filter params (interface=public, service_id=64acfc9de6ce4efb8d5bbd75d0311116, region_id=RegionOne) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:44.895147 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47803ee-3445-46a2-9c92-ea6cb62ad444 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:44.896580 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47803ee-3445-46a2-9c92-ea6cb62ad444 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:44.906959 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 496/1009] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Jul 21 03:31:44 2022] GET /identity/v3/endpoints?service_id=64acfc9de6ce4efb8d5bbd75d0311116&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:31:44.908637 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bac37f-2708-4f0e-98ce-c2e3b3c7f611 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:45.009989 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bac37f-2708-4f0e-98ce-c2e3b3c7f611 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:45.032881 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:45.045432 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbba10-7c81-4cc6-8462-434b56b86d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:45.046100 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbba10-7c81-4cc6-8462-434b56b86d54 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:45.046386 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbba10-7c81-4cc6-8462-434b56b86d54 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:45.046712 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbba10-7c81-4cc6-8462-434b56b86d54 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:45.047394 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cbba10-7c81-4cc6-8462-434b56b86d54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:45.048788 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cbba10-7c81-4cc6-8462-434b56b86d54 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:45.062482 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 514/1010] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Jul 21 03:31:44 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 03:31:45.344836 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f52bd-dd0e-4105-bca1-0da67c8bfbef None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:45.345353 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f52bd-dd0e-4105-bca1-0da67c8bfbef None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:45.345433 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f52bd-dd0e-4105-bca1-0da67c8bfbef None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:45.346940 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 497/1011] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:31:45.352470 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e185a7-521b-46a9-8fc2-5e55cfc8a1e0 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:45.352809 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e185a7-521b-46a9-8fc2-5e55cfc8a1e0 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:45.353087 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e185a7-521b-46a9-8fc2-5e55cfc8a1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:45.369910 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-70e185a7-521b-46a9-8fc2-5e55cfc8a1e0 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:45.371126 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-70e185a7-521b-46a9-8fc2-5e55cfc8a1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:45.437624 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 515/1012] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:45 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 03:31:45.462315 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f52bd-dd0e-4105-bca1-0da67c8bfbef None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:45.472283 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:45.566691 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f52bd-dd0e-4105-bca1-0da67c8bfbef None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:45.600780 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f6c48-1ecf-4479-9ba0-005716d36f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:45.601491 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f6c48-1ecf-4479-9ba0-005716d36f52 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:45.601773 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f6c48-1ecf-4479-9ba0-005716d36f52 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:45.602051 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f6c48-1ecf-4479-9ba0-005716d36f52 None admin] PATH_INFO: `/v3/services/image` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:45.602728 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f6c48-1ecf-4479-9ba0-005716d36f52 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:45.604103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f6c48-1ecf-4479-9ba0-005716d36f52 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:45.615642 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-de4f6c48-1ecf-4479-9ba0-005716d36f52 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 03:31:45.615642 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:45.615642 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 03:31:45.615642 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 03:31:45.615642 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 03:31:45.615642 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 03:31:45.615642 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 03:31:45.615642 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:31:45.615642 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 03:31:45.615642 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:45.615642 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 03:31:45.615642 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:45.615642 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:45.615642 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:45.615642 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:45.615642 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:45.615642 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:45.616620 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:45.616620 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:45.616620 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:45.616620 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:45.616620 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:45.616620 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:45.616620 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 03:31:45.616620 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 03:31:45.616620 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 03:31:45.616620 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 03:31:45.616620 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:45.616620 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:45.616620 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:45.616620 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:45.616620 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:45.616620 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:45.617473 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:45.617473 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:45.617473 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:45.617473 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:45.617473 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:45.617473 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:45.617473 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:45.617473 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:45.617473 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:45.617473 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:45.617473 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 03:31:45.617473 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:31:45.617473 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 03:31:45.617473 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:45.621796 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 498/1013] 10.222.0.20 () {56 vars in 1105 bytes} [Thu Jul 21 03:31:45 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:45.623165 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e185a7-521b-46a9-8fc2-5e55cfc8a1e0 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:45.725591 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e185a7-521b-46a9-8fc2-5e55cfc8a1e0 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:45.743319 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:45.761430 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0db73-a25c-4488-8209-8b51bb4a745e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:45.762103 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0db73-a25c-4488-8209-8b51bb4a745e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:45.762393 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0db73-a25c-4488-8209-8b51bb4a745e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:45.762706 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0db73-a25c-4488-8209-8b51bb4a745e None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:45.763415 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a0db73-a25c-4488-8209-8b51bb4a745e None admin] RBAC: Adding query filter params (name=image) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:45.763729 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a0db73-a25c-4488-8209-8b51bb4a745e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:45.765094 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a0db73-a25c-4488-8209-8b51bb4a745e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:45.775501 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 516/1014] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:45.776968 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f6c48-1ecf-4479-9ba0-005716d36f52 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:45.847693 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:45.879839 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f6c48-1ecf-4479-9ba0-005716d36f52 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:45.913242 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f420748-6b4d-4be0-9be4-3e8fffb31afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:45.913930 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f420748-6b4d-4be0-9be4-3e8fffb31afb None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:45.914212 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f420748-6b4d-4be0-9be4-3e8fffb31afb None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:45.914508 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f420748-6b4d-4be0-9be4-3e8fffb31afb None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:45.915209 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f420748-6b4d-4be0-9be4-3e8fffb31afb None admin] RBAC: Adding query filter params (type=image) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:45.915515 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f420748-6b4d-4be0-9be4-3e8fffb31afb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:45.916885 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f420748-6b4d-4be0-9be4-3e8fffb31afb None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:45.921810 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 499/1015] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:45 2022] GET /identity/v3/services?type=image => generated 350 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:45.928170 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0db73-a25c-4488-8209-8b51bb4a745e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:46.030234 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0db73-a25c-4488-8209-8b51bb4a745e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:46.064872 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8842e725-6978-446f-9119-54907d00fa7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:46.065515 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842e725-6978-446f-9119-54907d00fa7a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:46.065804 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842e725-6978-446f-9119-54907d00fa7a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:46.066083 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842e725-6978-446f-9119-54907d00fa7a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:46.066901 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8842e725-6978-446f-9119-54907d00fa7a None admin] RBAC: Adding query filter params (interface=public, service_id=b98180991ba84ebaaea5e158c46f72cf, region_id=RegionOne) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:46.067220 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8842e725-6978-446f-9119-54907d00fa7a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:46.068613 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8842e725-6978-446f-9119-54907d00fa7a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:46.073919 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 517/1016] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Jul 21 03:31:45 2022] GET /identity/v3/endpoints?service_id=b98180991ba84ebaaea5e158c46f72cf&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:46.079280 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f420748-6b4d-4be0-9be4-3e8fffb31afb None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:46.183071 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f420748-6b4d-4be0-9be4-3e8fffb31afb None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:46.217018 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f92f5f9-f070-4c9a-9cae-5852cdf8bdf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:46.217715 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92f5f9-f070-4c9a-9cae-5852cdf8bdf0 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:46.218002 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92f5f9-f070-4c9a-9cae-5852cdf8bdf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:46.218282 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f92f5f9-f070-4c9a-9cae-5852cdf8bdf0 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:46.219006 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f92f5f9-f070-4c9a-9cae-5852cdf8bdf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:46.220385 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f92f5f9-f070-4c9a-9cae-5852cdf8bdf0 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:46.221441 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:46.234490 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 500/1017] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Jul 21 03:31:46 2022] GET /identity/v3/services => generated 1957 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:31:46.471912 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363e97e-a35e-41df-baa7-541856aed7f3 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:46.472253 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363e97e-a35e-41df-baa7-541856aed7f3 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:46.472372 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363e97e-a35e-41df-baa7-541856aed7f3 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:46.473907 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 518/1018] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:31:46.479042 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31826c31-ab9a-4890-8f4b-fd8b1d19dcd2 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:46.479477 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31826c31-ab9a-4890-8f4b-fd8b1d19dcd2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:46.479639 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31826c31-ab9a-4890-8f4b-fd8b1d19dcd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:46.496369 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-31826c31-ab9a-4890-8f4b-fd8b1d19dcd2 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:46.497555 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-31826c31-ab9a-4890-8f4b-fd8b1d19dcd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:46.564838 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 501/1019] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:46 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 03:31:46.588878 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363e97e-a35e-41df-baa7-541856aed7f3 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:46.637590 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:46.697533 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363e97e-a35e-41df-baa7-541856aed7f3 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:46.733208 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682bc6a2-b2fb-4cde-88ae-3b2bea0d173e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:46.733931 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bc6a2-b2fb-4cde-88ae-3b2bea0d173e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:46.734213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bc6a2-b2fb-4cde-88ae-3b2bea0d173e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:46.734509 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bc6a2-b2fb-4cde-88ae-3b2bea0d173e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:46.735674 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682bc6a2-b2fb-4cde-88ae-3b2bea0d173e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:46.737125 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682bc6a2-b2fb-4cde-88ae-3b2bea0d173e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:46.743917 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 519/1020] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:46.744949 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31826c31-ab9a-4890-8f4b-fd8b1d19dcd2 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:46.846010 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31826c31-ab9a-4890-8f4b-fd8b1d19dcd2 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:46.872509 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:46.884703 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f0e06-7732-47a0-9f94-6e2452dc1d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:46.885406 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f0e06-7732-47a0-9f94-6e2452dc1d65 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:46.885686 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f0e06-7732-47a0-9f94-6e2452dc1d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:46.885957 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f0e06-7732-47a0-9f94-6e2452dc1d65 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:46.886700 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3f0e06-7732-47a0-9f94-6e2452dc1d65 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:46.888129 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3f0e06-7732-47a0-9f94-6e2452dc1d65 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:46.918485 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 502/1021] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jul 21 03:31:46 2022] POST /identity/v3/projects => generated 311 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:31:47.089912 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d90ed4-91c6-41da-91e7-e6d8d25204b7 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:47.090431 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d90ed4-91c6-41da-91e7-e6d8d25204b7 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:47.090572 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d90ed4-91c6-41da-91e7-e6d8d25204b7 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:47.092015 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 520/1022] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:31:47.097011 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1d8cb-6d92-4996-9e59-a785035e2e3a None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:47.097308 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1d8cb-6d92-4996-9e59-a785035e2e3a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:47.097590 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1d8cb-6d92-4996-9e59-a785035e2e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:47.115614 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-0ae1d8cb-6d92-4996-9e59-a785035e2e3a None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:47.116812 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0ae1d8cb-6d92-4996-9e59-a785035e2e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:47.191941 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 503/1023] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:47 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 03:31:47.214750 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d90ed4-91c6-41da-91e7-e6d8d25204b7 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:47.317695 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d90ed4-91c6-41da-91e7-e6d8d25204b7 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:47.334054 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:47.356138 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76228515-c809-49b9-9089-c004100c185e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:47.356871 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76228515-c809-49b9-9089-c004100c185e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:47.357160 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76228515-c809-49b9-9089-c004100c185e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:47.357442 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76228515-c809-49b9-9089-c004100c185e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:47.358099 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76228515-c809-49b9-9089-c004100c185e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:47.359562 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76228515-c809-49b9-9089-c004100c185e None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:47.371677 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-76228515-c809-49b9-9089-c004100c185e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 03:31:47.371677 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:47.371677 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 03:31:47.371677 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 03:31:47.371677 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 03:31:47.371677 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 03:31:47.371677 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 03:31:47.371677 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:31:47.371677 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 03:31:47.371677 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:47.371677 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 03:31:47.371677 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:47.371677 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:47.371677 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:47.371677 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:47.371677 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:47.371677 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:47.372682 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:47.372682 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:47.372682 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:47.372682 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:47.372682 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:47.372682 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:47.372682 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 03:31:47.372682 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 03:31:47.372682 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 03:31:47.372682 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 03:31:47.372682 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:47.372682 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:47.372682 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:47.372682 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:47.372682 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:47.372682 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:47.373562 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:47.373562 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:47.373562 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:47.373562 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:47.373562 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:47.373562 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:47.373562 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:47.373562 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:47.373562 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:47.373562 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:47.373562 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 03:31:47.373562 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:31:47.373562 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 03:31:47.373562 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:47.373562 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 521/1024] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:31:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:31:47.380652 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1d8cb-6d92-4996-9e59-a785035e2e3a None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:47.483876 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1d8cb-6d92-4996-9e59-a785035e2e3a None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:47.494544 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:47.519808 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95692ed5-f561-4190-9a73-86e04e8c4af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:47.520478 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95692ed5-f561-4190-9a73-86e04e8c4af8 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:47.520759 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95692ed5-f561-4190-9a73-86e04e8c4af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:47.521552 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95692ed5-f561-4190-9a73-86e04e8c4af8 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:47.522292 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95692ed5-f561-4190-9a73-86e04e8c4af8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:47.522884 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95692ed5-f561-4190-9a73-86e04e8c4af8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:47.524260 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95692ed5-f561-4190-9a73-86e04e8c4af8 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:47.533877 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 504/1025] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jul 21 03:31:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:47.535130 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76228515-c809-49b9-9089-c004100c185e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:47.636598 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76228515-c809-49b9-9089-c004100c185e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:47.670945 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655d011-6136-40c3-a91b-b01440913ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:47.671615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655d011-6136-40c3-a91b-b01440913ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:47.671904 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655d011-6136-40c3-a91b-b01440913ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:47.672185 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655d011-6136-40c3-a91b-b01440913ff4 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:47.672895 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4655d011-6136-40c3-a91b-b01440913ff4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:47.673209 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4655d011-6136-40c3-a91b-b01440913ff4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:47.674608 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4655d011-6136-40c3-a91b-b01440913ff4 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:47.684306 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 522/1026] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jul 21 03:31:47 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:47.685933 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95692ed5-f561-4190-9a73-86e04e8c4af8 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:47.790350 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95692ed5-f561-4190-9a73-86e04e8c4af8 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:47.823721 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686159f-7644-439b-ac9c-aa4a8f59c07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:47.824373 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686159f-7644-439b-ac9c-aa4a8f59c07b None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:47.824655 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686159f-7644-439b-ac9c-aa4a8f59c07b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:47.824926 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686159f-7644-439b-ac9c-aa4a8f59c07b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:47.825665 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0686159f-7644-439b-ac9c-aa4a8f59c07b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:47.827062 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0686159f-7644-439b-ac9c-aa4a8f59c07b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:47.847108 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 505/1027] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Jul 21 03:31:47 2022] POST /identity/v3/endpoints => generated 334 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:31:48.261820 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65778c52-cfa2-44f3-b82e-14b2b896f610 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:48.262376 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65778c52-cfa2-44f3-b82e-14b2b896f610 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:48.262376 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65778c52-cfa2-44f3-b82e-14b2b896f610 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:48.263929 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 523/1028] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:31:48.268894 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29462a8b-64ca-4a5c-9381-7b2087e646e5 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:48.269196 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29462a8b-64ca-4a5c-9381-7b2087e646e5 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:48.269482 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29462a8b-64ca-4a5c-9381-7b2087e646e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:48.286210 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-29462a8b-64ca-4a5c-9381-7b2087e646e5 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:48.287461 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-29462a8b-64ca-4a5c-9381-7b2087e646e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:48.312403 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:48.363608 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 506/1029] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:48 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 03:31:48.387302 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65778c52-cfa2-44f3-b82e-14b2b896f610 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:48.435085 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:48.496124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65778c52-cfa2-44f3-b82e-14b2b896f610 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:48.529659 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aefc04-2641-4529-ba9a-0ee10fa68e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:48.530368 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aefc04-2641-4529-ba9a-0ee10fa68e00 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:48.530669 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aefc04-2641-4529-ba9a-0ee10fa68e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:48.530943 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aefc04-2641-4529-ba9a-0ee10fa68e00 None admin] PATH_INFO: `/v3/services/image` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:48.531610 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aefc04-2641-4529-ba9a-0ee10fa68e00 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:48.532961 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aefc04-2641-4529-ba9a-0ee10fa68e00 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:48.544868 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-e1aefc04-2641-4529-ba9a-0ee10fa68e00 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 03:31:48.544868 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:48.544868 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 03:31:48.544868 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 03:31:48.544868 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 03:31:48.544868 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 03:31:48.544868 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 03:31:48.544868 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:31:48.544868 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 03:31:48.544868 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:48.544868 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 03:31:48.544868 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:48.544868 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:48.544868 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:48.544868 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:48.544868 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:48.544868 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:48.545889 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:48.545889 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:48.545889 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:48.545889 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:48.545889 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:48.545889 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:48.545889 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 03:31:48.545889 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 03:31:48.545889 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 03:31:48.545889 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 03:31:48.545889 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:48.545889 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:48.545889 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:48.545889 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:48.545889 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:48.545889 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:48.546802 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:48.546802 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:48.546802 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:48.546802 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:48.546802 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:48.546802 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:48.546802 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:48.546802 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:48.546802 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:48.546802 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:48.546802 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 03:31:48.546802 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:31:48.546802 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 03:31:48.546802 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:48.546802 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 524/1030] 10.222.0.20 () {56 vars in 1105 bytes} [Thu Jul 21 03:31:48 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:48.554408 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29462a8b-64ca-4a5c-9381-7b2087e646e5 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:48.652284 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29462a8b-64ca-4a5c-9381-7b2087e646e5 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:48.686479 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4797ca-d305-4a1e-8a8d-3ba1e80f2857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:48.687279 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4797ca-d305-4a1e-8a8d-3ba1e80f2857 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:48.687566 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4797ca-d305-4a1e-8a8d-3ba1e80f2857 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:48.687836 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4797ca-d305-4a1e-8a8d-3ba1e80f2857 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:48.688539 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4797ca-d305-4a1e-8a8d-3ba1e80f2857 None admin] RBAC: Adding query filter params (name=image) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:48.688842 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4797ca-d305-4a1e-8a8d-3ba1e80f2857 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:48.690216 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4797ca-d305-4a1e-8a8d-3ba1e80f2857 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:48.703956 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 507/1031] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:48.705209 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aefc04-2641-4529-ba9a-0ee10fa68e00 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:48.807854 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aefc04-2641-4529-ba9a-0ee10fa68e00 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:48.814532 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:48.842924 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17bac0-31c8-45e2-825e-5582b307b862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:48.843579 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17bac0-31c8-45e2-825e-5582b307b862 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:48.843862 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17bac0-31c8-45e2-825e-5582b307b862 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:48.844133 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17bac0-31c8-45e2-825e-5582b307b862 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:48.844828 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b17bac0-31c8-45e2-825e-5582b307b862 None admin] RBAC: Adding query filter params (type=image) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:48.845131 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b17bac0-31c8-45e2-825e-5582b307b862 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:48.846485 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b17bac0-31c8-45e2-825e-5582b307b862 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:48.852006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 525/1032] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:48 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:48.857760 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4797ca-d305-4a1e-8a8d-3ba1e80f2857 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:48.879364 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:48.958167 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4797ca-d305-4a1e-8a8d-3ba1e80f2857 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:48.992357 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f234eb-fc29-42c7-be5e-01bdf008f07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:48.993013 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f234eb-fc29-42c7-be5e-01bdf008f07e None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:48.993295 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f234eb-fc29-42c7-be5e-01bdf008f07e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:48.993567 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f234eb-fc29-42c7-be5e-01bdf008f07e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:48.994346 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f234eb-fc29-42c7-be5e-01bdf008f07e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:48.995742 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f234eb-fc29-42c7-be5e-01bdf008f07e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:49.013325 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e80c38-3196-416f-958a-284a1f88a088 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:49.013325 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e80c38-3196-416f-958a-284a1f88a088 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:49.013325 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e80c38-3196-416f-958a-284a1f88a088 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:49.014490 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 526/1033] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 03:31:49.019244 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534785a-66a5-479c-ada6-b6ef3d9808b4 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:49.019531 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534785a-66a5-479c-ada6-b6ef3d9808b4 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:49.019811 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534785a-66a5-479c-ada6-b6ef3d9808b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:49.020753 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 508/1034] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Jul 21 03:31:48 2022] POST /identity/v3/endpoints => generated 327 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:31:49.042351 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-9534785a-66a5-479c-ada6-b6ef3d9808b4 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:49.043675 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9534785a-66a5-479c-ada6-b6ef3d9808b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:49.130621 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 527/1035] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 03:31:49.153275 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f234eb-fc29-42c7-be5e-01bdf008f07e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:49.240062 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:49.265952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f234eb-fc29-42c7-be5e-01bdf008f07e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:49.301206 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d1bc0-1f45-48dc-a574-d97c32727063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:49.302003 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d1bc0-1f45-48dc-a574-d97c32727063 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:49.302316 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d1bc0-1f45-48dc-a574-d97c32727063 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:49.302616 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d1bc0-1f45-48dc-a574-d97c32727063 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:49.303790 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d1bc0-1f45-48dc-a574-d97c32727063 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:49.305241 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744d1bc0-1f45-48dc-a574-d97c32727063 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:49.311334 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 509/1036] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:49.312590 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534785a-66a5-479c-ada6-b6ef3d9808b4 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:49.408515 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:49.415995 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534785a-66a5-479c-ada6-b6ef3d9808b4 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:49.451381 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c9a74-3b66-4965-8594-c1390a73d475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:49.452050 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c9a74-3b66-4965-8594-c1390a73d475 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:49.452333 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c9a74-3b66-4965-8594-c1390a73d475 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:49.452607 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c9a74-3b66-4965-8594-c1390a73d475 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:49.453306 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c9a74-3b66-4965-8594-c1390a73d475 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:49.454780 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c9a74-3b66-4965-8594-c1390a73d475 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:49.475146 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 528/1037] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jul 21 03:31:49 2022] POST /identity/v3/users => generated 285 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:31:49.996647 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e571df-2fc0-4b82-841b-58a48cd3a610 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:49.997158 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e571df-2fc0-4b82-841b-58a48cd3a610 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:49.997158 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e571df-2fc0-4b82-841b-58a48cd3a610 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:49.998685 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 510/1038] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:31:50.003600 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156e1f7-5af6-4e96-a2e6-c8ee96bd5a2e None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:50.003902 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156e1f7-5af6-4e96-a2e6-c8ee96bd5a2e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:50.004188 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156e1f7-5af6-4e96-a2e6-c8ee96bd5a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:50.020643 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-5156e1f7-5af6-4e96-a2e6-c8ee96bd5a2e None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:50.021926 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5156e1f7-5af6-4e96-a2e6-c8ee96bd5a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:50.087494 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 529/1039] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 03:31:50.110924 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e571df-2fc0-4b82-841b-58a48cd3a610 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:50.214265 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e571df-2fc0-4b82-841b-58a48cd3a610 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:50.248270 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08324c86-b050-4376-8a3f-971dac806362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:50.249013 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08324c86-b050-4376-8a3f-971dac806362 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:50.249302 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08324c86-b050-4376-8a3f-971dac806362 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:50.249583 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08324c86-b050-4376-8a3f-971dac806362 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:50.259639 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08324c86-b050-4376-8a3f-971dac806362 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:31:50.267861 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-08324c86-b050-4376-8a3f-971dac806362 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 03:31:50.267861 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:50.267861 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:50.267861 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:50.267861 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:50.267861 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:50.267861 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:50.267861 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:50.267861 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:50.267861 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:50.267861 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:50.267861 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:50.267861 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:31:50.267861 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:31:50.267861 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:31:50.267861 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:31:50.268775 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:31:50.268775 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:31:50.268775 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:31:50.268775 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:31:50.268775 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:50.268775 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:50.268775 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:50.268775 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:50.268775 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:50.268775 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:50.268775 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:50.268775 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:50.268775 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:50.268775 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:50.268775 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:50.268775 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:50.269658 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:50.269658 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:50.269658 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:50.269658 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:50.269658 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:31:50.269658 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:31:50.269658 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:31:50.269658 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:31:50.269658 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:31:50.269658 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:31:50.269658 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 03:31:50.269658 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:50.277400 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 511/1040] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Jul 21 03:31:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:50.277548 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5156e1f7-5af6-4e96-a2e6-c8ee96bd5a2e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:50.359226 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:50.378726 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5156e1f7-5af6-4e96-a2e6-c8ee96bd5a2e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:50.412631 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc34ba-999f-4bb4-af5c-961382bc5843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:50.413292 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc34ba-999f-4bb4-af5c-961382bc5843 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:50.413581 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc34ba-999f-4bb4-af5c-961382bc5843 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:50.413860 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc34ba-999f-4bb4-af5c-961382bc5843 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:50.414636 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfc34ba-999f-4bb4-af5c-961382bc5843 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:50.414949 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfc34ba-999f-4bb4-af5c-961382bc5843 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:50.416314 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfc34ba-999f-4bb4-af5c-961382bc5843 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:50.424373 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 530/1041] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Jul 21 03:31:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:50.429814 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08324c86-b050-4376-8a3f-971dac806362 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:50.433656 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:50.531899 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08324c86-b050-4376-8a3f-971dac806362 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:50.565960 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b6ec8-9f72-4d10-989f-7aa74d4202d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:50.566791 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b6ec8-9f72-4d10-989f-7aa74d4202d6 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:50.567080 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b6ec8-9f72-4d10-989f-7aa74d4202d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:50.567360 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b6ec8-9f72-4d10-989f-7aa74d4202d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:50.578040 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90b6ec8-9f72-4d10-989f-7aa74d4202d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:50.579547 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90b6ec8-9f72-4d10-989f-7aa74d4202d6 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:50.597108 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-e90b6ec8-9f72-4d10-989f-7aa74d4202d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:50.597108 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:50.597108 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:50.597108 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:50.597108 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:50.597108 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:50.597108 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:50.597108 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:50.597108 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:50.597108 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:50.597108 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:50.597108 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:50.597108 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:31:50.597108 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:31:50.597108 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:31:50.598041 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:31:50.598041 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:50.598041 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:50.598041 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:50.598041 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:50.598041 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:50.598041 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:50.598041 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:50.598041 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:50.598041 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:50.598041 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:50.598041 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:50.598041 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:50.598041 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:50.598041 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:50.598041 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:50.598041 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:50.599606 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:31:50.599606 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:31:50.599606 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:50.599606 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:50.602799 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 512/1042] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:50.604550 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc34ba-999f-4bb4-af5c-961382bc5843 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:50.714611 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc34ba-999f-4bb4-af5c-961382bc5843 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:50.747583 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110cc38-7ebc-4bee-848a-ff6d21c7c024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:50.748248 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110cc38-7ebc-4bee-848a-ff6d21c7c024 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:50.748533 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110cc38-7ebc-4bee-848a-ff6d21c7c024 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:50.748809 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110cc38-7ebc-4bee-848a-ff6d21c7c024 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:50.749536 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4110cc38-7ebc-4bee-848a-ff6d21c7c024 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:50.749844 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4110cc38-7ebc-4bee-848a-ff6d21c7c024 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:50.751227 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4110cc38-7ebc-4bee-848a-ff6d21c7c024 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:50.767996 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 531/1043] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:31:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:50.769495 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b6ec8-9f72-4d10-989f-7aa74d4202d6 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:50.827654 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:50.872943 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b6ec8-9f72-4d10-989f-7aa74d4202d6 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:50.906407 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b993d51-c58a-402c-8407-daf6c622beaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:50.907224 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b993d51-c58a-402c-8407-daf6c622beaa None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:50.907508 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b993d51-c58a-402c-8407-daf6c622beaa None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:50.907784 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b993d51-c58a-402c-8407-daf6c622beaa None admin] PATH_INFO: `/v3/users/nova` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:50.915896 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b993d51-c58a-402c-8407-daf6c622beaa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:50.917337 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b993d51-c58a-402c-8407-daf6c622beaa None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:50.930914 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-4b993d51-c58a-402c-8407-daf6c622beaa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 03:31:50.930914 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:50.930914 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:50.930914 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:50.930914 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:50.930914 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:50.930914 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:50.930914 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:50.930914 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:50.930914 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:50.930914 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:50.930914 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:50.930914 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 03:31:50.930914 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 03:31:50.930914 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 03:31:50.930914 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 03:31:50.931844 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:50.931844 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:50.931844 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 03:31:50.931844 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:31:50.931844 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 03:31:50.931844 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:31:50.931844 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:50.931844 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:50.931844 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:50.931844 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:50.931844 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:50.931844 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:50.931844 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:50.931844 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:50.931844 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:50.931844 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:50.931844 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:50.931844 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:50.932807 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:50.932807 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:50.932807 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 03:31:50.932807 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 03:31:50.932807 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 03:31:50.932807 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 03:31:50.932807 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 03:31:50.932807 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 03:31:50.932807 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 03:31:50.932807 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:50.934551 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 513/1044] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Jul 21 03:31:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:50.938056 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110cc38-7ebc-4bee-848a-ff6d21c7c024 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:50.942705 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:51.041825 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110cc38-7ebc-4bee-848a-ff6d21c7c024 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:51.075972 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d5cf1-f857-4c73-8e34-746f94cef22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:51.076642 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d5cf1-f857-4c73-8e34-746f94cef22c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:51.076924 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d5cf1-f857-4c73-8e34-746f94cef22c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:51.077196 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d5cf1-f857-4c73-8e34-746f94cef22c None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:51.078081 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d5cf1-f857-4c73-8e34-746f94cef22c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:51.078336 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d5cf1-f857-4c73-8e34-746f94cef22c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:51.079789 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d5cf1-f857-4c73-8e34-746f94cef22c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:51.087827 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7add7-e57e-482b-8af5-c742be825d30 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:51.088288 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7add7-e57e-482b-8af5-c742be825d30 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:51.088387 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a7add7-e57e-482b-8af5-c742be825d30 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:51.089744 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 514/1045] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:31:51.094531 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806132d-3d5d-46c2-94f2-4ec0fd3353e3 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:51.094827 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806132d-3d5d-46c2-94f2-4ec0fd3353e3 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:51.095110 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806132d-3d5d-46c2-94f2-4ec0fd3353e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:51.099071 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 532/1046] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Jul 21 03:31:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:51.104656 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d5cf1-f857-4c73-8e34-746f94cef22c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:51.112343 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-e806132d-3d5d-46c2-94f2-4ec0fd3353e3 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:51.113939 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e806132d-3d5d-46c2-94f2-4ec0fd3353e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:51.166751 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:51.195200 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 515/1047] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 03:31:51.209519 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d5cf1-f857-4c73-8e34-746f94cef22c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:51.217041 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806132d-3d5d-46c2-94f2-4ec0fd3353e3 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:51.244599 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf1180-521b-48a7-a116-a168db94d66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:51.245249 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf1180-521b-48a7-a116-a168db94d66d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:51.245536 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf1180-521b-48a7-a116-a168db94d66d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:51.245809 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf1180-521b-48a7-a116-a168db94d66d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:51.266147 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:51.321226 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaf1180-521b-48a7-a116-a168db94d66d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:51.321821 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806132d-3d5d-46c2-94f2-4ec0fd3353e3 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:51.322717 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaf1180-521b-48a7-a116-a168db94d66d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:51.356433 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99815d3d-1fa1-46c7-89e7-72429493775c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:51.357089 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99815d3d-1fa1-46c7-89e7-72429493775c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:51.357374 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99815d3d-1fa1-46c7-89e7-72429493775c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:51.357647 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99815d3d-1fa1-46c7-89e7-72429493775c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:51.389315 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:51.434290 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 533/1048] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:31:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 03:31:51.435371 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf1180-521b-48a7-a116-a168db94d66d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:51.441018 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99815d3d-1fa1-46c7-89e7-72429493775c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:51.442550 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99815d3d-1fa1-46c7-89e7-72429493775c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:51.493517 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:51.542284 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf1180-521b-48a7-a116-a168db94d66d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:51.553551 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 516/1049] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:31:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 03:31:51.559079 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99815d3d-1fa1-46c7-89e7-72429493775c None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:51.579555 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59029ac1-e48f-42e8-a6a3-f6dacf99989c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:51.580359 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59029ac1-e48f-42e8-a6a3-f6dacf99989c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:51.580647 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59029ac1-e48f-42e8-a6a3-f6dacf99989c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:51.580930 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59029ac1-e48f-42e8-a6a3-f6dacf99989c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:51.591915 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59029ac1-e48f-42e8-a6a3-f6dacf99989c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:51.593356 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59029ac1-e48f-42e8-a6a3-f6dacf99989c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:51.611370 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-59029ac1-e48f-42e8-a6a3-f6dacf99989c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:51.611370 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:51.611370 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:51.611370 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:51.611370 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:51.611370 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:51.611370 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:51.611370 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:51.611370 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:51.611370 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:51.611370 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:51.611370 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:51.611370 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:31:51.611370 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:31:51.611370 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:31:51.612434 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:31:51.612434 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:51.612434 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:51.612434 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:51.612434 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:51.612434 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:51.612434 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:51.612434 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:51.612434 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:51.612434 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:51.612434 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:51.612434 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:51.612434 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:51.612434 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:51.612434 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:51.612434 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:51.612434 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:51.613678 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:31:51.613678 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:31:51.613678 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:51.613678 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:51.613678 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 534/1050] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:31:51.614027 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3010680-e5b5-43fd-bdeb-7f7eaa58333a None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:51.614277 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3010680-e5b5-43fd-bdeb-7f7eaa58333a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:51.614585 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3010680-e5b5-43fd-bdeb-7f7eaa58333a None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:51.616528 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 535/1051] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:31:51.618482 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3010680-e5b5-43fd-bdeb-7f7eaa58333a None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:51.633123 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:51.663398 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99815d3d-1fa1-46c7-89e7-72429493775c None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:51.699778 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f93378-1404-4fd2-ab4e-f8bec8caa161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:51.700815 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f93378-1404-4fd2-ab4e-f8bec8caa161 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:51.701106 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f93378-1404-4fd2-ab4e-f8bec8caa161 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:51.701390 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f93378-1404-4fd2-ab4e-f8bec8caa161 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:51.711967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f93378-1404-4fd2-ab4e-f8bec8caa161 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:51.713536 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f93378-1404-4fd2-ab4e-f8bec8caa161 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:51.720168 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:51.722183 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3010680-e5b5-43fd-bdeb-7f7eaa58333a None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:51.732201 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-b2f93378-1404-4fd2-ab4e-f8bec8caa161 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:51.732201 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:51.732201 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:51.732201 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:51.732201 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:51.732201 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:51.732201 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:51.732201 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:51.732201 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:51.732201 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:51.732201 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:51.732201 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:51.732201 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:31:51.732201 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:31:51.732201 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:31:51.733128 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:31:51.733128 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:51.733128 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:51.733128 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:51.733128 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:51.733128 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:51.733128 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:51.733128 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:51.733128 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:51.733128 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:51.733128 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:51.733128 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:51.733128 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:51.733128 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:51.733128 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:51.733128 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:51.733128 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:51.734066 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:31:51.734066 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:31:51.734066 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:51.734066 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:51.734066 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 517/1052] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:31:51.734697 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8075835f-581d-460b-bc4c-5765238b70d4 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:51.734933 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8075835f-581d-460b-bc4c-5765238b70d4 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:51.735156 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8075835f-581d-460b-bc4c-5765238b70d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:51.751350 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-8075835f-581d-460b-bc4c-5765238b70d4 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:51.752528 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8075835f-581d-460b-bc4c-5765238b70d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:51.762046 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef55c1-3ecb-494d-a84b-21e222d80915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:51.762763 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef55c1-3ecb-494d-a84b-21e222d80915 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:51.763051 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef55c1-3ecb-494d-a84b-21e222d80915 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:51.763329 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef55c1-3ecb-494d-a84b-21e222d80915 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:51.764087 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef55c1-3ecb-494d-a84b-21e222d80915 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:51.764399 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef55c1-3ecb-494d-a84b-21e222d80915 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:51.765755 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbef55c1-3ecb-494d-a84b-21e222d80915 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:51.776934 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 536/1053] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:31:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:31:51.777720 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef55c1-3ecb-494d-a84b-21e222d80915 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:51.823187 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 518/1054] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 03:31:51.824078 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8075835f-581d-460b-bc4c-5765238b70d4 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:51.852927 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:51.877565 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbef55c1-3ecb-494d-a84b-21e222d80915 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:51.912704 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1a940-984c-4a70-ada9-e46f6c8f7fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:51.913352 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1a940-984c-4a70-ada9-e46f6c8f7fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:51.913631 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1a940-984c-4a70-ada9-e46f6c8f7fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:51.913910 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1a940-984c-4a70-ada9-e46f6c8f7fa2 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:51.914647 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd1a940-984c-4a70-ada9-e46f6c8f7fa2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:51.914955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd1a940-984c-4a70-ada9-e46f6c8f7fa2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:51.916301 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd1a940-984c-4a70-ada9-e46f6c8f7fa2 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:51.922211 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8075835f-581d-460b-bc4c-5765238b70d4 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:51.927586 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 537/1055] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:31:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:51.928361 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1a940-984c-4a70-ada9-e46f6c8f7fa2 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:51.963555 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:51.973107 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98659e89-b315-4866-9778-bff3cbee8ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:51.975099 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98659e89-b315-4866-9778-bff3cbee8ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:51.975433 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98659e89-b315-4866-9778-bff3cbee8ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:51.975711 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98659e89-b315-4866-9778-bff3cbee8ca3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:51.984340 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98659e89-b315-4866-9778-bff3cbee8ca3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:51.985843 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98659e89-b315-4866-9778-bff3cbee8ca3 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:52.000589 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-98659e89-b315-4866-9778-bff3cbee8ca3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:31:52.000589 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:52.000589 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:52.000589 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:52.000589 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:52.000589 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:52.000589 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:52.000589 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:52.000589 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:52.000589 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:52.000589 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:52.000589 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:52.000589 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 03:31:52.000589 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 03:31:52.000589 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 03:31:52.001638 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 03:31:52.001638 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:52.001638 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:52.001638 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:52.001638 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:52.001638 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:52.001638 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:52.001638 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:52.001638 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:52.001638 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:52.001638 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:52.001638 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:52.001638 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:52.001638 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:52.001638 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:52.001638 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:52.001638 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:52.002604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 03:31:52.002604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 03:31:52.002604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 03:31:52.002604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 03:31:52.002604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 03:31:52.002604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 03:31:52.002604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:31:52.002604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:52.002604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 519/1056] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:31:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:52.007825 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98659e89-b315-4866-9778-bff3cbee8ca3 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:52.043514 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1a940-984c-4a70-ada9-e46f6c8f7fa2 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:52.082564 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432b689-4817-4c0d-add0-8bf2a84a5da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:52.084273 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432b689-4817-4c0d-add0-8bf2a84a5da2 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:52.084780 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432b689-4817-4c0d-add0-8bf2a84a5da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:52.085064 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432b689-4817-4c0d-add0-8bf2a84a5da2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:52.087799 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:52.098130 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5432b689-4817-4c0d-add0-8bf2a84a5da2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:31:52.106567 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-5432b689-4817-4c0d-add0-8bf2a84a5da2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:31:52.106567 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:52.106567 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:52.106567 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:52.106567 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:52.106567 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:52.106567 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:52.106567 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:52.106567 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:52.106567 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:52.106567 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:52.106567 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:52.106567 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:31:52.106567 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:31:52.106567 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:31:52.106567 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:31:52.107723 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:31:52.107723 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:31:52.107723 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:31:52.107723 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:31:52.107723 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:52.107723 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:52.107723 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:52.107723 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:52.107723 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:52.107723 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:52.107723 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:52.107723 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:52.107723 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:52.107723 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:52.107723 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:52.107723 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:52.108875 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:52.108875 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:52.108875 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:52.108875 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:52.108875 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:31:52.108875 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:31:52.108875 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:31:52.108875 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:31:52.108875 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:31:52.108875 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:31:52.108875 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:31:52.108875 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:52.108875 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 538/1057] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 03:31:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:52.113971 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432b689-4817-4c0d-add0-8bf2a84a5da2 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:52.128191 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98659e89-b315-4866-9778-bff3cbee8ca3 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:52.166816 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ccd5c7-4488-4552-89f4-0e149863394c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:52.167490 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ccd5c7-4488-4552-89f4-0e149863394c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:52.167780 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ccd5c7-4488-4552-89f4-0e149863394c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:52.168058 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ccd5c7-4488-4552-89f4-0e149863394c None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:52.168854 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ccd5c7-4488-4552-89f4-0e149863394c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:52.169166 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ccd5c7-4488-4552-89f4-0e149863394c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:52.170649 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ccd5c7-4488-4552-89f4-0e149863394c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:52.183807 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 520/1058] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 03:31:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:31:52.191490 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ccd5c7-4488-4552-89f4-0e149863394c None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:52.232724 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432b689-4817-4c0d-add0-8bf2a84a5da2 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:52.244387 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:52.266133 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e229e-69e2-4f5e-9989-4366f35acdfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:52.266818 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e229e-69e2-4f5e-9989-4366f35acdfe None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:52.267102 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e229e-69e2-4f5e-9989-4366f35acdfe None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:52.267375 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e229e-69e2-4f5e-9989-4366f35acdfe None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:52.268139 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e229e-69e2-4f5e-9989-4366f35acdfe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:52.268445 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e229e-69e2-4f5e-9989-4366f35acdfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:52.269797 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e229e-69e2-4f5e-9989-4366f35acdfe None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:52.278584 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 539/1059] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:31:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:31:52.284207 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e229e-69e2-4f5e-9989-4366f35acdfe None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:52.295276 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ccd5c7-4488-4552-89f4-0e149863394c None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:52.329901 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1229f-3d99-4a78-b339-901920ea5c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:52.330581 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1229f-3d99-4a78-b339-901920ea5c4e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:52.330870 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1229f-3d99-4a78-b339-901920ea5c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:52.331144 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1229f-3d99-4a78-b339-901920ea5c4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:52.331970 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca1229f-3d99-4a78-b339-901920ea5c4e None admin] RBAC: Adding query filter params (role.id=b6ab65019dfc4679a967f9b3f4a6ffde, scope.project.id=0432303daa8b4304a8e07032d6a80781, user.id=cefbe2d0c739428ab0d4dfeaed6c37ab) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:52.332280 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca1229f-3d99-4a78-b339-901920ea5c4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:52.334249 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca1229f-3d99-4a78-b339-901920ea5c4e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:52.338155 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:52.340190 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 521/1060] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:31:52 2022] GET /identity/v3/role_assignments?user.id=cefbe2d0c739428ab0d4dfeaed6c37ab&scope.project.id=0432303daa8b4304a8e07032d6a80781&role.id=b6ab65019dfc4679a967f9b3f4a6ffde => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:31:52.384269 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e229e-69e2-4f5e-9989-4366f35acdfe None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:52.419937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6ac4e-3837-4788-a348-9bb5f14ee8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:52.420819 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6ac4e-3837-4788-a348-9bb5f14ee8b2 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:52.421098 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6ac4e-3837-4788-a348-9bb5f14ee8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:52.421366 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6ac4e-3837-4788-a348-9bb5f14ee8b2 None admin] PATH_INFO: `/v3/users/66f241414c1e4b89b4344bc925f4a216` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:52.435965 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a6ac4e-3837-4788-a348-9bb5f14ee8b2 None admin] RBAC: Authorizing `identity:get_user(user_id=66f241414c1e4b89b4344bc925f4a216)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:52.437652 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a6ac4e-3837-4788-a348-9bb5f14ee8b2 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:52.439507 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 540/1061] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:31:52 2022] GET /identity/v3/users/66f241414c1e4b89b4344bc925f4a216 => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:31:52.445939 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1229f-3d99-4a78-b339-901920ea5c4e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:52.545710 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1229f-3d99-4a78-b339-901920ea5c4e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:52.558092 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:52.579648 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346071e-1620-49fe-baa8-c8548117f7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:52.580303 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346071e-1620-49fe-baa8-c8548117f7cb None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:52.580591 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346071e-1620-49fe-baa8-c8548117f7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:52.580872 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346071e-1620-49fe-baa8-c8548117f7cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:52.647065 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6346071e-1620-49fe-baa8-c8548117f7cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:52.648748 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6346071e-1620-49fe-baa8-c8548117f7cb None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:52.745548 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 522/1062] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:31:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 03:31:52.751214 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6ac4e-3837-4788-a348-9bb5f14ee8b2 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:52.847460 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6ac4e-3837-4788-a348-9bb5f14ee8b2 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:52.861453 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:52.882353 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16536c12-f28d-43f4-8ccf-8e44c40c3d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:52.883254 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16536c12-f28d-43f4-8ccf-8e44c40c3d98 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:52.883542 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16536c12-f28d-43f4-8ccf-8e44c40c3d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:52.883818 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16536c12-f28d-43f4-8ccf-8e44c40c3d98 None admin] PATH_INFO: `/v3/projects/52de011febf24e4faa38075e1506d2ae` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:52.884991 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16536c12-f28d-43f4-8ccf-8e44c40c3d98 None admin] RBAC: Authorizing `identity:get_project(project_id=52de011febf24e4faa38075e1506d2ae)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:52.886409 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16536c12-f28d-43f4-8ccf-8e44c40c3d98 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:52.888138 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 541/1063] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:31:52 2022] GET /identity/v3/projects/52de011febf24e4faa38075e1506d2ae => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:52.894148 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346071e-1620-49fe-baa8-c8548117f7cb None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:52.908410 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:52.993975 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346071e-1620-49fe-baa8-c8548117f7cb None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:53.027401 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f4d71-e3d0-48e3-9bcd-7815a457025a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:53.028005 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f4d71-e3d0-48e3-9bcd-7815a457025a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:53.028285 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f4d71-e3d0-48e3-9bcd-7815a457025a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:53.028560 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f4d71-e3d0-48e3-9bcd-7815a457025a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:53.029377 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451f4d71-e3d0-48e3-9bcd-7815a457025a None admin] RBAC: Adding query filter params (role.id=27e53d6c56f24c25a8c8057bfd36bcf1, scope.project.id=52de011febf24e4faa38075e1506d2ae, user.id=66f241414c1e4b89b4344bc925f4a216) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:53.029684 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451f4d71-e3d0-48e3-9bcd-7815a457025a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:53.031132 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451f4d71-e3d0-48e3-9bcd-7815a457025a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:53.037001 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 523/1064] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:31:52 2022] GET /identity/v3/role_assignments?user.id=66f241414c1e4b89b4344bc925f4a216&scope.project.id=52de011febf24e4faa38075e1506d2ae&role.id=27e53d6c56f24c25a8c8057bfd36bcf1 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:54.432466 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8e1ba-66d9-4b7e-923a-8365ae800bd5 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:54.433018 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8e1ba-66d9-4b7e-923a-8365ae800bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:54.433018 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb8e1ba-66d9-4b7e-923a-8365ae800bd5 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:54.434565 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 542/1065] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:31:54.440084 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ac6a8-4c1d-4bf4-afb2-678c7025a4cf None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:54.440485 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ac6a8-4c1d-4bf4-afb2-678c7025a4cf None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:54.440761 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ac6a8-4c1d-4bf4-afb2-678c7025a4cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:54.457608 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-308ac6a8-4c1d-4bf4-afb2-678c7025a4cf None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:54.459487 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-308ac6a8-4c1d-4bf4-afb2-678c7025a4cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:54.524419 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 524/1066] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 03:31:54.546580 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb8e1ba-66d9-4b7e-923a-8365ae800bd5 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:54.645544 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb8e1ba-66d9-4b7e-923a-8365ae800bd5 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:54.678748 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742797eb-c7f4-4cbc-aaf9-d151e8396f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:54.679760 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742797eb-c7f4-4cbc-aaf9-d151e8396f1f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:54.680044 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742797eb-c7f4-4cbc-aaf9-d151e8396f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:54.680318 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742797eb-c7f4-4cbc-aaf9-d151e8396f1f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:54.690195 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742797eb-c7f4-4cbc-aaf9-d151e8396f1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:31:54.698923 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-742797eb-c7f4-4cbc-aaf9-d151e8396f1f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 03:31:54.698923 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:54.698923 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:54.698923 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:54.698923 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:54.698923 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:54.698923 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:54.698923 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:54.698923 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:54.698923 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:54.698923 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:54.698923 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:54.698923 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:31:54.698923 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:31:54.698923 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:31:54.698923 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:31:54.699872 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:31:54.699872 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:31:54.699872 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:31:54.699872 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:31:54.699872 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:54.699872 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:54.699872 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:54.699872 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:54.699872 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:54.699872 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:54.699872 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:54.699872 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:54.699872 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:54.699872 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:54.699872 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:54.699872 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:54.700944 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:54.700944 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:54.700944 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:54.700944 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:54.700944 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:31:54.700944 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:31:54.700944 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:31:54.700944 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:31:54.700944 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:31:54.700944 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:31:54.700944 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 03:31:54.700944 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:54.700944 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 543/1067] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Jul 21 03:31:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:54.706092 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ac6a8-4c1d-4bf4-afb2-678c7025a4cf None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:54.715058 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:54.804552 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ac6a8-4c1d-4bf4-afb2-678c7025a4cf None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:54.837791 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59823228-ad47-4506-b5f5-ec927f7a34ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:54.838485 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59823228-ad47-4506-b5f5-ec927f7a34ed None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:54.838774 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59823228-ad47-4506-b5f5-ec927f7a34ed None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:54.839052 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59823228-ad47-4506-b5f5-ec927f7a34ed None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:54.839797 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59823228-ad47-4506-b5f5-ec927f7a34ed None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:54.840105 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59823228-ad47-4506-b5f5-ec927f7a34ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:54.841482 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59823228-ad47-4506-b5f5-ec927f7a34ed None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:54.849187 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 525/1068] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Jul 21 03:31:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:54.855221 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742797eb-c7f4-4cbc-aaf9-d151e8396f1f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:54.898479 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:54.954653 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742797eb-c7f4-4cbc-aaf9-d151e8396f1f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:54.986437 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32f491-e775-4e63-9a23-2bec76bcfcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:54.987251 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32f491-e775-4e63-9a23-2bec76bcfcce None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:54.987539 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32f491-e775-4e63-9a23-2bec76bcfcce None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:54.987814 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32f491-e775-4e63-9a23-2bec76bcfcce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:54.998587 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d32f491-e775-4e63-9a23-2bec76bcfcce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:55.000014 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d32f491-e775-4e63-9a23-2bec76bcfcce None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:55.004766 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19cc7e8-4dbc-46f3-9d3f-6ff1e9017d28 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:55.005059 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19cc7e8-4dbc-46f3-9d3f-6ff1e9017d28 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:55.005925 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19cc7e8-4dbc-46f3-9d3f-6ff1e9017d28 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:55.007319 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 526/1069] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 03:31:55.012142 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d5486-aa25-4b4f-bd80-d8deb43dafb2 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:55.012435 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d5486-aa25-4b4f-bd80-d8deb43dafb2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:55.012713 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d5486-aa25-4b4f-bd80-d8deb43dafb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:55.017641 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-6d32f491-e775-4e63-9a23-2bec76bcfcce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:55.017641 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:55.017641 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:55.017641 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:55.017641 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:55.017641 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:55.017641 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:55.017641 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:55.017641 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:55.017641 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:55.017641 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:55.017641 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:55.017641 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:31:55.017641 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:31:55.017641 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:31:55.018696 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:31:55.018696 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:55.018696 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:55.018696 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:55.018696 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:55.018696 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:55.018696 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:55.018696 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:55.018696 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:55.018696 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:55.018696 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:55.018696 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:55.018696 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:55.018696 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:55.018696 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:55.018696 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:55.018696 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:55.019858 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:31:55.019858 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:31:55.019858 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:55.019858 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:55.019858 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 544/1070] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:55.024832 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32f491-e775-4e63-9a23-2bec76bcfcce None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:55.031572 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-8f9d5486-aa25-4b4f-bd80-d8deb43dafb2 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:55.032762 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8f9d5486-aa25-4b4f-bd80-d8deb43dafb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:55.095350 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:55.101508 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 527/1071] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 03:31:55.115840 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:55.122694 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32f491-e775-4e63-9a23-2bec76bcfcce None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:55.123939 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d5486-aa25-4b4f-bd80-d8deb43dafb2 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:55.157293 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0231cc-c9ed-4a1a-b264-7892ddf46bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:55.157952 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0231cc-c9ed-4a1a-b264-7892ddf46bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:55.158241 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0231cc-c9ed-4a1a-b264-7892ddf46bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:55.158549 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0231cc-c9ed-4a1a-b264-7892ddf46bf2 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:55.159272 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0231cc-c9ed-4a1a-b264-7892ddf46bf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:55.159582 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0231cc-c9ed-4a1a-b264-7892ddf46bf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:55.160933 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0231cc-c9ed-4a1a-b264-7892ddf46bf2 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:55.172600 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 545/1072] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:31:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:31:55.178945 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0231cc-c9ed-4a1a-b264-7892ddf46bf2 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:55.222481 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d5486-aa25-4b4f-bd80-d8deb43dafb2 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:55.256735 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453d79e-e422-49bf-bd27-4cbcf0ca9afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:55.257524 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453d79e-e422-49bf-bd27-4cbcf0ca9afb None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:55.257804 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453d79e-e422-49bf-bd27-4cbcf0ca9afb None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:55.258126 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b453d79e-e422-49bf-bd27-4cbcf0ca9afb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:55.268277 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b453d79e-e422-49bf-bd27-4cbcf0ca9afb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:31:55.276077 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-b453d79e-e422-49bf-bd27-4cbcf0ca9afb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:31:55.276077 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:55.276077 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:55.276077 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:55.276077 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:55.276077 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:55.276077 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:55.276077 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:55.276077 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:55.276077 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:55.276077 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:55.276077 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:55.276077 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:31:55.276077 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:31:55.276077 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:31:55.276077 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:31:55.277206 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:31:55.277206 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:31:55.277206 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:31:55.277206 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:31:55.277206 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:55.277206 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:55.277206 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:55.277206 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:55.277206 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:55.277206 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:55.277206 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:55.277206 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:55.277206 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:55.277206 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:55.277206 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:55.277206 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:55.283098 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:55.283098 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:55.283098 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:55.283098 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:55.283098 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:31:55.283098 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:31:55.283098 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:31:55.283098 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:31:55.283098 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:31:55.283098 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:31:55.283098 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:31:55.283098 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:55.283745 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0231cc-c9ed-4a1a-b264-7892ddf46bf2 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:55.283832 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 528/1073] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 03:31:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:31:55.283832 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453d79e-e422-49bf-bd27-4cbcf0ca9afb None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:55.310488 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d2226-36cf-4de0-aea3-1b96bf0c5cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:55.311275 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d2226-36cf-4de0-aea3-1b96bf0c5cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:55.311561 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d2226-36cf-4de0-aea3-1b96bf0c5cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:55.311845 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3d2226-36cf-4de0-aea3-1b96bf0c5cf0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:55.318766 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3d2226-36cf-4de0-aea3-1b96bf0c5cf0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:55.320192 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3d2226-36cf-4de0-aea3-1b96bf0c5cf0 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:55.334297 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-0a3d2226-36cf-4de0-aea3-1b96bf0c5cf0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 03:31:55.334297 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:55.334297 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:55.334297 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:55.334297 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:55.334297 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:55.334297 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:55.334297 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:55.334297 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:55.334297 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:55.334297 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:55.334297 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:55.334297 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 03:31:55.334297 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 03:31:55.334297 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 03:31:55.334297 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 03:31:55.335237 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:55.335237 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:55.335237 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 03:31:55.335237 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:31:55.335237 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 03:31:55.335237 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:31:55.335237 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:55.335237 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:55.335237 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:55.335237 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:55.335237 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:55.335237 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:55.335237 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:55.335237 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:55.335237 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:55.335237 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:55.335237 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:55.335237 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:55.336168 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:55.336168 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:55.336168 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 03:31:55.336168 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 03:31:55.336168 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 03:31:55.336168 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 03:31:55.336168 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 03:31:55.336168 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 03:31:55.336168 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 03:31:55.336168 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:55.336168 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 546/1074] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Jul 21 03:31:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:31:55.341085 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d2226-36cf-4de0-aea3-1b96bf0c5cf0 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:55.345011 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:55.356037 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:55.388982 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b453d79e-e422-49bf-bd27-4cbcf0ca9afb None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:55.422058 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080c210-eeb8-4836-be0d-4e6d7f2fa911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:55.422744 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080c210-eeb8-4836-be0d-4e6d7f2fa911 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:55.423024 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080c210-eeb8-4836-be0d-4e6d7f2fa911 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:55.423300 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c080c210-eeb8-4836-be0d-4e6d7f2fa911 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:55.424043 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c080c210-eeb8-4836-be0d-4e6d7f2fa911 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:55.424348 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c080c210-eeb8-4836-be0d-4e6d7f2fa911 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:55.425718 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c080c210-eeb8-4836-be0d-4e6d7f2fa911 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:55.434044 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 529/1075] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:31:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:31:55.439521 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3d2226-36cf-4de0-aea3-1b96bf0c5cf0 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:55.440302 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080c210-eeb8-4836-be0d-4e6d7f2fa911 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:55.474818 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc6e64-5951-4d06-9eba-d0a4e07e1777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:55.475417 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc6e64-5951-4d06-9eba-d0a4e07e1777 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:55.475702 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc6e64-5951-4d06-9eba-d0a4e07e1777 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:55.476611 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc6e64-5951-4d06-9eba-d0a4e07e1777 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:55.476807 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc6e64-5951-4d06-9eba-d0a4e07e1777 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:55.477121 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc6e64-5951-4d06-9eba-d0a4e07e1777 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:55.478574 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc6e64-5951-4d06-9eba-d0a4e07e1777 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:55.495876 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 547/1076] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Jul 21 03:31:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:31:55.501530 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc6e64-5951-4d06-9eba-d0a4e07e1777 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:55.538917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c080c210-eeb8-4836-be0d-4e6d7f2fa911 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:55.558639 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:55.569279 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:55.573143 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a860e88-77ad-4d2c-8a93-1b01bd17a5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:55.574019 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a860e88-77ad-4d2c-8a93-1b01bd17a5bc None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:55.574381 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a860e88-77ad-4d2c-8a93-1b01bd17a5bc None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:55.574626 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a860e88-77ad-4d2c-8a93-1b01bd17a5bc None admin] PATH_INFO: `/v3/users/66f241414c1e4b89b4344bc925f4a216` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:55.575837 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a860e88-77ad-4d2c-8a93-1b01bd17a5bc None admin] RBAC: Authorizing `identity:get_user(user_id=66f241414c1e4b89b4344bc925f4a216)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:55.577289 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a860e88-77ad-4d2c-8a93-1b01bd17a5bc None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:55.578963 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 530/1077] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:31:55 2022] GET /identity/v3/users/66f241414c1e4b89b4344bc925f4a216 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:31:55.585047 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a860e88-77ad-4d2c-8a93-1b01bd17a5bc None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:55.600226 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc6e64-5951-4d06-9eba-d0a4e07e1777 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:55.632975 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fdadc0-3ac9-40f7-8e45-187f8e378a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:55.633760 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fdadc0-3ac9-40f7-8e45-187f8e378a77 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:55.634041 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fdadc0-3ac9-40f7-8e45-187f8e378a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:55.634320 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fdadc0-3ac9-40f7-8e45-187f8e378a77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:55.644039 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fdadc0-3ac9-40f7-8e45-187f8e378a77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:55.645463 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fdadc0-3ac9-40f7-8e45-187f8e378a77 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:55.663873 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-04fdadc0-3ac9-40f7-8e45-187f8e378a77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:55.663873 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:55.663873 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:55.663873 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:55.663873 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:55.663873 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:55.663873 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:55.663873 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:55.663873 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:55.663873 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:55.663873 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:55.663873 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:55.663873 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:31:55.663873 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:31:55.663873 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:31:55.664951 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:31:55.664951 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:55.664951 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:55.664951 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:55.664951 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:55.664951 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:55.664951 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:55.664951 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:55.664951 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:55.664951 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:55.664951 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:55.664951 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:55.664951 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:55.664951 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:55.664951 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:55.664951 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:55.664951 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:55.666178 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:31:55.666178 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:31:55.666178 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:55.666178 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:55.666178 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 548/1078] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:31:55.670663 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fdadc0-3ac9-40f7-8e45-187f8e378a77 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:55.685905 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a860e88-77ad-4d2c-8a93-1b01bd17a5bc None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:55.720756 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57408d90-c2e8-4a6a-a3d9-6a084d92b2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:55.721612 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57408d90-c2e8-4a6a-a3d9-6a084d92b2c4 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:55.721894 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57408d90-c2e8-4a6a-a3d9-6a084d92b2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:55.722163 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57408d90-c2e8-4a6a-a3d9-6a084d92b2c4 None admin] PATH_INFO: `/v3/projects/52de011febf24e4faa38075e1506d2ae` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:55.723360 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57408d90-c2e8-4a6a-a3d9-6a084d92b2c4 None admin] RBAC: Authorizing `identity:get_project(project_id=52de011febf24e4faa38075e1506d2ae)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:55.725400 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57408d90-c2e8-4a6a-a3d9-6a084d92b2c4 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:55.727207 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 531/1079] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:31:55 2022] GET /identity/v3/projects/52de011febf24e4faa38075e1506d2ae => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:31:55.732713 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57408d90-c2e8-4a6a-a3d9-6a084d92b2c4 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:55.769381 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fdadc0-3ac9-40f7-8e45-187f8e378a77 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:55.785587 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:55.794486 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:55.805304 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87034ee-71ea-43c1-8327-5706ac0a3dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:55.805963 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87034ee-71ea-43c1-8327-5706ac0a3dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:55.806246 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87034ee-71ea-43c1-8327-5706ac0a3dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:55.806550 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87034ee-71ea-43c1-8327-5706ac0a3dd2 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:55.807271 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87034ee-71ea-43c1-8327-5706ac0a3dd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:55.807577 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87034ee-71ea-43c1-8327-5706ac0a3dd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:55.808925 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87034ee-71ea-43c1-8327-5706ac0a3dd2 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:55.820676 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 549/1080] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:31:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:55.826205 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87034ee-71ea-43c1-8327-5706ac0a3dd2 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:55.838197 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57408d90-c2e8-4a6a-a3d9-6a084d92b2c4 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:55.871564 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ce5ba-f31a-4a15-b803-3fe68dd166dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:55.872459 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ce5ba-f31a-4a15-b803-3fe68dd166dc None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:55.872744 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ce5ba-f31a-4a15-b803-3fe68dd166dc None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:55.873021 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ce5ba-f31a-4a15-b803-3fe68dd166dc None admin] PATH_INFO: `/v3/projects/52de011febf24e4faa38075e1506d2ae/users/66f241414c1e4b89b4344bc925f4a216/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:55.874999 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8ce5ba-f31a-4a15-b803-3fe68dd166dc None admin] RBAC: Authorizing `identity:create_grant(project_id=52de011febf24e4faa38075e1506d2ae, user_id=66f241414c1e4b89b4344bc925f4a216, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:55.876435 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8ce5ba-f31a-4a15-b803-3fe68dd166dc None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:55.889377 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 532/1081] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 03:31:55 2022] PUT /identity/v3/projects/52de011febf24e4faa38075e1506d2ae/users/66f241414c1e4b89b4344bc925f4a216/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:31:55.928120 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87034ee-71ea-43c1-8327-5706ac0a3dd2 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:55.964998 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e569150-4d1d-42cb-8b95-56be6206798a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:55.965806 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e569150-4d1d-42cb-8b95-56be6206798a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:55.966089 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e569150-4d1d-42cb-8b95-56be6206798a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:55.966363 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e569150-4d1d-42cb-8b95-56be6206798a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:55.973903 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e569150-4d1d-42cb-8b95-56be6206798a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:55.975392 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e569150-4d1d-42cb-8b95-56be6206798a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:55.990419 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-1e569150-4d1d-42cb-8b95-56be6206798a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:31:55.990419 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:55.990419 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:55.990419 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:55.990419 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:55.990419 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:55.990419 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:55.990419 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:55.990419 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:55.990419 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:55.990419 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:55.990419 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:55.990419 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 03:31:55.990419 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 03:31:55.990419 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 03:31:55.991456 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 03:31:55.991456 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:55.991456 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:55.991456 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:55.991456 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:55.991456 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:55.991456 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:55.991456 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:55.991456 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:55.991456 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:55.991456 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:55.991456 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:55.991456 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:55.991456 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:55.991456 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:55.991456 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:55.991456 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:55.992373 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 03:31:55.992373 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 03:31:55.992373 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 03:31:55.992373 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 03:31:55.992373 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 03:31:55.992373 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 03:31:55.992373 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:31:55.992373 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:55.992373 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 550/1082] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:31:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:31:55.997680 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ce5ba-f31a-4a15-b803-3fe68dd166dc None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:56.105653 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ce5ba-f31a-4a15-b803-3fe68dd166dc None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:56.121164 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:56.139834 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67162ab4-b120-4f41-8bb9-7e97a1773851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:56.140490 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67162ab4-b120-4f41-8bb9-7e97a1773851 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:56.140774 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67162ab4-b120-4f41-8bb9-7e97a1773851 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:56.141048 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67162ab4-b120-4f41-8bb9-7e97a1773851 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:56.141836 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67162ab4-b120-4f41-8bb9-7e97a1773851 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:56.142142 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67162ab4-b120-4f41-8bb9-7e97a1773851 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:56.143597 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67162ab4-b120-4f41-8bb9-7e97a1773851 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:56.156208 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 533/1083] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 03:31:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:56.161955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e569150-4d1d-42cb-8b95-56be6206798a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:56.206369 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:56.259792 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e569150-4d1d-42cb-8b95-56be6206798a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:56.293775 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673f72b6-ea79-41ba-89cb-33b02f41c5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:56.294688 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f72b6-ea79-41ba-89cb-33b02f41c5ed None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:56.294975 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f72b6-ea79-41ba-89cb-33b02f41c5ed None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:56.295251 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673f72b6-ea79-41ba-89cb-33b02f41c5ed None admin] PATH_INFO: `/v3/projects/0432303daa8b4304a8e07032d6a80781/users/cefbe2d0c739428ab0d4dfeaed6c37ab/roles/b6ab65019dfc4679a967f9b3f4a6ffde` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:56.297410 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f72b6-ea79-41ba-89cb-33b02f41c5ed None admin] RBAC: Authorizing `identity:create_grant(project_id=0432303daa8b4304a8e07032d6a80781, user_id=cefbe2d0c739428ab0d4dfeaed6c37ab, role_id=b6ab65019dfc4679a967f9b3f4a6ffde)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:56.298888 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673f72b6-ea79-41ba-89cb-33b02f41c5ed None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:56.313014 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 551/1084] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 03:31:56 2022] PUT /identity/v3/projects/0432303daa8b4304a8e07032d6a80781/users/cefbe2d0c739428ab0d4dfeaed6c37ab/roles/b6ab65019dfc4679a967f9b3f4a6ffde => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:31:57.898749 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100d1e6-e054-4ad1-8a26-bed51a7f1764 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:57.899268 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100d1e6-e054-4ad1-8a26-bed51a7f1764 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:57.899396 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100d1e6-e054-4ad1-8a26-bed51a7f1764 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:57.900659 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 534/1085] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:31:57.905893 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4c084-81cf-44e8-8661-a5b54b60612a None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:57.906273 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4c084-81cf-44e8-8661-a5b54b60612a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:57.906442 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4c084-81cf-44e8-8661-a5b54b60612a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:57.923288 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-c3d4c084-81cf-44e8-8661-a5b54b60612a None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:57.924471 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c3d4c084-81cf-44e8-8661-a5b54b60612a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:57.989147 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 552/1086] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 03:31:58.011903 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6100d1e6-e054-4ad1-8a26-bed51a7f1764 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:58.110950 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6100d1e6-e054-4ad1-8a26-bed51a7f1764 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:58.143014 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151bd331-79dd-4cd6-bfc0-5d6c87c3c3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:58.143806 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bd331-79dd-4cd6-bfc0-5d6c87c3c3b4 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:58.144092 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bd331-79dd-4cd6-bfc0-5d6c87c3c3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:58.144371 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bd331-79dd-4cd6-bfc0-5d6c87c3c3b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:58.155247 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151bd331-79dd-4cd6-bfc0-5d6c87c3c3b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:31:58.163398 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-151bd331-79dd-4cd6-bfc0-5d6c87c3c3b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:31:58.163398 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:58.163398 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:58.163398 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:58.163398 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:58.163398 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:58.163398 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:58.163398 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:58.163398 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:58.163398 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:58.163398 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:58.163398 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:58.163398 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:31:58.163398 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:31:58.163398 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:31:58.163398 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:31:58.164345 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:31:58.164345 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:31:58.164345 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:31:58.164345 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:31:58.164345 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:58.164345 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:58.164345 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:58.164345 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:58.164345 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:58.164345 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:58.164345 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:58.164345 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:58.164345 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:58.164345 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:58.164345 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:58.164345 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:58.165228 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:58.165228 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:58.165228 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:58.165228 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:58.165228 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:31:58.165228 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:31:58.165228 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:31:58.165228 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:31:58.165228 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:31:58.165228 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:31:58.165228 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:31:58.165228 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:58.165228 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 535/1087] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 03:31:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:58.170712 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4c084-81cf-44e8-8661-a5b54b60612a None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:58.203429 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:58.267492 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4c084-81cf-44e8-8661-a5b54b60612a None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:58.300654 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161be2a-202d-423d-a46d-4fa30fb4f840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:58.301314 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161be2a-202d-423d-a46d-4fa30fb4f840 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:58.301598 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161be2a-202d-423d-a46d-4fa30fb4f840 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:58.301870 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161be2a-202d-423d-a46d-4fa30fb4f840 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:58.302643 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161be2a-202d-423d-a46d-4fa30fb4f840 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:58.302949 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161be2a-202d-423d-a46d-4fa30fb4f840 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:58.304304 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161be2a-202d-423d-a46d-4fa30fb4f840 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:58.312339 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 553/1088] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:31:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:58.312565 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d56a5-bece-45de-9890-88f2819dcfc4 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:58.312857 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d56a5-bece-45de-9890-88f2819dcfc4 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:58.313136 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d56a5-bece-45de-9890-88f2819dcfc4 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:58.314620 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 536/1089] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:31:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:31:58.318334 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161be2a-202d-423d-a46d-4fa30fb4f840 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:58.319891 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cecade-34c1-4e7f-8398-04076560c2f5 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:58.320180 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cecade-34c1-4e7f-8398-04076560c2f5 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:58.320464 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cecade-34c1-4e7f-8398-04076560c2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:58.338036 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-a9cecade-34c1-4e7f-8398-04076560c2f5 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:31:58.339260 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a9cecade-34c1-4e7f-8398-04076560c2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:31:58.367062 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:58.405956 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 537/1090] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:31:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 03:31:58.409624 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:58.415850 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161be2a-202d-423d-a46d-4fa30fb4f840 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:58.429137 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cecade-34c1-4e7f-8398-04076560c2f5 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:58.449161 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c44802e-afeb-4caa-8dc3-f1b43675511d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:58.450029 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44802e-afeb-4caa-8dc3-f1b43675511d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:58.450309 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44802e-afeb-4caa-8dc3-f1b43675511d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:58.450617 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44802e-afeb-4caa-8dc3-f1b43675511d None admin] PATH_INFO: `/v3/users/66f241414c1e4b89b4344bc925f4a216` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:58.451806 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c44802e-afeb-4caa-8dc3-f1b43675511d None admin] RBAC: Authorizing `identity:get_user(user_id=66f241414c1e4b89b4344bc925f4a216)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:58.453239 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c44802e-afeb-4caa-8dc3-f1b43675511d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:58.454912 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 554/1091] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:31:58 2022] GET /identity/v3/users/66f241414c1e4b89b4344bc925f4a216 => generated 285 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:58.461112 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c44802e-afeb-4caa-8dc3-f1b43675511d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:58.527560 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cecade-34c1-4e7f-8398-04076560c2f5 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:58.557706 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c44802e-afeb-4caa-8dc3-f1b43675511d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:58.560320 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd1506-8b0d-49be-a489-c905610abd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:58.561127 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd1506-8b0d-49be-a489-c905610abd21 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:58.561407 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd1506-8b0d-49be-a489-c905610abd21 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:58.561677 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd1506-8b0d-49be-a489-c905610abd21 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:58.572341 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd1506-8b0d-49be-a489-c905610abd21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:31:58.580401 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-5efd1506-8b0d-49be-a489-c905610abd21 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 03:31:58.580401 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:58.580401 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:58.580401 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:58.580401 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:58.580401 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:58.580401 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:58.580401 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:58.580401 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:58.580401 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:58.580401 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:58.580401 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:58.580401 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:31:58.580401 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:31:58.580401 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:31:58.580401 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:31:58.581360 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:31:58.581360 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:31:58.581360 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:31:58.581360 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:31:58.581360 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:58.581360 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:58.581360 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:58.581360 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:58.581360 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:58.581360 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:58.581360 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:58.581360 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:58.581360 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:58.581360 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:58.581360 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:58.581360 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:58.582210 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:58.582210 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:58.582210 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:58.582210 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:58.582210 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:31:58.582210 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:31:58.582210 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:31:58.582210 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:31:58.582210 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:31:58.582210 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:31:58.582210 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 03:31:58.582210 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:58.582210 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 538/1092] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Jul 21 03:31:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:31:58.588034 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd1506-8b0d-49be-a489-c905610abd21 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:58.590792 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0bdea-a2d3-4dce-8a21-3e49b78f00ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:58.591433 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0bdea-a2d3-4dce-8a21-3e49b78f00ef None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:58.591715 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0bdea-a2d3-4dce-8a21-3e49b78f00ef None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:58.591991 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0bdea-a2d3-4dce-8a21-3e49b78f00ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:58.613877 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:58.622533 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:58.658975 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0bdea-a2d3-4dce-8a21-3e49b78f00ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:58.660420 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0bdea-a2d3-4dce-8a21-3e49b78f00ef None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:58.685230 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd1506-8b0d-49be-a489-c905610abd21 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:58.722108 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542674d-66a2-4707-ab47-d24b4237b163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:58.722808 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542674d-66a2-4707-ab47-d24b4237b163 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:58.723088 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542674d-66a2-4707-ab47-d24b4237b163 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:58.723373 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e542674d-66a2-4707-ab47-d24b4237b163 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:58.724140 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e542674d-66a2-4707-ab47-d24b4237b163 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:58.724449 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e542674d-66a2-4707-ab47-d24b4237b163 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:58.725823 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e542674d-66a2-4707-ab47-d24b4237b163 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:58.733743 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 539/1093] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Jul 21 03:31:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:31:58.740272 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542674d-66a2-4707-ab47-d24b4237b163 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:58.758352 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 555/1094] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:31:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 03:31:58.764061 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0bdea-a2d3-4dce-8a21-3e49b78f00ef None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:58.825200 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:58.827575 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:58.839942 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e542674d-66a2-4707-ab47-d24b4237b163 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:58.861275 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0bdea-a2d3-4dce-8a21-3e49b78f00ef None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:58.872475 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d82016-2bcd-4f30-8a3d-199395c8af9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:58.873257 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d82016-2bcd-4f30-8a3d-199395c8af9f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:58.873538 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d82016-2bcd-4f30-8a3d-199395c8af9f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:58.873809 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d82016-2bcd-4f30-8a3d-199395c8af9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:58.885294 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d82016-2bcd-4f30-8a3d-199395c8af9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:58.886780 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d82016-2bcd-4f30-8a3d-199395c8af9f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:58.894987 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67d368-601d-45dc-98fe-96cb02dab82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:58.895833 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67d368-601d-45dc-98fe-96cb02dab82a None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:58.896120 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67d368-601d-45dc-98fe-96cb02dab82a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:58.896398 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67d368-601d-45dc-98fe-96cb02dab82a None admin] PATH_INFO: `/v3/projects/52de011febf24e4faa38075e1506d2ae` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:58.897833 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f67d368-601d-45dc-98fe-96cb02dab82a None admin] RBAC: Authorizing `identity:get_project(project_id=52de011febf24e4faa38075e1506d2ae)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:58.899287 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f67d368-601d-45dc-98fe-96cb02dab82a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:58.900969 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 556/1095] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:31:58 2022] GET /identity/v3/projects/52de011febf24e4faa38075e1506d2ae => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:58.904038 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-61d82016-2bcd-4f30-8a3d-199395c8af9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:58.904038 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:58.904038 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:58.904038 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:58.904038 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:58.904038 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:58.904038 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:58.904038 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:58.904038 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:58.904038 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:58.904038 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:58.904038 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:58.904038 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:31:58.904038 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:31:58.904038 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:31:58.905366 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:31:58.905366 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:58.905366 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:58.905366 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:58.905366 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:58.905366 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:58.905366 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:58.905366 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:58.905366 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:58.905366 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:58.905366 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:58.905366 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:58.905366 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:58.905366 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:58.905366 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:58.905366 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:58.905366 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:58.906281 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:31:58.906281 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:31:58.906281 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:58.906281 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:58.906281 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 540/1096] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:31:58.907199 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67d368-601d-45dc-98fe-96cb02dab82a None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:58.910588 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d82016-2bcd-4f30-8a3d-199395c8af9f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:59.005030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67d368-601d-45dc-98fe-96cb02dab82a None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:59.007634 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d82016-2bcd-4f30-8a3d-199395c8af9f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:59.034019 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:59.039980 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b18e6-c84a-4728-ac09-01c7e4f483a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:59.040531 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92b181-2e62-44c4-8f54-66a4a7e0492b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:59.040643 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b18e6-c84a-4728-ac09-01c7e4f483a5 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:59.040894 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b18e6-c84a-4728-ac09-01c7e4f483a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:59.041170 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331b18e6-c84a-4728-ac09-01c7e4f483a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:59.041264 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92b181-2e62-44c4-8f54-66a4a7e0492b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:59.041450 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92b181-2e62-44c4-8f54-66a4a7e0492b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:59.041726 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e92b181-2e62-44c4-8f54-66a4a7e0492b None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:59.041995 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b18e6-c84a-4728-ac09-01c7e4f483a5 None admin] RBAC: Adding query filter params (role.id=27e53d6c56f24c25a8c8057bfd36bcf1, scope.project.id=52de011febf24e4faa38075e1506d2ae, user.id=66f241414c1e4b89b4344bc925f4a216) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:59.042311 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b18e6-c84a-4728-ac09-01c7e4f483a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:59.042436 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e92b181-2e62-44c4-8f54-66a4a7e0492b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:59.042787 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e92b181-2e62-44c4-8f54-66a4a7e0492b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:59.043757 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331b18e6-c84a-4728-ac09-01c7e4f483a5 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:59.044143 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e92b181-2e62-44c4-8f54-66a4a7e0492b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:59.049561 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 557/1097] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:31:58 2022] GET /identity/v3/role_assignments?user.id=66f241414c1e4b89b4344bc925f4a216&scope.project.id=52de011febf24e4faa38075e1506d2ae&role.id=27e53d6c56f24c25a8c8057bfd36bcf1 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:59.054385 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:59.058051 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 541/1098] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:31:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:31:59.063956 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b18e6-c84a-4728-ac09-01c7e4f483a5 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:59.167997 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331b18e6-c84a-4728-ac09-01c7e4f483a5 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:59.203467 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c85f4-ea2c-40d3-bbd2-f794ca0134b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:59.204259 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c85f4-ea2c-40d3-bbd2-f794ca0134b0 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:59.204554 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c85f4-ea2c-40d3-bbd2-f794ca0134b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:59.204831 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143c85f4-ea2c-40d3-bbd2-f794ca0134b0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:59.212644 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143c85f4-ea2c-40d3-bbd2-f794ca0134b0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:59.214076 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143c85f4-ea2c-40d3-bbd2-f794ca0134b0 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:59.228442 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-143c85f4-ea2c-40d3-bbd2-f794ca0134b0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 03:31:59.228442 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:59.228442 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:59.228442 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:59.228442 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:59.228442 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:59.228442 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:59.228442 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:59.228442 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:59.228442 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:59.228442 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:59.228442 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:59.228442 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 03:31:59.228442 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 03:31:59.228442 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 03:31:59.228442 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 03:31:59.229543 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:59.229543 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:59.229543 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 03:31:59.229543 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:31:59.229543 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 03:31:59.229543 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:31:59.229543 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:59.229543 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:59.229543 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:59.229543 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:59.229543 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:59.229543 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:59.229543 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:59.229543 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:59.229543 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:59.229543 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:59.229543 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:59.229543 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:59.231145 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:59.231145 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:59.231145 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 03:31:59.231145 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 03:31:59.231145 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 03:31:59.231145 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 03:31:59.231145 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 03:31:59.231145 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 03:31:59.231145 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 03:31:59.231145 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:31:59.231145 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 558/1099] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Jul 21 03:31:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:31:59.236087 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92b181-2e62-44c4-8f54-66a4a7e0492b None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:59.338902 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e92b181-2e62-44c4-8f54-66a4a7e0492b None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:59.372851 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec94ae6-37c8-4d8c-9b67-c499b3d7e58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:59.373528 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec94ae6-37c8-4d8c-9b67-c499b3d7e58a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:59.373816 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec94ae6-37c8-4d8c-9b67-c499b3d7e58a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:59.374098 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec94ae6-37c8-4d8c-9b67-c499b3d7e58a None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:59.374977 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec94ae6-37c8-4d8c-9b67-c499b3d7e58a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:31:59.375294 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec94ae6-37c8-4d8c-9b67-c499b3d7e58a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:59.376724 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec94ae6-37c8-4d8c-9b67-c499b3d7e58a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:59.393739 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 542/1100] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Jul 21 03:31:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:31:59.400423 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c85f4-ea2c-40d3-bbd2-f794ca0134b0 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:59.455191 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:59.500472 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143c85f4-ea2c-40d3-bbd2-f794ca0134b0 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:59.533409 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc6112-7841-4178-9a40-ff773689fd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:59.534064 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc6112-7841-4178-9a40-ff773689fd85 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:59.534355 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc6112-7841-4178-9a40-ff773689fd85 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:59.534678 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc6112-7841-4178-9a40-ff773689fd85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:59.601834 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc6112-7841-4178-9a40-ff773689fd85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:59.603337 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc6112-7841-4178-9a40-ff773689fd85 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:59.656430 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:59.702057 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 559/1101] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:31:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 03:31:59.708166 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec94ae6-37c8-4d8c-9b67-c499b3d7e58a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:59.765792 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:31:59.807149 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec94ae6-37c8-4d8c-9b67-c499b3d7e58a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:31:59.840718 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c2919-7a05-4ba1-b578-ad015b7db35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:31:59.841500 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c2919-7a05-4ba1-b578-ad015b7db35f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:31:59.841785 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c2919-7a05-4ba1-b578-ad015b7db35f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:31:59.842057 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c2919-7a05-4ba1-b578-ad015b7db35f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:31:59.851767 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2c2919-7a05-4ba1-b578-ad015b7db35f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:31:59.853213 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2c2919-7a05-4ba1-b578-ad015b7db35f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:31:59.870047 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-6b2c2919-7a05-4ba1-b578-ad015b7db35f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:59.870047 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:31:59.870047 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:31:59.870047 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:31:59.870047 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:31:59.870047 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:31:59.870047 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:31:59.870047 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:31:59.870047 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:31:59.870047 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:31:59.870047 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:31:59.870047 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:31:59.870047 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:31:59.870047 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:31:59.870047 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:31:59.871093 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:31:59.871093 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:31:59.871093 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:31:59.871093 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:31:59.871093 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:31:59.871093 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:31:59.871093 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:31:59.871093 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:31:59.871093 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:31:59.871093 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:31:59.871093 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:31:59.871093 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:31:59.871093 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:31:59.871093 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:31:59.871093 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:31:59.871093 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:31:59.871093 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:31:59.872150 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:31:59.872150 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:31:59.872150 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:31:59.872150 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:31:59.872150 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 543/1102] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:31:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:31:59.877062 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc6112-7841-4178-9a40-ff773689fd85 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:31:59.972507 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc6112-7841-4178-9a40-ff773689fd85 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:00.003916 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b3d258-314b-407c-ad73-d13368a83db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:00.004558 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3d258-314b-407c-ad73-d13368a83db0 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:00.004838 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3d258-314b-407c-ad73-d13368a83db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:00.005621 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3d258-314b-407c-ad73-d13368a83db0 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:00.006329 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b3d258-314b-407c-ad73-d13368a83db0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:32:00.006671 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b3d258-314b-407c-ad73-d13368a83db0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:00.008013 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b3d258-314b-407c-ad73-d13368a83db0 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:00.018838 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 560/1103] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:31:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:32:00.025176 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c2919-7a05-4ba1-b578-ad015b7db35f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:00.128727 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c2919-7a05-4ba1-b578-ad015b7db35f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:00.140400 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:00.164690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a59c10c-014f-4a6c-963a-9dc6288cae54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:00.165487 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59c10c-014f-4a6c-963a-9dc6288cae54 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:00.165772 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59c10c-014f-4a6c-963a-9dc6288cae54 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:00.166048 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59c10c-014f-4a6c-963a-9dc6288cae54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:00.173485 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a59c10c-014f-4a6c-963a-9dc6288cae54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:00.175008 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a59c10c-014f-4a6c-963a-9dc6288cae54 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:00.189935 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-6a59c10c-014f-4a6c-963a-9dc6288cae54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:32:00.189935 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:32:00.189935 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:32:00.189935 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:32:00.189935 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:32:00.189935 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:32:00.189935 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:32:00.189935 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:32:00.189935 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:32:00.189935 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:32:00.189935 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:32:00.189935 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:32:00.189935 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 03:32:00.189935 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 03:32:00.189935 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 03:32:00.190937 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 03:32:00.190937 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:32:00.190937 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:32:00.190937 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:32:00.190937 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:32:00.190937 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:32:00.190937 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:32:00.190937 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:32:00.190937 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:32:00.190937 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:32:00.190937 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:32:00.190937 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:32:00.190937 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:32:00.190937 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:32:00.190937 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:32:00.190937 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:32:00.190937 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:32:00.191831 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 03:32:00.191831 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 03:32:00.191831 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 03:32:00.191831 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 03:32:00.191831 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 03:32:00.191831 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 03:32:00.191831 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:32:00.191831 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:32:00.191831 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 544/1104] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:32:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:32:00.197589 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b3d258-314b-407c-ad73-d13368a83db0 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:00.215582 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:00.294391 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b3d258-314b-407c-ad73-d13368a83db0 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:00.326901 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d5ce7-1ad5-4e3c-9ffd-83a12e116f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:00.327548 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d5ce7-1ad5-4e3c-9ffd-83a12e116f93 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:00.327827 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d5ce7-1ad5-4e3c-9ffd-83a12e116f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:00.328098 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d5ce7-1ad5-4e3c-9ffd-83a12e116f93 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:00.328874 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d5ce7-1ad5-4e3c-9ffd-83a12e116f93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:32:00.329183 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d5ce7-1ad5-4e3c-9ffd-83a12e116f93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:00.330628 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d5ce7-1ad5-4e3c-9ffd-83a12e116f93 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:00.342117 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 561/1105] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 03:32:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:32:00.348056 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a59c10c-014f-4a6c-963a-9dc6288cae54 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:00.445433 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a59c10c-014f-4a6c-963a-9dc6288cae54 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:00.478064 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e774b1-6adf-4b8b-a432-9f23c7a70005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:00.478748 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e774b1-6adf-4b8b-a432-9f23c7a70005 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:00.479029 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e774b1-6adf-4b8b-a432-9f23c7a70005 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:00.479304 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e774b1-6adf-4b8b-a432-9f23c7a70005 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:00.480130 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e774b1-6adf-4b8b-a432-9f23c7a70005 None admin] RBAC: Adding query filter params (role.id=b6ab65019dfc4679a967f9b3f4a6ffde, scope.project.id=0432303daa8b4304a8e07032d6a80781, user.id=cefbe2d0c739428ab0d4dfeaed6c37ab) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:32:00.480441 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e774b1-6adf-4b8b-a432-9f23c7a70005 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:00.481859 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e774b1-6adf-4b8b-a432-9f23c7a70005 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:00.487647 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 545/1106] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:32:00 2022] GET /identity/v3/role_assignments?user.id=cefbe2d0c739428ab0d4dfeaed6c37ab&scope.project.id=0432303daa8b4304a8e07032d6a80781&role.id=b6ab65019dfc4679a967f9b3f4a6ffde => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:32:01.115123 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933cd2c-5d3f-4525-8006-3b9cf2db5d4c None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:01.115742 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933cd2c-5d3f-4525-8006-3b9cf2db5d4c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:01.115742 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933cd2c-5d3f-4525-8006-3b9cf2db5d4c None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:01.117036 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 562/1107] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:32:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:32:01.122499 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482cb83d-dddb-47d4-9247-5c342ee36479 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:01.122999 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482cb83d-dddb-47d4-9247-5c342ee36479 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:01.123501 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482cb83d-dddb-47d4-9247-5c342ee36479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:01.140199 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-482cb83d-dddb-47d4-9247-5c342ee36479 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:32:01.141382 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-482cb83d-dddb-47d4-9247-5c342ee36479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:32:01.172168 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:01.214975 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 546/1108] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:32:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 03:32:01.239919 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933cd2c-5d3f-4525-8006-3b9cf2db5d4c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:01.318252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:01.341640 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933cd2c-5d3f-4525-8006-3b9cf2db5d4c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:01.373453 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f669b-839a-4112-9280-26c072d05954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:01.374183 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f669b-839a-4112-9280-26c072d05954 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:01.374480 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f669b-839a-4112-9280-26c072d05954 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:01.374776 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f669b-839a-4112-9280-26c072d05954 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:01.375969 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5f669b-839a-4112-9280-26c072d05954 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:01.377393 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5f669b-839a-4112-9280-26c072d05954 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:01.379048 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 563/1109] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:32:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:32:01.385253 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482cb83d-dddb-47d4-9247-5c342ee36479 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:01.482351 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482cb83d-dddb-47d4-9247-5c342ee36479 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:01.515009 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c394ceb1-480c-411d-8a48-f8b5ad975fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:01.515672 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394ceb1-480c-411d-8a48-f8b5ad975fa4 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:01.515953 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394ceb1-480c-411d-8a48-f8b5ad975fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:01.516228 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394ceb1-480c-411d-8a48-f8b5ad975fa4 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:01.516944 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c394ceb1-480c-411d-8a48-f8b5ad975fa4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:01.518367 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c394ceb1-480c-411d-8a48-f8b5ad975fa4 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:01.537695 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 547/1110] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jul 21 03:32:01 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:32:03.580084 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f526a-c420-4058-bdee-b416f5a9a3ac None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:03.580634 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f526a-c420-4058-bdee-b416f5a9a3ac None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:03.580634 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f526a-c420-4058-bdee-b416f5a9a3ac None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:03.582000 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 564/1111] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:32:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:32:03.587284 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162b189-c199-44a8-9179-2208e717a429 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:03.587684 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162b189-c199-44a8-9179-2208e717a429 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:03.587848 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7162b189-c199-44a8-9179-2208e717a429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:03.605023 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-7162b189-c199-44a8-9179-2208e717a429 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:32:03.606207 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7162b189-c199-44a8-9179-2208e717a429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:32:03.620482 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:03.672235 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 548/1112] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:32:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 03:32:03.696052 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f526a-c420-4058-bdee-b416f5a9a3ac None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:03.794537 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f526a-c420-4058-bdee-b416f5a9a3ac None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:03.827382 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce52f7-324c-4d0f-8107-8debe90f91f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:03.828223 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce52f7-324c-4d0f-8107-8debe90f91f2 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:03.828510 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce52f7-324c-4d0f-8107-8debe90f91f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:03.828790 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ce52f7-324c-4d0f-8107-8debe90f91f2 None admin] PATH_INFO: `/v3/roles/76578c4e1dbb4559b293fb93830ed5b2` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:03.830319 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ce52f7-324c-4d0f-8107-8debe90f91f2 None admin] RBAC: Authorizing `identity:get_role(role_id=76578c4e1dbb4559b293fb93830ed5b2)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:03.831655 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ce52f7-324c-4d0f-8107-8debe90f91f2 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:03.833030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 565/1113] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:32:03 2022] GET /identity/v3/roles/76578c4e1dbb4559b293fb93830ed5b2 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:32:03.839283 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7162b189-c199-44a8-9179-2208e717a429 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:03.933545 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7162b189-c199-44a8-9179-2208e717a429 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:03.965674 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2a62e-099b-4f4b-bf30-526f57325e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:03.966555 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2a62e-099b-4f4b-bf30-526f57325e70 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:03.966837 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2a62e-099b-4f4b-bf30-526f57325e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:03.967110 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2a62e-099b-4f4b-bf30-526f57325e70 None admin] PATH_INFO: `/v3/users/0b269e3759ef4d82abaecc459fcb80da` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:03.980177 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb2a62e-099b-4f4b-bf30-526f57325e70 None admin] RBAC: Authorizing `identity:get_user(user_id=0b269e3759ef4d82abaecc459fcb80da)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:03.981615 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb2a62e-099b-4f4b-bf30-526f57325e70 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:03.983242 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 549/1114] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:32:03 2022] GET /identity/v3/users/0b269e3759ef4d82abaecc459fcb80da => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:32:03.989091 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce52f7-324c-4d0f-8107-8debe90f91f2 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:04.003438 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:04.085467 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ce52f7-324c-4d0f-8107-8debe90f91f2 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:04.117818 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b8f06-8070-4f2b-a3fc-e2f80b9a72fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:04.118498 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b8f06-8070-4f2b-a3fc-e2f80b9a72fc None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:04.118768 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b8f06-8070-4f2b-a3fc-e2f80b9a72fc None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:04.119045 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b8f06-8070-4f2b-a3fc-e2f80b9a72fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:04.184750 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b8f06-8070-4f2b-a3fc-e2f80b9a72fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:04.186197 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014b8f06-8070-4f2b-a3fc-e2f80b9a72fc None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:04.200449 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:04.281982 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 566/1115] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:32:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 03:32:04.287803 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2a62e-099b-4f4b-bf30-526f57325e70 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:04.298277 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:04.384836 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2a62e-099b-4f4b-bf30-526f57325e70 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:04.417815 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4828f5ca-d115-448a-87a7-97e5a2917e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:04.418693 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828f5ca-d115-448a-87a7-97e5a2917e75 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:04.418979 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828f5ca-d115-448a-87a7-97e5a2917e75 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:04.419255 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828f5ca-d115-448a-87a7-97e5a2917e75 None admin] PATH_INFO: `/v3/projects/52de011febf24e4faa38075e1506d2ae` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:04.420433 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4828f5ca-d115-448a-87a7-97e5a2917e75 None admin] RBAC: Authorizing `identity:get_project(project_id=52de011febf24e4faa38075e1506d2ae)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:04.421885 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4828f5ca-d115-448a-87a7-97e5a2917e75 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:04.423594 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 550/1116] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:32:04 2022] GET /identity/v3/projects/52de011febf24e4faa38075e1506d2ae => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:32:04.430477 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b8f06-8070-4f2b-a3fc-e2f80b9a72fc None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:04.529559 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b8f06-8070-4f2b-a3fc-e2f80b9a72fc None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:04.542065 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:04.562394 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e555c147-6b09-476d-a757-f2331b9d1dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:04.563068 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555c147-6b09-476d-a757-f2331b9d1dec None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:04.563353 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555c147-6b09-476d-a757-f2331b9d1dec None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:04.563631 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e555c147-6b09-476d-a757-f2331b9d1dec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:04.564458 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e555c147-6b09-476d-a757-f2331b9d1dec None admin] RBAC: Adding query filter params (role.id=76578c4e1dbb4559b293fb93830ed5b2, scope.project.id=52de011febf24e4faa38075e1506d2ae, user.id=0b269e3759ef4d82abaecc459fcb80da) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:32:04.564770 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e555c147-6b09-476d-a757-f2331b9d1dec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:04.566176 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e555c147-6b09-476d-a757-f2331b9d1dec None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:04.571987 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 567/1117] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:32:04 2022] GET /identity/v3/role_assignments?user.id=0b269e3759ef4d82abaecc459fcb80da&scope.project.id=52de011febf24e4faa38075e1506d2ae&role.id=76578c4e1dbb4559b293fb93830ed5b2 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:32:06.543742 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f61c45-e889-4a2d-b662-39e0a3efe75b None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:06.544301 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f61c45-e889-4a2d-b662-39e0a3efe75b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:06.544301 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f61c45-e889-4a2d-b662-39e0a3efe75b None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:06.545645 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 551/1118] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:32:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:32:06.550694 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b689bc5-9e95-49dc-ab9e-e7c1343b4363 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:06.551076 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b689bc5-9e95-49dc-ab9e-e7c1343b4363 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:06.551251 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b689bc5-9e95-49dc-ab9e-e7c1343b4363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:06.568080 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-7b689bc5-9e95-49dc-ab9e-e7c1343b4363 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:32:06.569255 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7b689bc5-9e95-49dc-ab9e-e7c1343b4363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:32:06.632820 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 568/1119] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:32:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 03:32:06.655216 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f61c45-e889-4a2d-b662-39e0a3efe75b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:06.730414 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:06.754102 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f61c45-e889-4a2d-b662-39e0a3efe75b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:06.786821 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b15f5-7f60-419f-a79b-da223a6e0599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:06.787664 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b15f5-7f60-419f-a79b-da223a6e0599 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:06.787949 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b15f5-7f60-419f-a79b-da223a6e0599 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:06.788220 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408b15f5-7f60-419f-a79b-da223a6e0599 None admin] PATH_INFO: `/v3/roles/76578c4e1dbb4559b293fb93830ed5b2` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:06.789667 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b15f5-7f60-419f-a79b-da223a6e0599 None admin] RBAC: Authorizing `identity:get_role(role_id=76578c4e1dbb4559b293fb93830ed5b2)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:06.791064 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408b15f5-7f60-419f-a79b-da223a6e0599 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:06.792401 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 552/1120] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:32:06 2022] GET /identity/v3/roles/76578c4e1dbb4559b293fb93830ed5b2 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:32:06.798220 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b689bc5-9e95-49dc-ab9e-e7c1343b4363 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:06.893187 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b689bc5-9e95-49dc-ab9e-e7c1343b4363 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:06.901067 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:06.927250 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cce537-ff42-4bf6-ae5d-b51b371babd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:06.928110 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cce537-ff42-4bf6-ae5d-b51b371babd6 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:06.928392 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cce537-ff42-4bf6-ae5d-b51b371babd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:06.928667 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cce537-ff42-4bf6-ae5d-b51b371babd6 None admin] PATH_INFO: `/v3/users/0b269e3759ef4d82abaecc459fcb80da` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:06.929843 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cce537-ff42-4bf6-ae5d-b51b371babd6 None admin] RBAC: Authorizing `identity:get_user(user_id=0b269e3759ef4d82abaecc459fcb80da)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:06.931312 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cce537-ff42-4bf6-ae5d-b51b371babd6 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:06.932924 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 569/1121] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:32:06 2022] GET /identity/v3/users/0b269e3759ef4d82abaecc459fcb80da => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:32:06.938648 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b15f5-7f60-419f-a79b-da223a6e0599 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:07.033162 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408b15f5-7f60-419f-a79b-da223a6e0599 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:07.066242 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f5b39-590b-46d4-a648-5e2188f64bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:07.067050 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f5b39-590b-46d4-a648-5e2188f64bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:07.067330 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f5b39-590b-46d4-a648-5e2188f64bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:07.067623 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f5b39-590b-46d4-a648-5e2188f64bd6 None admin] PATH_INFO: `/v3/projects/52de011febf24e4faa38075e1506d2ae` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:07.068771 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f5b39-590b-46d4-a648-5e2188f64bd6 None admin] RBAC: Authorizing `identity:get_project(project_id=52de011febf24e4faa38075e1506d2ae)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:07.070188 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002f5b39-590b-46d4-a648-5e2188f64bd6 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:07.071849 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 553/1122] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:32:06 2022] GET /identity/v3/projects/52de011febf24e4faa38075e1506d2ae => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:32:07.077604 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cce537-ff42-4bf6-ae5d-b51b371babd6 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:07.173834 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cce537-ff42-4bf6-ae5d-b51b371babd6 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:07.206395 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513c9116-7dcf-46a7-afe9-e29ad0f5732c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:07.207293 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c9116-7dcf-46a7-afe9-e29ad0f5732c None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:07.207576 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c9116-7dcf-46a7-afe9-e29ad0f5732c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:07.207853 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513c9116-7dcf-46a7-afe9-e29ad0f5732c None admin] PATH_INFO: `/v3/projects/52de011febf24e4faa38075e1506d2ae/users/0b269e3759ef4d82abaecc459fcb80da/roles/76578c4e1dbb4559b293fb93830ed5b2` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:07.210690 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c9116-7dcf-46a7-afe9-e29ad0f5732c None admin] RBAC: Authorizing `identity:create_grant(project_id=52de011febf24e4faa38075e1506d2ae, user_id=0b269e3759ef4d82abaecc459fcb80da, role_id=76578c4e1dbb4559b293fb93830ed5b2)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:07.212098 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513c9116-7dcf-46a7-afe9-e29ad0f5732c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:07.224119 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 570/1123] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 03:32:07 2022] PUT /identity/v3/projects/52de011febf24e4faa38075e1506d2ae/users/0b269e3759ef4d82abaecc459fcb80da/roles/76578c4e1dbb4559b293fb93830ed5b2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:32:09.236373 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fa341-f6b8-43ab-986a-73c1fe25fba6 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:09.236900 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fa341-f6b8-43ab-986a-73c1fe25fba6 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:09.236987 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fa341-f6b8-43ab-986a-73c1fe25fba6 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:09.238284 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 554/1124] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:32:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:32:09.243876 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e906153-e957-4a86-9391-c053f42de82c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:09.244314 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e906153-e957-4a86-9391-c053f42de82c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:09.244410 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e906153-e957-4a86-9391-c053f42de82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:09.261193 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-9e906153-e957-4a86-9391-c053f42de82c None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:32:09.262356 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9e906153-e957-4a86-9391-c053f42de82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:32:09.289544 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:09.330079 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 571/1125] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:32:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 03:32:09.353699 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fa341-f6b8-43ab-986a-73c1fe25fba6 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:09.368571 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:09.452760 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fa341-f6b8-43ab-986a-73c1fe25fba6 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:09.488346 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1dedc2-158b-48a4-8a3a-d0b79e77eb48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:09.490179 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1dedc2-158b-48a4-8a3a-d0b79e77eb48 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:09.490635 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1dedc2-158b-48a4-8a3a-d0b79e77eb48 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:09.491053 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1dedc2-158b-48a4-8a3a-d0b79e77eb48 None admin] PATH_INFO: `/v3/roles/76578c4e1dbb4559b293fb93830ed5b2` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:09.493213 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1dedc2-158b-48a4-8a3a-d0b79e77eb48 None admin] RBAC: Authorizing `identity:get_role(role_id=76578c4e1dbb4559b293fb93830ed5b2)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:09.495358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1dedc2-158b-48a4-8a3a-d0b79e77eb48 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:09.497531 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 555/1126] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:32:09 2022] GET /identity/v3/roles/76578c4e1dbb4559b293fb93830ed5b2 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:32:09.503308 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e906153-e957-4a86-9391-c053f42de82c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:09.604497 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e906153-e957-4a86-9391-c053f42de82c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:09.637140 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f193f2-7d3c-4e7f-874e-a524bf1ceb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:09.638006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f193f2-7d3c-4e7f-874e-a524bf1ceb85 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:09.638290 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f193f2-7d3c-4e7f-874e-a524bf1ceb85 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:09.638596 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f193f2-7d3c-4e7f-874e-a524bf1ceb85 None admin] PATH_INFO: `/v3/users/0b269e3759ef4d82abaecc459fcb80da` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:09.639783 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f193f2-7d3c-4e7f-874e-a524bf1ceb85 None admin] RBAC: Authorizing `identity:get_user(user_id=0b269e3759ef4d82abaecc459fcb80da)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:09.641208 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f193f2-7d3c-4e7f-874e-a524bf1ceb85 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:09.642876 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 572/1127] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:32:09 2022] GET /identity/v3/users/0b269e3759ef4d82abaecc459fcb80da => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:32:09.648907 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1dedc2-158b-48a4-8a3a-d0b79e77eb48 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:09.726973 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:09.746131 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1dedc2-158b-48a4-8a3a-d0b79e77eb48 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:09.778670 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaca80a-5a7a-4bf3-9398-15690bd5fd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:09.779318 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaca80a-5a7a-4bf3-9398-15690bd5fd14 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:09.779604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaca80a-5a7a-4bf3-9398-15690bd5fd14 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:09.779885 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaca80a-5a7a-4bf3-9398-15690bd5fd14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:09.844494 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaca80a-5a7a-4bf3-9398-15690bd5fd14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:09.845927 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaca80a-5a7a-4bf3-9398-15690bd5fd14 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:09.921452 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:09.940365 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 556/1128] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:32:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 03:32:09.946231 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f193f2-7d3c-4e7f-874e-a524bf1ceb85 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:09.976644 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:10.042158 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f193f2-7d3c-4e7f-874e-a524bf1ceb85 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:10.073460 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd531c8-1910-40c9-94f7-f6699a4b0e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:10.074290 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd531c8-1910-40c9-94f7-f6699a4b0e86 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:10.074603 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd531c8-1910-40c9-94f7-f6699a4b0e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:10.074877 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd531c8-1910-40c9-94f7-f6699a4b0e86 None admin] PATH_INFO: `/v3/projects/52de011febf24e4faa38075e1506d2ae` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:10.076022 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd531c8-1910-40c9-94f7-f6699a4b0e86 None admin] RBAC: Authorizing `identity:get_project(project_id=52de011febf24e4faa38075e1506d2ae)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:10.077468 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd531c8-1910-40c9-94f7-f6699a4b0e86 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:10.079159 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 573/1129] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:32:09 2022] GET /identity/v3/projects/52de011febf24e4faa38075e1506d2ae => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:32:10.085616 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaca80a-5a7a-4bf3-9398-15690bd5fd14 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:10.182035 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaca80a-5a7a-4bf3-9398-15690bd5fd14 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:10.215240 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de699e57-a894-4fa7-a9e2-d231fc58892a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:10.215877 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de699e57-a894-4fa7-a9e2-d231fc58892a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:10.216160 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de699e57-a894-4fa7-a9e2-d231fc58892a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:10.216434 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de699e57-a894-4fa7-a9e2-d231fc58892a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:10.217256 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de699e57-a894-4fa7-a9e2-d231fc58892a None admin] RBAC: Adding query filter params (role.id=76578c4e1dbb4559b293fb93830ed5b2, scope.project.id=52de011febf24e4faa38075e1506d2ae, user.id=0b269e3759ef4d82abaecc459fcb80da) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:32:10.217563 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de699e57-a894-4fa7-a9e2-d231fc58892a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:10.219024 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de699e57-a894-4fa7-a9e2-d231fc58892a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:10.224706 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 557/1130] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:32:10 2022] GET /identity/v3/role_assignments?user.id=0b269e3759ef4d82abaecc459fcb80da&scope.project.id=52de011febf24e4faa38075e1506d2ae&role.id=76578c4e1dbb4559b293fb93830ed5b2 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:32:12.245755 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3819fa-9c05-4a77-a56a-394ed726e451 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:12.246306 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3819fa-9c05-4a77-a56a-394ed726e451 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:12.246306 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3819fa-9c05-4a77-a56a-394ed726e451 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:12.247719 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 574/1131] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:32:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:32:12.252911 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a590c-5600-4659-a6b2-274736f1b683 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:12.253324 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a590c-5600-4659-a6b2-274736f1b683 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:12.253475 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1a590c-5600-4659-a6b2-274736f1b683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:12.270363 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-0f1a590c-5600-4659-a6b2-274736f1b683 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:32:12.271577 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0f1a590c-5600-4659-a6b2-274736f1b683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:32:12.309928 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:12.335961 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 558/1132] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:32:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 03:32:12.358884 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3819fa-9c05-4a77-a56a-394ed726e451 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:12.454382 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:12.458261 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3819fa-9c05-4a77-a56a-394ed726e451 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:12.491801 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa103532-94a2-41b8-8b36-e0cdc154e1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:12.492579 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa103532-94a2-41b8-8b36-e0cdc154e1b7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:12.492859 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa103532-94a2-41b8-8b36-e0cdc154e1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:12.493128 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa103532-94a2-41b8-8b36-e0cdc154e1b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:12.494282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa103532-94a2-41b8-8b36-e0cdc154e1b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:12.495718 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa103532-94a2-41b8-8b36-e0cdc154e1b7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:12.497354 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 575/1133] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:32:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:32:12.503170 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a590c-5600-4659-a6b2-274736f1b683 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:12.599691 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1a590c-5600-4659-a6b2-274736f1b683 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:12.632307 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40a3256-72e1-4974-8405-5eae3f869284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:12.632958 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a3256-72e1-4974-8405-5eae3f869284 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:12.633245 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a3256-72e1-4974-8405-5eae3f869284 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:12.633526 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40a3256-72e1-4974-8405-5eae3f869284 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:12.634239 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40a3256-72e1-4974-8405-5eae3f869284 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:12.635712 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40a3256-72e1-4974-8405-5eae3f869284 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:12.660827 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 559/1134] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jul 21 03:32:12 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:32:14.708682 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4871c9-00b2-4c6c-972f-5a340620c47d None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:14.709211 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4871c9-00b2-4c6c-972f-5a340620c47d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:14.709211 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4871c9-00b2-4c6c-972f-5a340620c47d None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:14.710624 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 576/1135] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:32:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:32:14.715976 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01790268-272e-4980-a3ec-f17fdb8a2c85 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:14.716380 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01790268-272e-4980-a3ec-f17fdb8a2c85 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:14.716538 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01790268-272e-4980-a3ec-f17fdb8a2c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:14.732875 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-01790268-272e-4980-a3ec-f17fdb8a2c85 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:32:14.734054 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-01790268-272e-4980-a3ec-f17fdb8a2c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:32:14.753376 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:14.800009 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 560/1136] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:32:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 03:32:14.825098 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4871c9-00b2-4c6c-972f-5a340620c47d None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:14.921669 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4871c9-00b2-4c6c-972f-5a340620c47d None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:14.953960 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da661950-93c2-4635-ac48-f9fafcede32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:14.954760 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da661950-93c2-4635-ac48-f9fafcede32c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:14.955047 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da661950-93c2-4635-ac48-f9fafcede32c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:14.955324 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da661950-93c2-4635-ac48-f9fafcede32c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:14.956489 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da661950-93c2-4635-ac48-f9fafcede32c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:14.958526 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da661950-93c2-4635-ac48-f9fafcede32c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:14.960172 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 577/1137] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:32:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:32:14.965590 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01790268-272e-4980-a3ec-f17fdb8a2c85 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:15.059537 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01790268-272e-4980-a3ec-f17fdb8a2c85 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:15.092504 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e3db5-fa5c-481f-a324-5e3164fba056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:15.093157 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e3db5-fa5c-481f-a324-5e3164fba056 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:15.093444 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e3db5-fa5c-481f-a324-5e3164fba056 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:15.093719 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e3db5-fa5c-481f-a324-5e3164fba056 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:15.094418 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e3db5-fa5c-481f-a324-5e3164fba056 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:15.095867 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e3db5-fa5c-481f-a324-5e3164fba056 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:15.115009 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 561/1138] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jul 21 03:32:14 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:32:17.150261 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a942001-e13f-487f-981e-ecda9343251e None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:17.150838 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a942001-e13f-487f-981e-ecda9343251e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:17.150838 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a942001-e13f-487f-981e-ecda9343251e None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:17.152218 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 578/1139] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:32:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:32:17.157294 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b07885-dccc-4208-bdef-c014ce4b63c7 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:17.157728 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b07885-dccc-4208-bdef-c014ce4b63c7 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:17.157831 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b07885-dccc-4208-bdef-c014ce4b63c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:17.174582 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d5b07885-dccc-4208-bdef-c014ce4b63c7 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:32:17.175753 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d5b07885-dccc-4208-bdef-c014ce4b63c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:32:17.183381 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:17.240965 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 562/1140] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:32:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 03:32:17.263691 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a942001-e13f-487f-981e-ecda9343251e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:17.298683 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:17.364087 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a942001-e13f-487f-981e-ecda9343251e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:17.396608 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1c75c-82f7-40fe-9a0a-0f035052a580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:17.397654 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1c75c-82f7-40fe-9a0a-0f035052a580 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:17.397949 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1c75c-82f7-40fe-9a0a-0f035052a580 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:17.398226 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1c75c-82f7-40fe-9a0a-0f035052a580 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:17.408306 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1c75c-82f7-40fe-9a0a-0f035052a580 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:32:17.416486 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-cbc1c75c-82f7-40fe-9a0a-0f035052a580 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:32:17.416486 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:32:17.416486 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:32:17.416486 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:32:17.416486 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:32:17.416486 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:32:17.416486 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:32:17.416486 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:32:17.416486 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:32:17.416486 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:32:17.416486 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:32:17.416486 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:32:17.416486 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:32:17.416486 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:32:17.416486 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:32:17.416486 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:32:17.417642 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:32:17.417642 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:32:17.417642 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:32:17.417642 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:32:17.417642 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:32:17.417642 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:32:17.417642 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:32:17.417642 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:32:17.417642 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:32:17.417642 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:32:17.417642 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:32:17.417642 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:32:17.417642 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:32:17.417642 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:32:17.417642 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:32:17.417642 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:32:17.418920 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:32:17.418920 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:32:17.418920 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:32:17.418920 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:32:17.418920 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:32:17.418920 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:32:17.418920 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:32:17.418920 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:32:17.418920 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:32:17.418920 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:32:17.418920 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:32:17.418920 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:32:17.418920 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 579/1141] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 03:32:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:32:17.423632 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b07885-dccc-4208-bdef-c014ce4b63c7 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:17.518337 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b07885-dccc-4208-bdef-c014ce4b63c7 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:17.552050 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10109597-b0d4-4cae-bcd5-2db6f851bcbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:17.552702 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10109597-b0d4-4cae-bcd5-2db6f851bcbc None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:17.552987 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10109597-b0d4-4cae-bcd5-2db6f851bcbc None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:17.553265 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10109597-b0d4-4cae-bcd5-2db6f851bcbc None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:17.554009 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10109597-b0d4-4cae-bcd5-2db6f851bcbc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:32:17.554315 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10109597-b0d4-4cae-bcd5-2db6f851bcbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:17.555727 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10109597-b0d4-4cae-bcd5-2db6f851bcbc None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:17.563542 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 563/1142] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:32:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:32:17.569023 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1c75c-82f7-40fe-9a0a-0f035052a580 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:17.660410 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:17.667137 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1c75c-82f7-40fe-9a0a-0f035052a580 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:17.699790 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa9c6a-1384-427d-a66e-841c3ccc14c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:17.700650 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa9c6a-1384-427d-a66e-841c3ccc14c7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:17.700936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa9c6a-1384-427d-a66e-841c3ccc14c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:17.701213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa9c6a-1384-427d-a66e-841c3ccc14c7 None admin] PATH_INFO: `/v3/users/2d3f8f5664cc4ae885d553a3051beb41` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:17.715552 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa9c6a-1384-427d-a66e-841c3ccc14c7 None admin] RBAC: Authorizing `identity:get_user(user_id=2d3f8f5664cc4ae885d553a3051beb41)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:17.716990 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fa9c6a-1384-427d-a66e-841c3ccc14c7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:17.718673 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 580/1143] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:32:17 2022] GET /identity/v3/users/2d3f8f5664cc4ae885d553a3051beb41 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:32:17.724331 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10109597-b0d4-4cae-bcd5-2db6f851bcbc None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:17.728078 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:17.821079 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10109597-b0d4-4cae-bcd5-2db6f851bcbc None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:17.853137 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dbc847-810e-4214-a374-6892ec5b262c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:17.853769 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbc847-810e-4214-a374-6892ec5b262c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:17.854054 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbc847-810e-4214-a374-6892ec5b262c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:17.854331 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbc847-810e-4214-a374-6892ec5b262c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:17.919138 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dbc847-810e-4214-a374-6892ec5b262c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:17.920511 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dbc847-810e-4214-a374-6892ec5b262c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:17.923039 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:18.014198 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 564/1144] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:32:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 03:32:18.019921 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa9c6a-1384-427d-a66e-841c3ccc14c7 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:18.116339 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa9c6a-1384-427d-a66e-841c3ccc14c7 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:18.149088 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d1de9c-e587-41e6-86d5-c35aefefbb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:18.149927 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1de9c-e587-41e6-86d5-c35aefefbb18 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:18.150213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1de9c-e587-41e6-86d5-c35aefefbb18 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:18.150512 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d1de9c-e587-41e6-86d5-c35aefefbb18 None admin] PATH_INFO: `/v3/projects/daefd1710a6f41229b4e521aa90a093e` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:18.151679 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d1de9c-e587-41e6-86d5-c35aefefbb18 None admin] RBAC: Authorizing `identity:get_project(project_id=daefd1710a6f41229b4e521aa90a093e)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:18.153100 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d1de9c-e587-41e6-86d5-c35aefefbb18 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:18.154797 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 581/1145] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:32:18 2022] GET /identity/v3/projects/daefd1710a6f41229b4e521aa90a093e => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:32:18.160469 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dbc847-810e-4214-a374-6892ec5b262c None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:18.255542 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dbc847-810e-4214-a374-6892ec5b262c None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:18.257743 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:18.287948 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c20a95-22b1-471a-8789-e37020d9d511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:18.288582 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c20a95-22b1-471a-8789-e37020d9d511 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:18.288867 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c20a95-22b1-471a-8789-e37020d9d511 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:18.289142 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c20a95-22b1-471a-8789-e37020d9d511 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:18.289972 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c20a95-22b1-471a-8789-e37020d9d511 None admin] RBAC: Adding query filter params (role.id=27e53d6c56f24c25a8c8057bfd36bcf1, scope.project.id=daefd1710a6f41229b4e521aa90a093e, user.id=2d3f8f5664cc4ae885d553a3051beb41) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:32:18.290283 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c20a95-22b1-471a-8789-e37020d9d511 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:18.291744 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c20a95-22b1-471a-8789-e37020d9d511 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:18.296983 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 565/1146] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:32:18 2022] GET /identity/v3/role_assignments?user.id=2d3f8f5664cc4ae885d553a3051beb41&scope.project.id=daefd1710a6f41229b4e521aa90a093e&role.id=27e53d6c56f24c25a8c8057bfd36bcf1 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:32:20.294474 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca323b23-2157-4399-aaeb-28743f7519b1 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:20.294994 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca323b23-2157-4399-aaeb-28743f7519b1 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:20.295084 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca323b23-2157-4399-aaeb-28743f7519b1 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:20.296435 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 582/1147] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:32:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:32:20.301868 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097e572-d762-4eff-aaa7-dede4c1ba7ed None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:20.302291 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097e572-d762-4eff-aaa7-dede4c1ba7ed None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:20.302422 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f097e572-d762-4eff-aaa7-dede4c1ba7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:20.319119 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-f097e572-d762-4eff-aaa7-dede4c1ba7ed None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:32:20.320292 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f097e572-d762-4eff-aaa7-dede4c1ba7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:32:20.384205 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 566/1148] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:32:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 03:32:20.406688 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca323b23-2157-4399-aaeb-28743f7519b1 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:20.430673 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:20.504338 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca323b23-2157-4399-aaeb-28743f7519b1 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:20.536759 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080eea85-8091-48f7-9cad-4a9d1a02ce9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:20.537526 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080eea85-8091-48f7-9cad-4a9d1a02ce9e None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:20.537810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080eea85-8091-48f7-9cad-4a9d1a02ce9e None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:20.538106 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080eea85-8091-48f7-9cad-4a9d1a02ce9e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:20.547904 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080eea85-8091-48f7-9cad-4a9d1a02ce9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:32:20.555946 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-080eea85-8091-48f7-9cad-4a9d1a02ce9e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:32:20.555946 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:32:20.555946 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:32:20.555946 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:32:20.555946 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:32:20.555946 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:32:20.555946 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:32:20.555946 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:32:20.555946 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:32:20.555946 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:32:20.555946 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:32:20.555946 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:32:20.555946 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:32:20.555946 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:32:20.555946 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:32:20.555946 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:32:20.557036 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:32:20.557036 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:32:20.557036 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:32:20.557036 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:32:20.557036 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:32:20.557036 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:32:20.557036 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:32:20.557036 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:32:20.557036 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:32:20.557036 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:32:20.557036 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:32:20.557036 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:32:20.557036 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:32:20.557036 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:32:20.557036 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:32:20.557036 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:32:20.557950 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:32:20.557950 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:32:20.557950 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:32:20.557950 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:32:20.557950 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:32:20.557950 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:32:20.557950 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:32:20.557950 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:32:20.557950 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:32:20.557950 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:32:20.557950 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:32:20.557950 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:32:20.557950 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 583/1149] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 03:32:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:32:20.563008 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097e572-d762-4eff-aaa7-dede4c1ba7ed None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:20.654332 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:20.657951 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f097e572-d762-4eff-aaa7-dede4c1ba7ed None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:20.690806 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc13f3b-c99a-4aa7-8538-d1b403e3144a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:20.691481 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc13f3b-c99a-4aa7-8538-d1b403e3144a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:20.691764 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc13f3b-c99a-4aa7-8538-d1b403e3144a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:20.692588 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc13f3b-c99a-4aa7-8538-d1b403e3144a None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:20.693347 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc13f3b-c99a-4aa7-8538-d1b403e3144a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:32:20.693652 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc13f3b-c99a-4aa7-8538-d1b403e3144a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:20.695062 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc13f3b-c99a-4aa7-8538-d1b403e3144a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:20.705756 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 567/1150] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:32:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:32:20.711865 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080eea85-8091-48f7-9cad-4a9d1a02ce9e None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:20.790210 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:20.808445 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080eea85-8091-48f7-9cad-4a9d1a02ce9e None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:20.839636 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15883ae-938c-493c-9aea-a08dcf9456f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:20.840482 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15883ae-938c-493c-9aea-a08dcf9456f8 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:20.840763 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15883ae-938c-493c-9aea-a08dcf9456f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:20.841039 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15883ae-938c-493c-9aea-a08dcf9456f8 None admin] PATH_INFO: `/v3/users/2d3f8f5664cc4ae885d553a3051beb41` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:20.842202 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15883ae-938c-493c-9aea-a08dcf9456f8 None admin] RBAC: Authorizing `identity:get_user(user_id=2d3f8f5664cc4ae885d553a3051beb41)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:20.843644 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15883ae-938c-493c-9aea-a08dcf9456f8 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:20.845235 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 584/1151] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:32:20 2022] GET /identity/v3/users/2d3f8f5664cc4ae885d553a3051beb41 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:32:20.851831 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc13f3b-c99a-4aa7-8538-d1b403e3144a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:20.947615 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc13f3b-c99a-4aa7-8538-d1b403e3144a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:20.979861 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad844823-cd78-4018-902c-5cf53e9ad59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:20.980705 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad844823-cd78-4018-902c-5cf53e9ad59e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:20.980991 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad844823-cd78-4018-902c-5cf53e9ad59e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:20.981268 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad844823-cd78-4018-902c-5cf53e9ad59e None admin] PATH_INFO: `/v3/projects/daefd1710a6f41229b4e521aa90a093e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:20.982423 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad844823-cd78-4018-902c-5cf53e9ad59e None admin] RBAC: Authorizing `identity:get_project(project_id=daefd1710a6f41229b4e521aa90a093e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:20.983907 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad844823-cd78-4018-902c-5cf53e9ad59e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:20.985558 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 568/1152] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:32:20 2022] GET /identity/v3/projects/daefd1710a6f41229b4e521aa90a093e => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:32:20.991900 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15883ae-938c-493c-9aea-a08dcf9456f8 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:21.086684 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15883ae-938c-493c-9aea-a08dcf9456f8 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:21.118314 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd87cba-91db-43c5-910f-ebcfa72af9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:21.119229 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd87cba-91db-43c5-910f-ebcfa72af9c4 None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:21.119511 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd87cba-91db-43c5-910f-ebcfa72af9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:21.119785 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd87cba-91db-43c5-910f-ebcfa72af9c4 None admin] PATH_INFO: `/v3/projects/daefd1710a6f41229b4e521aa90a093e/users/2d3f8f5664cc4ae885d553a3051beb41/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:21.121707 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd87cba-91db-43c5-910f-ebcfa72af9c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=daefd1710a6f41229b4e521aa90a093e, user_id=2d3f8f5664cc4ae885d553a3051beb41, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:21.123140 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd87cba-91db-43c5-910f-ebcfa72af9c4 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:21.135865 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 585/1153] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 03:32:20 2022] PUT /identity/v3/projects/daefd1710a6f41229b4e521aa90a093e/users/2d3f8f5664cc4ae885d553a3051beb41/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:32:23.105743 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed85b2-ff5d-4f42-b606-4a590ed8b6f4 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:23.106278 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed85b2-ff5d-4f42-b606-4a590ed8b6f4 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:23.106278 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed85b2-ff5d-4f42-b606-4a590ed8b6f4 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:23.107705 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 569/1154] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:32:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:32:23.112943 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89aff78-e9e7-430e-a969-ec2109542026 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:23.113356 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89aff78-e9e7-430e-a969-ec2109542026 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:23.113505 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89aff78-e9e7-430e-a969-ec2109542026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:23.130433 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f89aff78-e9e7-430e-a969-ec2109542026 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:32:23.131641 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f89aff78-e9e7-430e-a969-ec2109542026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:32:23.134294 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:23.196454 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 586/1155] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:32:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 03:32:23.219408 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed85b2-ff5d-4f42-b606-4a590ed8b6f4 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:23.248043 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:23.320247 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed85b2-ff5d-4f42-b606-4a590ed8b6f4 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:23.352917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88913487-9b87-4f7d-aa21-117214b977c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:23.353686 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88913487-9b87-4f7d-aa21-117214b977c3 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:23.353970 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88913487-9b87-4f7d-aa21-117214b977c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:23.354246 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88913487-9b87-4f7d-aa21-117214b977c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:23.364588 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88913487-9b87-4f7d-aa21-117214b977c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:32:23.376161 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-88913487-9b87-4f7d-aa21-117214b977c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:32:23.376161 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:32:23.376161 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:32:23.376161 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:32:23.376161 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:32:23.376161 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:32:23.376161 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:32:23.376161 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:32:23.376161 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:32:23.376161 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:32:23.376161 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:32:23.376161 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:32:23.376161 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:32:23.376161 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:32:23.376161 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:32:23.376161 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:32:23.377271 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:32:23.377271 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:32:23.377271 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:32:23.377271 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:32:23.377271 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:32:23.377271 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:32:23.377271 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:32:23.377271 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:32:23.377271 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:32:23.377271 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:32:23.377271 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:32:23.377271 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:32:23.377271 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:32:23.377271 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:32:23.377271 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:32:23.377271 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:32:23.378679 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:32:23.378679 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:32:23.378679 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:32:23.378679 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:32:23.378679 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:32:23.378679 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:32:23.378679 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:32:23.378679 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:32:23.378679 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:32:23.378679 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:32:23.378679 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:32:23.378679 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:32:23.378679 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 570/1156] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 03:32:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:32:23.383383 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89aff78-e9e7-430e-a969-ec2109542026 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:23.479826 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89aff78-e9e7-430e-a969-ec2109542026 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:23.512085 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0c6d8-d717-4bf0-a22f-0043664e2a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:23.512730 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0c6d8-d717-4bf0-a22f-0043664e2a6f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:23.513011 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0c6d8-d717-4bf0-a22f-0043664e2a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:23.513282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0c6d8-d717-4bf0-a22f-0043664e2a6f None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:23.514015 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b0c6d8-d717-4bf0-a22f-0043664e2a6f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:32:23.514319 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b0c6d8-d717-4bf0-a22f-0043664e2a6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:23.515697 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b0c6d8-d717-4bf0-a22f-0043664e2a6f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:23.524159 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 587/1157] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:32:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:32:23.529800 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88913487-9b87-4f7d-aa21-117214b977c3 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:23.614237 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:23.626159 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88913487-9b87-4f7d-aa21-117214b977c3 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:23.659239 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90712f5f-fd81-4247-bf8b-efc953e620a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:23.660088 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90712f5f-fd81-4247-bf8b-efc953e620a7 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:23.660373 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90712f5f-fd81-4247-bf8b-efc953e620a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:23.661210 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90712f5f-fd81-4247-bf8b-efc953e620a7 None admin] PATH_INFO: `/v3/users/2d3f8f5664cc4ae885d553a3051beb41` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:23.662393 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90712f5f-fd81-4247-bf8b-efc953e620a7 None admin] RBAC: Authorizing `identity:get_user(user_id=2d3f8f5664cc4ae885d553a3051beb41)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:23.663858 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90712f5f-fd81-4247-bf8b-efc953e620a7 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:23.665452 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 571/1158] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:32:23 2022] GET /identity/v3/users/2d3f8f5664cc4ae885d553a3051beb41 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:32:23.671262 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0c6d8-d717-4bf0-a22f-0043664e2a6f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:23.674071 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:23.768509 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0c6d8-d717-4bf0-a22f-0043664e2a6f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:23.800968 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247aee3c-9144-438c-9235-0aec784a8253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:23.801635 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247aee3c-9144-438c-9235-0aec784a8253 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:23.801923 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247aee3c-9144-438c-9235-0aec784a8253 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:23.802199 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247aee3c-9144-438c-9235-0aec784a8253 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:23.866818 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247aee3c-9144-438c-9235-0aec784a8253 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:23.868250 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247aee3c-9144-438c-9235-0aec784a8253 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:23.869999 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:23.964140 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 588/1159] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:32:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 03:32:23.970033 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90712f5f-fd81-4247-bf8b-efc953e620a7 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:24.064827 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90712f5f-fd81-4247-bf8b-efc953e620a7 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:24.097872 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b82949-66c2-4210-a138-81a310cb3a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:24.098770 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b82949-66c2-4210-a138-81a310cb3a80 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:24.099055 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b82949-66c2-4210-a138-81a310cb3a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:24.099331 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b82949-66c2-4210-a138-81a310cb3a80 None admin] PATH_INFO: `/v3/projects/daefd1710a6f41229b4e521aa90a093e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:24.100508 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b82949-66c2-4210-a138-81a310cb3a80 None admin] RBAC: Authorizing `identity:get_project(project_id=daefd1710a6f41229b4e521aa90a093e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:24.101944 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b82949-66c2-4210-a138-81a310cb3a80 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:24.103643 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 572/1160] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:32:23 2022] GET /identity/v3/projects/daefd1710a6f41229b4e521aa90a093e => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:32:24.109645 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247aee3c-9144-438c-9235-0aec784a8253 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:24.205846 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247aee3c-9144-438c-9235-0aec784a8253 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:24.207365 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:24.240131 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf148b-de25-4118-a275-69100ca79ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:24.240719 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf148b-de25-4118-a275-69100ca79ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:24.241007 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf148b-de25-4118-a275-69100ca79ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:24.241288 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf148b-de25-4118-a275-69100ca79ff8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:24.242115 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf148b-de25-4118-a275-69100ca79ff8 None admin] RBAC: Adding query filter params (role.id=27e53d6c56f24c25a8c8057bfd36bcf1, scope.project.id=daefd1710a6f41229b4e521aa90a093e, user.id=2d3f8f5664cc4ae885d553a3051beb41) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:32:24.242431 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf148b-de25-4118-a275-69100ca79ff8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:24.243883 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf148b-de25-4118-a275-69100ca79ff8 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:24.249535 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 589/1161] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:32:24 2022] GET /identity/v3/role_assignments?user.id=2d3f8f5664cc4ae885d553a3051beb41&scope.project.id=daefd1710a6f41229b4e521aa90a093e&role.id=27e53d6c56f24c25a8c8057bfd36bcf1 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:32:26.265077 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51126a46-c06e-4904-bdc9-e8a7f1b291f6 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:26.265616 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51126a46-c06e-4904-bdc9-e8a7f1b291f6 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:26.265616 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51126a46-c06e-4904-bdc9-e8a7f1b291f6 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:26.267030 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 573/1162] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:32:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:32:26.273039 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6ff0b-99db-4c38-afee-8bd17b05e3d9 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:26.273475 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6ff0b-99db-4c38-afee-8bd17b05e3d9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:26.273582 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6ff0b-99db-4c38-afee-8bd17b05e3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:26.289932 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-33b6ff0b-99db-4c38-afee-8bd17b05e3d9 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:32:26.291154 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-33b6ff0b-99db-4c38-afee-8bd17b05e3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:32:26.355207 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 590/1163] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:32:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 03:32:26.377721 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51126a46-c06e-4904-bdc9-e8a7f1b291f6 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:26.402711 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:26.482900 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51126a46-c06e-4904-bdc9-e8a7f1b291f6 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:26.515935 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f985678-afe9-4f63-a080-c4d8579bdfdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:26.516517 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f985678-afe9-4f63-a080-c4d8579bdfdc None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:26.516801 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f985678-afe9-4f63-a080-c4d8579bdfdc None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:26.517079 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f985678-afe9-4f63-a080-c4d8579bdfdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:26.581026 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f985678-afe9-4f63-a080-c4d8579bdfdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:26.582500 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f985678-afe9-4f63-a080-c4d8579bdfdc None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:26.604788 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:26.676156 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 574/1164] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:32:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 03:32:26.682538 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6ff0b-99db-4c38-afee-8bd17b05e3d9 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:26.773372 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:26.778996 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6ff0b-99db-4c38-afee-8bd17b05e3d9 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:26.811801 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a6e105-b743-4b01-ac16-34bad8c9a119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:26.812583 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6e105-b743-4b01-ac16-34bad8c9a119 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:26.812864 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6e105-b743-4b01-ac16-34bad8c9a119 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:26.813138 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a6e105-b743-4b01-ac16-34bad8c9a119 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:26.819604 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a6e105-b743-4b01-ac16-34bad8c9a119 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:26.821023 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a6e105-b743-4b01-ac16-34bad8c9a119 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:26.834660 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-f3a6e105-b743-4b01-ac16-34bad8c9a119 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 21 03:32:26.834660 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:32:26.834660 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 21 03:32:26.834660 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 21 03:32:26.834660 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 03:32:26.834660 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 03:32:26.834660 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 03:32:26.834660 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 03:32:26.834660 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 21 03:32:26.834660 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:32:26.834660 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 03:32:26.834660 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:32:26.834660 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:32:26.834660 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:32:26.834660 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:32:26.834660 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:32:26.834660 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:32:26.835871 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:32:26.835871 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:32:26.835871 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:32:26.835871 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:32:26.835871 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:32:26.835871 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:32:26.835871 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:32:26.835871 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:32:26.835871 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:32:26.835871 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:32:26.835871 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:32:26.835871 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:32:26.835871 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:32:26.835871 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:32:26.835871 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:32:26.835871 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:32:26.836834 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:32:26.836834 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:32:26.836834 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:32:26.836834 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:32:26.836834 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:32:26.836834 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:32:26.836834 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:32:26.836834 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:32:26.836834 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:32:26.836834 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:32:26.836834 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 21 03:32:26.836834 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:32:26.836834 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 21 03:32:26.836834 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:32:26.836834 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 591/1165] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Jul 21 03:32:26 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:32:26.841835 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f985678-afe9-4f63-a080-c4d8579bdfdc None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:26.939369 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f985678-afe9-4f63-a080-c4d8579bdfdc None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:26.962368 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:26.972990 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b35f4f-2b98-4cf3-9045-0a1937832023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:26.974140 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b35f4f-2b98-4cf3-9045-0a1937832023 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:26.974422 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b35f4f-2b98-4cf3-9045-0a1937832023 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:26.974733 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b35f4f-2b98-4cf3-9045-0a1937832023 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:26.975447 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b35f4f-2b98-4cf3-9045-0a1937832023 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:32:26.975753 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b35f4f-2b98-4cf3-9045-0a1937832023 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:26.977121 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b35f4f-2b98-4cf3-9045-0a1937832023 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:26.984034 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 575/1166] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Jul 21 03:32:26 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:32:28.987294 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa93061-fd15-43aa-9ea0-cde496e0e3cb None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:28.987810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa93061-fd15-43aa-9ea0-cde496e0e3cb None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:28.987810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa93061-fd15-43aa-9ea0-cde496e0e3cb None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:28.989765 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 592/1167] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:32:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:32:28.995158 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50facef-7e23-4359-97a6-3e5f288bd4f7 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:28.995553 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50facef-7e23-4359-97a6-3e5f288bd4f7 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:28.995746 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50facef-7e23-4359-97a6-3e5f288bd4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:29.012557 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-e50facef-7e23-4359-97a6-3e5f288bd4f7 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:32:29.013736 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e50facef-7e23-4359-97a6-3e5f288bd4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:32:29.082502 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 576/1168] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:32:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 03:32:29.105727 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa93061-fd15-43aa-9ea0-cde496e0e3cb None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:29.207978 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa93061-fd15-43aa-9ea0-cde496e0e3cb None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:29.242416 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93b118-a15a-4d23-954c-8fd41b3dd7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:29.243027 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93b118-a15a-4d23-954c-8fd41b3dd7c7 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:29.243309 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93b118-a15a-4d23-954c-8fd41b3dd7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:29.243581 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93b118-a15a-4d23-954c-8fd41b3dd7c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:29.244317 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93b118-a15a-4d23-954c-8fd41b3dd7c7 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:29.245667 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93b118-a15a-4d23-954c-8fd41b3dd7c7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:29.260080 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 593/1169] 10.222.0.20 () {60 vars in 1138 bytes} [Thu Jul 21 03:32:29 2022] POST /identity/v3/domains => generated 267 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:32:31.293075 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa640d94-fd87-4ea0-918a-10a9210b2c38 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:31.293630 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa640d94-fd87-4ea0-918a-10a9210b2c38 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:31.293630 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa640d94-fd87-4ea0-918a-10a9210b2c38 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:31.295015 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 577/1170] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:32:31.300240 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a2a35-9066-4204-bed1-e398270eab7f None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:31.300639 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a2a35-9066-4204-bed1-e398270eab7f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:31.300807 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a2a35-9066-4204-bed1-e398270eab7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:31.317555 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-5d2a2a35-9066-4204-bed1-e398270eab7f None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:32:31.318758 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5d2a2a35-9066-4204-bed1-e398270eab7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:32:31.329012 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:31.385666 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 594/1171] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:32:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 03:32:31.409916 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa640d94-fd87-4ea0-918a-10a9210b2c38 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:31.509818 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa640d94-fd87-4ea0-918a-10a9210b2c38 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:31.528993 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:31.545314 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7308a-10f1-4d18-89b3-f7eaf86a51e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:31.546105 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7308a-10f1-4d18-89b3-f7eaf86a51e2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:31.546385 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7308a-10f1-4d18-89b3-f7eaf86a51e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:31.546690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7308a-10f1-4d18-89b3-f7eaf86a51e2 None admin] PATH_INFO: `/v3/domains/c88065b32202436381cfb682597a435a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:31.556753 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce7308a-10f1-4d18-89b3-f7eaf86a51e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=c88065b32202436381cfb682597a435a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:31.558192 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce7308a-10f1-4d18-89b3-f7eaf86a51e2 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:31.559826 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 578/1172] 10.222.0.20 () {56 vars in 1183 bytes} [Thu Jul 21 03:32:31 2022] GET /identity/v3/domains/c88065b32202436381cfb682597a435a => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:32:31.565679 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a2a35-9066-4204-bed1-e398270eab7f None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:31.661666 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a2a35-9066-4204-bed1-e398270eab7f None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:31.695041 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365072a-df59-46f8-b226-8418fb5c84f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:31.695694 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365072a-df59-46f8-b226-8418fb5c84f0 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:31.695980 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365072a-df59-46f8-b226-8418fb5c84f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:31.696257 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365072a-df59-46f8-b226-8418fb5c84f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:31.696956 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e365072a-df59-46f8-b226-8418fb5c84f0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:31.698381 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e365072a-df59-46f8-b226-8418fb5c84f0 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:31.717318 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:31.725041 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 595/1173] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jul 21 03:32:31 2022] POST /identity/v3/projects => generated 361 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:32:33.754052 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb298bf8-300c-4ba8-bbad-f1940a40582f None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:33.754582 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb298bf8-300c-4ba8-bbad-f1940a40582f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:33.754683 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb298bf8-300c-4ba8-bbad-f1940a40582f None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:33.756073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 579/1174] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:32:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:32:33.761331 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98dcce-09d9-4cd4-bee8-24be9770091f None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:33.761759 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98dcce-09d9-4cd4-bee8-24be9770091f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:33.761902 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98dcce-09d9-4cd4-bee8-24be9770091f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:33.778753 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-5b98dcce-09d9-4cd4-bee8-24be9770091f None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:32:33.779946 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5b98dcce-09d9-4cd4-bee8-24be9770091f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:32:33.844369 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 596/1175] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:32:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 03:32:33.869065 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb298bf8-300c-4ba8-bbad-f1940a40582f None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:33.967672 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb298bf8-300c-4ba8-bbad-f1940a40582f None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:34.000197 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c3ff5-c559-440e-b2ca-57963c5a6b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:34.001041 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c3ff5-c559-440e-b2ca-57963c5a6b19 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:34.001328 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c3ff5-c559-440e-b2ca-57963c5a6b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:34.001608 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c3ff5-c559-440e-b2ca-57963c5a6b19 None admin] PATH_INFO: `/v3/domains/c88065b32202436381cfb682597a435a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:34.002809 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c3ff5-c559-440e-b2ca-57963c5a6b19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=c88065b32202436381cfb682597a435a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:34.004288 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c3ff5-c559-440e-b2ca-57963c5a6b19 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:34.005873 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 580/1176] 10.222.0.20 () {56 vars in 1183 bytes} [Thu Jul 21 03:32:33 2022] GET /identity/v3/domains/c88065b32202436381cfb682597a435a => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:32:34.011303 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98dcce-09d9-4cd4-bee8-24be9770091f None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:34.105683 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98dcce-09d9-4cd4-bee8-24be9770091f None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:34.130142 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:34.137705 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4644c534-172f-4376-9e94-be404312ccfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:34.138356 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644c534-172f-4376-9e94-be404312ccfe None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:34.138670 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644c534-172f-4376-9e94-be404312ccfe None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:34.138946 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4644c534-172f-4376-9e94-be404312ccfe None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:34.139648 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4644c534-172f-4376-9e94-be404312ccfe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:34.141057 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4644c534-172f-4376-9e94-be404312ccfe None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:34.160015 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 597/1177] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jul 21 03:32:34 2022] POST /identity/v3/users => generated 311 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:32:36.185162 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d8b48-c757-4408-8930-51dfe55910a8 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:36.185700 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d8b48-c757-4408-8930-51dfe55910a8 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:36.185700 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d8b48-c757-4408-8930-51dfe55910a8 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:36.187108 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 581/1178] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:32:36.193074 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c316e2-ad84-4f39-ae18-a6ed89f76a73 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:36.193496 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c316e2-ad84-4f39-ae18-a6ed89f76a73 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:36.193633 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c316e2-ad84-4f39-ae18-a6ed89f76a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:36.209942 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-95c316e2-ad84-4f39-ae18-a6ed89f76a73 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:32:36.211151 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-95c316e2-ad84-4f39-ae18-a6ed89f76a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:32:36.275725 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 598/1179] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:32:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 03:32:36.301855 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d8b48-c757-4408-8930-51dfe55910a8 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:36.347527 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:36.398878 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d8b48-c757-4408-8930-51dfe55910a8 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:36.430997 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce190597-bbf2-4a1a-8bf6-5b4eda918c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:36.431766 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce190597-bbf2-4a1a-8bf6-5b4eda918c1c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:36.432049 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce190597-bbf2-4a1a-8bf6-5b4eda918c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:36.432327 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce190597-bbf2-4a1a-8bf6-5b4eda918c1c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:36.442639 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce190597-bbf2-4a1a-8bf6-5b4eda918c1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:32:36.450060 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-ce190597-bbf2-4a1a-8bf6-5b4eda918c1c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:32:36.450060 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:32:36.450060 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:32:36.450060 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:32:36.450060 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:32:36.450060 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:32:36.450060 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:32:36.450060 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:32:36.450060 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:32:36.450060 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:32:36.450060 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:32:36.450060 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:32:36.450060 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:32:36.450060 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:32:36.450060 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:32:36.450060 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:32:36.451307 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:32:36.451307 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:32:36.451307 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:32:36.451307 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:32:36.451307 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:32:36.451307 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:32:36.451307 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:32:36.451307 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:32:36.451307 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:32:36.451307 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:32:36.451307 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:32:36.451307 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:32:36.451307 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:32:36.451307 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:32:36.451307 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:32:36.451307 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:32:36.452578 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:32:36.452578 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:32:36.452578 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:32:36.452578 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:32:36.452578 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:32:36.452578 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:32:36.452578 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:32:36.452578 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:32:36.452578 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:32:36.452578 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:32:36.452578 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:32:36.452578 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:32:36.452578 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 582/1180] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 03:32:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:32:36.457018 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c316e2-ad84-4f39-ae18-a6ed89f76a73 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:36.552772 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c316e2-ad84-4f39-ae18-a6ed89f76a73 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:36.565997 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:36.586138 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6a7bcc-e5fd-435b-8b5d-33f923e0ce11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:36.586816 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a7bcc-e5fd-435b-8b5d-33f923e0ce11 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:36.587100 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a7bcc-e5fd-435b-8b5d-33f923e0ce11 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:36.587375 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a7bcc-e5fd-435b-8b5d-33f923e0ce11 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:36.588114 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6a7bcc-e5fd-435b-8b5d-33f923e0ce11 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:32:36.588419 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6a7bcc-e5fd-435b-8b5d-33f923e0ce11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:36.589771 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6a7bcc-e5fd-435b-8b5d-33f923e0ce11 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:36.597556 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 599/1181] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:32:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:32:36.603624 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce190597-bbf2-4a1a-8bf6-5b4eda918c1c None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:36.700623 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce190597-bbf2-4a1a-8bf6-5b4eda918c1c None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:36.707335 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:36.734825 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eb4867-36c3-4329-a9ed-0fdc6011dc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:36.735677 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb4867-36c3-4329-a9ed-0fdc6011dc3d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:36.735957 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb4867-36c3-4329-a9ed-0fdc6011dc3d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:36.736228 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eb4867-36c3-4329-a9ed-0fdc6011dc3d None admin] PATH_INFO: `/v3/users/c7d0c52345fd46eb8076d92cd119dabe` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:36.749358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eb4867-36c3-4329-a9ed-0fdc6011dc3d None admin] RBAC: Authorizing `identity:get_user(user_id=c7d0c52345fd46eb8076d92cd119dabe)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:36.750829 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eb4867-36c3-4329-a9ed-0fdc6011dc3d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:36.752439 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 583/1182] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:32:36 2022] GET /identity/v3/users/c7d0c52345fd46eb8076d92cd119dabe => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:32:36.758184 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6a7bcc-e5fd-435b-8b5d-33f923e0ce11 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:36.855137 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6a7bcc-e5fd-435b-8b5d-33f923e0ce11 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:36.887903 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1702dcb-4662-4072-b3a1-a6adf5662369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:36.888542 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1702dcb-4662-4072-b3a1-a6adf5662369 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:36.888831 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1702dcb-4662-4072-b3a1-a6adf5662369 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:36.889112 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1702dcb-4662-4072-b3a1-a6adf5662369 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:36.932829 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:36.955337 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1702dcb-4662-4072-b3a1-a6adf5662369 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:36.956722 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1702dcb-4662-4072-b3a1-a6adf5662369 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:37.049780 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 600/1183] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:32:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 03:32:37.056117 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eb4867-36c3-4329-a9ed-0fdc6011dc3d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:37.150110 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eb4867-36c3-4329-a9ed-0fdc6011dc3d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:37.182145 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef52d5-73a3-4ba8-a070-e20069a593ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:37.183001 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef52d5-73a3-4ba8-a070-e20069a593ea None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:37.183280 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef52d5-73a3-4ba8-a070-e20069a593ea None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:37.183548 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef52d5-73a3-4ba8-a070-e20069a593ea None admin] PATH_INFO: `/v3/projects/90756cd67f644fdb8c239f9270822efb` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:37.184716 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef52d5-73a3-4ba8-a070-e20069a593ea None admin] RBAC: Authorizing `identity:get_project(project_id=90756cd67f644fdb8c239f9270822efb)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:37.186145 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef52d5-73a3-4ba8-a070-e20069a593ea None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:37.187820 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 584/1184] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:32:37 2022] GET /identity/v3/projects/90756cd67f644fdb8c239f9270822efb => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:32:37.194113 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1702dcb-4662-4072-b3a1-a6adf5662369 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:37.267384 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:37.290644 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1702dcb-4662-4072-b3a1-a6adf5662369 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:37.323584 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e922362-8728-4c3e-b338-8dc26730b4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:37.324225 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e922362-8728-4c3e-b338-8dc26730b4bb None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:37.324513 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e922362-8728-4c3e-b338-8dc26730b4bb None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:37.324795 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e922362-8728-4c3e-b338-8dc26730b4bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:37.325623 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e922362-8728-4c3e-b338-8dc26730b4bb None admin] RBAC: Adding query filter params (role.id=27e53d6c56f24c25a8c8057bfd36bcf1, scope.project.id=90756cd67f644fdb8c239f9270822efb, user.id=c7d0c52345fd46eb8076d92cd119dabe) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:32:37.325940 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e922362-8728-4c3e-b338-8dc26730b4bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:37.327389 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e922362-8728-4c3e-b338-8dc26730b4bb None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:37.332744 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 601/1185] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:32:37 2022] GET /identity/v3/role_assignments?user.id=c7d0c52345fd46eb8076d92cd119dabe&scope.project.id=90756cd67f644fdb8c239f9270822efb&role.id=27e53d6c56f24c25a8c8057bfd36bcf1 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:32:39.315811 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e626158-51fe-4b11-b6ae-f80421c44554 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:39.316335 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e626158-51fe-4b11-b6ae-f80421c44554 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:39.316450 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e626158-51fe-4b11-b6ae-f80421c44554 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:39.317771 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 585/1186] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:32:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:32:39.322979 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73cfa8-51c7-432c-bc0d-9eed7ecb52e7 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:39.323379 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73cfa8-51c7-432c-bc0d-9eed7ecb52e7 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:39.323531 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73cfa8-51c7-432c-bc0d-9eed7ecb52e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:39.340365 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-8b73cfa8-51c7-432c-bc0d-9eed7ecb52e7 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:32:39.341529 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8b73cfa8-51c7-432c-bc0d-9eed7ecb52e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:32:39.405199 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 602/1187] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:32:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 03:32:39.429947 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e626158-51fe-4b11-b6ae-f80421c44554 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:39.472990 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:39.550092 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e626158-51fe-4b11-b6ae-f80421c44554 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:39.583859 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a6aca-de56-4886-99bd-bf96be0318ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:39.584586 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a6aca-de56-4886-99bd-bf96be0318ac None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:39.584873 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a6aca-de56-4886-99bd-bf96be0318ac None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:39.585150 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a6aca-de56-4886-99bd-bf96be0318ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:39.595123 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2a6aca-de56-4886-99bd-bf96be0318ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:32:39.602776 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-4c2a6aca-de56-4886-99bd-bf96be0318ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:32:39.602776 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:32:39.602776 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:32:39.602776 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:32:39.602776 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:32:39.602776 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:32:39.602776 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:32:39.602776 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:32:39.602776 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:32:39.602776 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:32:39.602776 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:32:39.602776 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:32:39.602776 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:32:39.602776 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:32:39.602776 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:32:39.602776 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:32:39.603884 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:32:39.603884 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:32:39.603884 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:32:39.603884 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:32:39.603884 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:32:39.603884 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:32:39.603884 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:32:39.603884 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:32:39.603884 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:32:39.603884 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:32:39.603884 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:32:39.603884 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:32:39.603884 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:32:39.603884 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:32:39.603884 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:32:39.603884 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:32:39.605142 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:32:39.605142 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:32:39.605142 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:32:39.605142 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:32:39.605142 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:32:39.605142 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:32:39.605142 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:32:39.605142 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:32:39.605142 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:32:39.605142 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:32:39.605142 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:32:39.605142 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:32:39.605142 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 586/1188] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 03:32:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:32:39.610115 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b73cfa8-51c7-432c-bc0d-9eed7ecb52e7 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:39.676466 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:39.706184 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b73cfa8-51c7-432c-bc0d-9eed7ecb52e7 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:39.738714 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85babf-146a-45c4-85ae-7c8fbcb5c76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:39.739366 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85babf-146a-45c4-85ae-7c8fbcb5c76c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:39.739648 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85babf-146a-45c4-85ae-7c8fbcb5c76c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:39.739923 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c85babf-146a-45c4-85ae-7c8fbcb5c76c None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:39.740657 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c85babf-146a-45c4-85ae-7c8fbcb5c76c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:32:39.740962 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c85babf-146a-45c4-85ae-7c8fbcb5c76c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:39.742318 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c85babf-146a-45c4-85ae-7c8fbcb5c76c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:39.750051 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 603/1189] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:32:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:32:39.756382 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a6aca-de56-4886-99bd-bf96be0318ac None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:39.848627 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:39.858563 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a6aca-de56-4886-99bd-bf96be0318ac None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:39.892533 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329754e-01f5-4ae0-8e45-bee0b8638b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:39.893406 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329754e-01f5-4ae0-8e45-bee0b8638b4c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:39.893692 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329754e-01f5-4ae0-8e45-bee0b8638b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:39.893969 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329754e-01f5-4ae0-8e45-bee0b8638b4c None admin] PATH_INFO: `/v3/users/c7d0c52345fd46eb8076d92cd119dabe` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:39.895196 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329754e-01f5-4ae0-8e45-bee0b8638b4c None admin] RBAC: Authorizing `identity:get_user(user_id=c7d0c52345fd46eb8076d92cd119dabe)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:39.896634 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329754e-01f5-4ae0-8e45-bee0b8638b4c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:39.898546 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 587/1190] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:32:39 2022] GET /identity/v3/users/c7d0c52345fd46eb8076d92cd119dabe => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:32:39.904810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85babf-146a-45c4-85ae-7c8fbcb5c76c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:40.000093 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c85babf-146a-45c4-85ae-7c8fbcb5c76c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:40.028434 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:40.033681 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05565666-22b2-4042-b2da-c22fe53bc790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:40.034555 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05565666-22b2-4042-b2da-c22fe53bc790 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:40.034839 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05565666-22b2-4042-b2da-c22fe53bc790 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:40.035114 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05565666-22b2-4042-b2da-c22fe53bc790 None admin] PATH_INFO: `/v3/projects/90756cd67f644fdb8c239f9270822efb` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:40.036802 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05565666-22b2-4042-b2da-c22fe53bc790 None admin] RBAC: Authorizing `identity:get_project(project_id=90756cd67f644fdb8c239f9270822efb)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:40.038217 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05565666-22b2-4042-b2da-c22fe53bc790 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:40.039935 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 604/1191] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:32:39 2022] GET /identity/v3/projects/90756cd67f644fdb8c239f9270822efb => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:32:40.045925 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329754e-01f5-4ae0-8e45-bee0b8638b4c None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:40.143584 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329754e-01f5-4ae0-8e45-bee0b8638b4c None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:40.183885 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b80b9bc-6e8a-48ba-94aa-948565d34016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:40.184777 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80b9bc-6e8a-48ba-94aa-948565d34016 None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:40.185065 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80b9bc-6e8a-48ba-94aa-948565d34016 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:40.185348 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b80b9bc-6e8a-48ba-94aa-948565d34016 None admin] PATH_INFO: `/v3/projects/90756cd67f644fdb8c239f9270822efb/users/c7d0c52345fd46eb8076d92cd119dabe/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:40.187336 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b80b9bc-6e8a-48ba-94aa-948565d34016 None admin] RBAC: Authorizing `identity:create_grant(project_id=90756cd67f644fdb8c239f9270822efb, user_id=c7d0c52345fd46eb8076d92cd119dabe, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:40.188783 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b80b9bc-6e8a-48ba-94aa-948565d34016 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:40.201690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 588/1192] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 03:32:40 2022] PUT /identity/v3/projects/90756cd67f644fdb8c239f9270822efb/users/c7d0c52345fd46eb8076d92cd119dabe/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:32:42.217392 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb68b11-03bf-47d8-809a-bfa00562098c None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:42.217940 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb68b11-03bf-47d8-809a-bfa00562098c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:42.217940 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb68b11-03bf-47d8-809a-bfa00562098c None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:42.219350 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 605/1193] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:32:42.225184 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817c188-766d-461b-a4e5-9184afb6ebf3 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:42.225624 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817c188-766d-461b-a4e5-9184afb6ebf3 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:42.225748 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817c188-766d-461b-a4e5-9184afb6ebf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:42.242096 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c817c188-766d-461b-a4e5-9184afb6ebf3 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:32:42.243315 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c817c188-766d-461b-a4e5-9184afb6ebf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:32:42.256796 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:42.308933 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 589/1194] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:32:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 03:32:42.332906 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb68b11-03bf-47d8-809a-bfa00562098c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:42.431439 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb68b11-03bf-47d8-809a-bfa00562098c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:42.464497 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64507e5a-51db-4078-af3b-aaadee3b261c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:42.465278 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64507e5a-51db-4078-af3b-aaadee3b261c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:42.465562 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64507e5a-51db-4078-af3b-aaadee3b261c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:42.465839 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64507e5a-51db-4078-af3b-aaadee3b261c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:42.475585 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64507e5a-51db-4078-af3b-aaadee3b261c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:32:42.483082 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-64507e5a-51db-4078-af3b-aaadee3b261c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:32:42.483082 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:32:42.483082 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:32:42.483082 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:32:42.483082 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:32:42.483082 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:32:42.483082 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:32:42.483082 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:32:42.483082 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:32:42.483082 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:32:42.483082 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:32:42.483082 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:32:42.483082 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:32:42.483082 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:32:42.483082 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:32:42.483082 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:32:42.484180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:32:42.484180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:32:42.484180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:32:42.484180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:32:42.484180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:32:42.484180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:32:42.484180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:32:42.484180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:32:42.484180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:32:42.484180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:32:42.484180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:32:42.484180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:32:42.484180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:32:42.484180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:32:42.484180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:32:42.484180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:32:42.485058 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:32:42.485058 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:32:42.485058 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:32:42.485058 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:32:42.485058 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:32:42.485058 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:32:42.485058 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:32:42.485058 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:32:42.485058 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:32:42.485058 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:32:42.485058 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:32:42.485058 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:32:42.485058 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 606/1195] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 03:32:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:32:42.490277 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817c188-766d-461b-a4e5-9184afb6ebf3 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:42.585368 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817c188-766d-461b-a4e5-9184afb6ebf3 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:42.616967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb7ae75-6e0e-428b-b4be-aef7803a343e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:42.617616 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7ae75-6e0e-428b-b4be-aef7803a343e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:42.617898 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7ae75-6e0e-428b-b4be-aef7803a343e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:42.618171 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7ae75-6e0e-428b-b4be-aef7803a343e None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:42.618939 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb7ae75-6e0e-428b-b4be-aef7803a343e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:32:42.619243 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb7ae75-6e0e-428b-b4be-aef7803a343e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:42.620613 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb7ae75-6e0e-428b-b4be-aef7803a343e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:42.628268 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 590/1196] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:32:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:32:42.634418 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64507e5a-51db-4078-af3b-aaadee3b261c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:42.690940 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:42.731843 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64507e5a-51db-4078-af3b-aaadee3b261c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:42.763724 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc26dad-fe5f-401d-b90c-ade9af856c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:42.764582 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc26dad-fe5f-401d-b90c-ade9af856c9b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:42.764870 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc26dad-fe5f-401d-b90c-ade9af856c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:42.765147 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc26dad-fe5f-401d-b90c-ade9af856c9b None admin] PATH_INFO: `/v3/users/c7d0c52345fd46eb8076d92cd119dabe` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:42.766316 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc26dad-fe5f-401d-b90c-ade9af856c9b None admin] RBAC: Authorizing `identity:get_user(user_id=c7d0c52345fd46eb8076d92cd119dabe)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:42.767765 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc26dad-fe5f-401d-b90c-ade9af856c9b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:42.769379 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 607/1197] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jul 21 03:32:42 2022] GET /identity/v3/users/c7d0c52345fd46eb8076d92cd119dabe => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:32:42.775875 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb7ae75-6e0e-428b-b4be-aef7803a343e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:42.790602 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:42.873559 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb7ae75-6e0e-428b-b4be-aef7803a343e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:42.906178 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a0854-1e0b-4938-bb6b-1ad95431ef08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:42.906850 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a0854-1e0b-4938-bb6b-1ad95431ef08 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:42.907139 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a0854-1e0b-4938-bb6b-1ad95431ef08 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:42.907418 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a0854-1e0b-4938-bb6b-1ad95431ef08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:42.971855 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a0854-1e0b-4938-bb6b-1ad95431ef08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:42.973318 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a0854-1e0b-4938-bb6b-1ad95431ef08 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:42.986269 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:43.069675 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 591/1198] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:32:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 03:32:43.075402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc26dad-fe5f-401d-b90c-ade9af856c9b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:43.170811 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc26dad-fe5f-401d-b90c-ade9af856c9b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:43.195350 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:43.202976 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc1aa6-71e4-4f73-a594-1ac4583a9e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:43.203820 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc1aa6-71e4-4f73-a594-1ac4583a9e14 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:43.204102 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc1aa6-71e4-4f73-a594-1ac4583a9e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:43.204374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc1aa6-71e4-4f73-a594-1ac4583a9e14 None admin] PATH_INFO: `/v3/projects/90756cd67f644fdb8c239f9270822efb` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:43.205531 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cc1aa6-71e4-4f73-a594-1ac4583a9e14 None admin] RBAC: Authorizing `identity:get_project(project_id=90756cd67f644fdb8c239f9270822efb)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:43.207569 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cc1aa6-71e4-4f73-a594-1ac4583a9e14 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:43.209228 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 608/1199] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jul 21 03:32:43 2022] GET /identity/v3/projects/90756cd67f644fdb8c239f9270822efb => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:32:43.215323 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a0854-1e0b-4938-bb6b-1ad95431ef08 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:32:43.309574 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a0854-1e0b-4938-bb6b-1ad95431ef08 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:32:43.322374 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:43.343121 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beadee44-fd41-48a9-8690-e18c8802e2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:32:43.343755 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beadee44-fd41-48a9-8690-e18c8802e2f5 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:32:43.344035 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beadee44-fd41-48a9-8690-e18c8802e2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:32:43.344309 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beadee44-fd41-48a9-8690-e18c8802e2f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:32:43.345131 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beadee44-fd41-48a9-8690-e18c8802e2f5 None admin] RBAC: Adding query filter params (role.id=27e53d6c56f24c25a8c8057bfd36bcf1, scope.project.id=90756cd67f644fdb8c239f9270822efb, user.id=c7d0c52345fd46eb8076d92cd119dabe) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:32:43.345441 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beadee44-fd41-48a9-8690-e18c8802e2f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:32:43.346895 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beadee44-fd41-48a9-8690-e18c8802e2f5 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:32:43.352492 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 592/1200] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:32:43 2022] GET /identity/v3/role_assignments?user.id=c7d0c52345fd46eb8076d92cd119dabe&scope.project.id=90756cd67f644fdb8c239f9270822efb&role.id=27e53d6c56f24c25a8c8057bfd36bcf1 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:32:53.199299 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:32:53.349940 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=12 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:33:37.799572 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6ece1-a9d3-4e17-a69c-1d54691ae28e None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:37.800166 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6ece1-a9d3-4e17-a69c-1d54691ae28e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:37.800166 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6ece1-a9d3-4e17-a69c-1d54691ae28e None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:37.801820 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 609/1201] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:33:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:33:37.807750 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e050e-419d-46b9-88eb-35a9b59a736a None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:37.808215 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e050e-419d-46b9-88eb-35a9b59a736a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:37.808378 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e050e-419d-46b9-88eb-35a9b59a736a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:37.826816 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-9a8e050e-419d-46b9-88eb-35a9b59a736a None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:33:37.828245 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9a8e050e-419d-46b9-88eb-35a9b59a736a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:33:37.916589 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 593/1202] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:33:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 03:33:37.944062 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6ece1-a9d3-4e17-a69c-1d54691ae28e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:38.079907 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6ece1-a9d3-4e17-a69c-1d54691ae28e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:38.123601 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab232e-ed18-415a-aea0-ac7a61ef5d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:38.124579 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab232e-ed18-415a-aea0-ac7a61ef5d99 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:38.124866 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab232e-ed18-415a-aea0-ac7a61ef5d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:38.125292 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab232e-ed18-415a-aea0-ac7a61ef5d99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:38.140013 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ab232e-ed18-415a-aea0-ac7a61ef5d99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:33:38.141770 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ab232e-ed18-415a-aea0-ac7a61ef5d99 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:33:38.165072 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-91ab232e-ed18-415a-aea0-ac7a61ef5d99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:33:38.165072 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:33:38.165072 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:33:38.165072 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:33:38.165072 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:33:38.165072 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:33:38.165072 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:33:38.165072 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:33:38.165072 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:33:38.165072 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:33:38.165072 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:33:38.165072 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:33:38.165072 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:33:38.165072 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:33:38.165072 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:33:38.171155 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:33:38.171155 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:33:38.171155 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:33:38.171155 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:33:38.171155 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:33:38.171155 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:33:38.171155 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:33:38.171155 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:33:38.171155 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:33:38.171155 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:33:38.171155 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:33:38.171155 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:33:38.171155 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:33:38.171155 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:33:38.171155 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:33:38.171155 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:33:38.171155 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:33:38.172398 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:33:38.172398 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:33:38.172398 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:33:38.172398 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:33:38.172398 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 610/1203] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:33:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:33:38.172777 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e050e-419d-46b9-88eb-35a9b59a736a None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:38.304080 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e050e-419d-46b9-88eb-35a9b59a736a None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:38.340164 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:33:38.347172 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660b2b4a-3f1c-41f5-83e5-82d946c592cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:38.347962 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b2b4a-3f1c-41f5-83e5-82d946c592cf None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:38.348275 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b2b4a-3f1c-41f5-83e5-82d946c592cf None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:38.348527 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660b2b4a-3f1c-41f5-83e5-82d946c592cf None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:38.349374 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660b2b4a-3f1c-41f5-83e5-82d946c592cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:33:38.349684 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660b2b4a-3f1c-41f5-83e5-82d946c592cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:33:38.351132 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660b2b4a-3f1c-41f5-83e5-82d946c592cf None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:33:38.366829 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 594/1204] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:33:38.371118 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab232e-ed18-415a-aea0-ac7a61ef5d99 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:38.438183 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:33:38.508708 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab232e-ed18-415a-aea0-ac7a61ef5d99 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:38.552326 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ab8a6-9f1c-44ec-afe1-59445f6cbd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:38.553012 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ab8a6-9f1c-44ec-afe1-59445f6cbd9a None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:38.553299 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ab8a6-9f1c-44ec-afe1-59445f6cbd9a None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:38.553574 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ab8a6-9f1c-44ec-afe1-59445f6cbd9a None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:38.555936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ab8a6-9f1c-44ec-afe1-59445f6cbd9a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:33:38.555936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ab8a6-9f1c-44ec-afe1-59445f6cbd9a None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:33:38.578317 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 611/1205] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jul 21 03:33:38 2022] POST /identity/v3/users => generated 251 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:33:40.866540 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56c7ce-ef5f-43e5-a734-a69df95128ee None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:40.867082 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56c7ce-ef5f-43e5-a734-a69df95128ee None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:40.867082 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56c7ce-ef5f-43e5-a734-a69df95128ee None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:40.868462 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 595/1206] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:33:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:33:40.874803 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff1311-2b1b-41fa-99c9-c231c8bb55ad None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:40.875249 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff1311-2b1b-41fa-99c9-c231c8bb55ad None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:40.875436 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff1311-2b1b-41fa-99c9-c231c8bb55ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:40.894409 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-44ff1311-2b1b-41fa-99c9-c231c8bb55ad None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:33:40.895700 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-44ff1311-2b1b-41fa-99c9-c231c8bb55ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:33:40.968533 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 612/1207] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:33:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 03:33:40.993838 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56c7ce-ef5f-43e5-a734-a69df95128ee None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:41.121303 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56c7ce-ef5f-43e5-a734-a69df95128ee None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:41.158905 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a645f45-1bd5-49f3-862d-dd1dc1899a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:41.159710 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a645f45-1bd5-49f3-862d-dd1dc1899a4d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:41.159997 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a645f45-1bd5-49f3-862d-dd1dc1899a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:41.160272 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a645f45-1bd5-49f3-862d-dd1dc1899a4d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:41.171792 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a645f45-1bd5-49f3-862d-dd1dc1899a4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:33:41.180242 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-9a645f45-1bd5-49f3-862d-dd1dc1899a4d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 03:33:41.180242 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:33:41.180242 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:33:41.180242 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:33:41.180242 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:33:41.180242 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:33:41.180242 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:33:41.180242 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:33:41.180242 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:33:41.180242 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:33:41.180242 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:33:41.180242 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:33:41.180242 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:33:41.180242 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:33:41.180242 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:33:41.180242 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:33:41.181871 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:33:41.181871 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:33:41.181871 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:33:41.181871 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:33:41.181871 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:33:41.181871 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:33:41.181871 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:33:41.181871 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:33:41.181871 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:33:41.181871 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:33:41.181871 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:33:41.181871 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:33:41.181871 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:33:41.181871 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:33:41.181871 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:33:41.181871 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:33:41.182971 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:33:41.182971 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:33:41.182971 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:33:41.182971 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:33:41.182971 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:33:41.182971 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:33:41.182971 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:33:41.182971 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:33:41.182971 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:33:41.182971 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:33:41.182971 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 03:33:41.182971 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:33:41.182971 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 596/1208] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jul 21 03:33:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:33:41.187415 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff1311-2b1b-41fa-99c9-c231c8bb55ad None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:41.227965 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:33:41.301206 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff1311-2b1b-41fa-99c9-c231c8bb55ad None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:41.340256 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0125d6-185b-4063-9595-8e671d4efa5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:41.340988 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0125d6-185b-4063-9595-8e671d4efa5c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:41.341219 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0125d6-185b-4063-9595-8e671d4efa5c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:41.341493 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0125d6-185b-4063-9595-8e671d4efa5c None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:41.342247 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0125d6-185b-4063-9595-8e671d4efa5c None admin] RBAC: Adding query filter params (name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:33:41.342602 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0125d6-185b-4063-9595-8e671d4efa5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:33:41.343942 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0125d6-185b-4063-9595-8e671d4efa5c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:33:41.352735 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 613/1209] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jul 21 03:33:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:33:41.358446 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a645f45-1bd5-49f3-862d-dd1dc1899a4d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:41.413311 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:33:41.473284 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a645f45-1bd5-49f3-862d-dd1dc1899a4d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:41.509408 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62058d0-c24b-4eb5-9b31-dd9b60b17ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:41.510084 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62058d0-c24b-4eb5-9b31-dd9b60b17ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:41.510370 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62058d0-c24b-4eb5-9b31-dd9b60b17ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:41.510677 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62058d0-c24b-4eb5-9b31-dd9b60b17ae0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:41.522358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62058d0-c24b-4eb5-9b31-dd9b60b17ae0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:33:41.524139 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62058d0-c24b-4eb5-9b31-dd9b60b17ae0 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:33:41.543154 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-c62058d0-c24b-4eb5-9b31-dd9b60b17ae0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:33:41.543154 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:33:41.543154 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:33:41.543154 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:33:41.543154 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:33:41.543154 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:33:41.543154 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:33:41.543154 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:33:41.543154 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:33:41.543154 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:33:41.543154 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:33:41.543154 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:33:41.543154 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:33:41.543154 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:33:41.543154 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:33:41.544286 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:33:41.544286 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:33:41.544286 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:33:41.544286 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:33:41.544286 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:33:41.544286 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:33:41.544286 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:33:41.544286 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:33:41.544286 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:33:41.544286 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:33:41.544286 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:33:41.544286 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:33:41.544286 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:33:41.544286 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:33:41.544286 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:33:41.544286 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:33:41.544286 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:33:41.545386 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:33:41.545386 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:33:41.545386 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:33:41.545386 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:33:41.546244 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 597/1210] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:33:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:33:41.551586 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0125d6-185b-4063-9595-8e671d4efa5c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:41.660038 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:33:41.663106 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0125d6-185b-4063-9595-8e671d4efa5c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:41.701620 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467b24f-f8cc-4713-a834-6a7065c9f449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:41.702312 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467b24f-f8cc-4713-a834-6a7065c9f449 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:41.702654 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467b24f-f8cc-4713-a834-6a7065c9f449 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:41.702935 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f467b24f-f8cc-4713-a834-6a7065c9f449 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:41.703690 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f467b24f-f8cc-4713-a834-6a7065c9f449 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:33:41.704005 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f467b24f-f8cc-4713-a834-6a7065c9f449 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:33:41.706068 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f467b24f-f8cc-4713-a834-6a7065c9f449 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:33:41.724505 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 614/1211] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:33:41.730242 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62058d0-c24b-4eb5-9b31-dd9b60b17ae0 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:41.846364 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62058d0-c24b-4eb5-9b31-dd9b60b17ae0 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:41.848035 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:33:41.883522 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ccdfae-8e6e-41c3-b38c-267127f881df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:41.884492 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ccdfae-8e6e-41c3-b38c-267127f881df None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:41.884613 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ccdfae-8e6e-41c3-b38c-267127f881df None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:41.884926 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ccdfae-8e6e-41c3-b38c-267127f881df None admin] PATH_INFO: `/v3/users/placement` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:41.895002 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ccdfae-8e6e-41c3-b38c-267127f881df None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:33:41.896748 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ccdfae-8e6e-41c3-b38c-267127f881df None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:33:41.914113 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-02ccdfae-8e6e-41c3-b38c-267127f881df None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 03:33:41.914113 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:33:41.914113 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:33:41.914113 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:33:41.914113 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:33:41.914113 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:33:41.914113 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:33:41.914113 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:33:41.914113 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:33:41.914113 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:33:41.914113 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:33:41.914113 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:33:41.914113 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 03:33:41.914113 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 03:33:41.914113 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 03:33:41.914113 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 03:33:41.915730 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:33:41.915730 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:33:41.915730 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 03:33:41.915730 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:33:41.915730 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 03:33:41.915730 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:33:41.915730 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:33:41.915730 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:33:41.915730 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:33:41.915730 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:33:41.915730 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:33:41.915730 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:33:41.915730 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:33:41.915730 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:33:41.915730 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:33:41.915730 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:33:41.915730 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:33:41.915730 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:33:41.916916 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:33:41.916916 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:33:41.916916 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 03:33:41.916916 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 03:33:41.916916 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 03:33:41.916916 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 03:33:41.916916 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 03:33:41.916916 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 03:33:41.916916 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 03:33:41.916916 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:33:41.924113 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 598/1212] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:33:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:33:41.924296 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467b24f-f8cc-4713-a834-6a7065c9f449 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:42.045836 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f467b24f-f8cc-4713-a834-6a7065c9f449 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:42.084909 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebca170-8cd2-419e-9434-6bba97f3f2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:42.085686 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebca170-8cd2-419e-9434-6bba97f3f2ac None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:42.086004 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebca170-8cd2-419e-9434-6bba97f3f2ac None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:42.086339 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebca170-8cd2-419e-9434-6bba97f3f2ac None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:42.087292 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebca170-8cd2-419e-9434-6bba97f3f2ac None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:33:42.087846 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebca170-8cd2-419e-9434-6bba97f3f2ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:33:42.089052 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebca170-8cd2-419e-9434-6bba97f3f2ac None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:33:42.113826 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 615/1213] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Jul 21 03:33:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:33:42.115000 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ccdfae-8e6e-41c3-b38c-267127f881df None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:42.229933 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ccdfae-8e6e-41c3-b38c-267127f881df None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:42.266053 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c9591-d3cc-4649-a900-ab88671f975f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:42.266740 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c9591-d3cc-4649-a900-ab88671f975f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:42.267075 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c9591-d3cc-4649-a900-ab88671f975f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:42.267356 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c9591-d3cc-4649-a900-ab88671f975f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:42.307736 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:33:42.350596 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c9591-d3cc-4649-a900-ab88671f975f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:33:42.352027 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c9591-d3cc-4649-a900-ab88671f975f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:33:42.456935 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 599/1214] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:33:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 03:33:42.463010 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebca170-8cd2-419e-9434-6bba97f3f2ac None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:42.489962 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:33:42.590273 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebca170-8cd2-419e-9434-6bba97f3f2ac None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:42.628312 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac94d36-05e9-41c4-912e-1191eaf51c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:42.629241 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac94d36-05e9-41c4-912e-1191eaf51c12 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:42.629497 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac94d36-05e9-41c4-912e-1191eaf51c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:42.629878 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac94d36-05e9-41c4-912e-1191eaf51c12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:42.640208 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac94d36-05e9-41c4-912e-1191eaf51c12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:33:42.641713 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac94d36-05e9-41c4-912e-1191eaf51c12 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:33:42.661060 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-6ac94d36-05e9-41c4-912e-1191eaf51c12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:33:42.661060 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:33:42.661060 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:33:42.661060 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:33:42.661060 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:33:42.661060 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:33:42.661060 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:33:42.661060 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:33:42.661060 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:33:42.661060 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:33:42.661060 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:33:42.661060 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:33:42.661060 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:33:42.661060 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:33:42.661060 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:33:42.662198 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:33:42.662198 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:33:42.662198 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:33:42.662198 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:33:42.662198 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:33:42.662198 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:33:42.662198 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:33:42.662198 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:33:42.662198 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:33:42.662198 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:33:42.662198 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:33:42.662198 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:33:42.662198 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:33:42.662198 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:33:42.662198 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:33:42.662198 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:33:42.662198 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:33:42.663218 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:33:42.663218 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:33:42.663218 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:33:42.663218 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:33:42.667603 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 616/1215] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:33:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:33:42.668593 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c9591-d3cc-4649-a900-ab88671f975f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:42.743805 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:33:42.787969 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c9591-d3cc-4649-a900-ab88671f975f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:42.837221 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b481a60-dfbe-453b-b937-a4c84df80c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:42.838029 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b481a60-dfbe-453b-b937-a4c84df80c51 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:42.838353 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b481a60-dfbe-453b-b937-a4c84df80c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:42.838735 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b481a60-dfbe-453b-b937-a4c84df80c51 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:42.839639 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b481a60-dfbe-453b-b937-a4c84df80c51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:33:42.839980 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b481a60-dfbe-453b-b937-a4c84df80c51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:33:42.841512 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b481a60-dfbe-453b-b937-a4c84df80c51 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:33:42.859484 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 600/1216] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:33:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:33:42.860684 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac94d36-05e9-41c4-912e-1191eaf51c12 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:42.935978 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:33:42.971599 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac94d36-05e9-41c4-912e-1191eaf51c12 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:43.007498 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad419f4c-516a-4063-8593-a0ea967332ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:43.008294 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad419f4c-516a-4063-8593-a0ea967332ef None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:43.008579 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad419f4c-516a-4063-8593-a0ea967332ef None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:43.008854 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad419f4c-516a-4063-8593-a0ea967332ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:43.015815 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad419f4c-516a-4063-8593-a0ea967332ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:33:43.017508 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad419f4c-516a-4063-8593-a0ea967332ef None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:33:43.034073 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-ad419f4c-516a-4063-8593-a0ea967332ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:33:43.034073 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:33:43.034073 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:33:43.034073 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:33:43.034073 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:33:43.034073 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:33:43.034073 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:33:43.034073 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:33:43.034073 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:33:43.034073 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:33:43.034073 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:33:43.034073 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:33:43.034073 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 03:33:43.034073 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 03:33:43.034073 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 03:33:43.035013 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 03:33:43.035013 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:33:43.035013 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:33:43.035013 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:33:43.035013 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:33:43.035013 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:33:43.035013 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:33:43.035013 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:33:43.035013 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:33:43.035013 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:33:43.035013 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:33:43.035013 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:33:43.035013 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:33:43.035013 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:33:43.035013 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:33:43.035013 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:33:43.035013 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:33:43.035909 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 03:33:43.035909 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 03:33:43.035909 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 03:33:43.035909 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 03:33:43.035909 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 03:33:43.035909 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 03:33:43.035909 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:33:43.035909 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:33:43.035909 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 617/1217] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:33:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:33:43.041349 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b481a60-dfbe-453b-b937-a4c84df80c51 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:43.159716 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b481a60-dfbe-453b-b937-a4c84df80c51 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:43.184839 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:33:43.200797 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312addae-be12-42aa-9101-653b80f1ce69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:43.203119 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312addae-be12-42aa-9101-653b80f1ce69 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:43.203119 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312addae-be12-42aa-9101-653b80f1ce69 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:43.203119 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312addae-be12-42aa-9101-653b80f1ce69 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:43.203420 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312addae-be12-42aa-9101-653b80f1ce69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:33:43.203624 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312addae-be12-42aa-9101-653b80f1ce69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:33:43.204978 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312addae-be12-42aa-9101-653b80f1ce69 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:33:43.219467 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 601/1218] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 03:33:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:33:43.225489 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad419f4c-516a-4063-8593-a0ea967332ef None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:43.338096 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad419f4c-516a-4063-8593-a0ea967332ef None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:43.368861 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:33:43.376095 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1675c4c1-632c-4b9a-acc7-11fca1772330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:43.376821 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675c4c1-632c-4b9a-acc7-11fca1772330 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:43.377627 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675c4c1-632c-4b9a-acc7-11fca1772330 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:43.377973 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675c4c1-632c-4b9a-acc7-11fca1772330 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:43.379040 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1675c4c1-632c-4b9a-acc7-11fca1772330 None admin] RBAC: Adding query filter params (role.id=3d204e16b7214bf29bde33739ca9006a, scope.project.id=0432303daa8b4304a8e07032d6a80781, user.id=cb39129b3ed04db28ed01860b37bd714) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:33:43.379356 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1675c4c1-632c-4b9a-acc7-11fca1772330 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:33:43.380949 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1675c4c1-632c-4b9a-acc7-11fca1772330 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:33:43.387531 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 618/1219] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:33:43 2022] GET /identity/v3/role_assignments?user.id=cb39129b3ed04db28ed01860b37bd714&scope.project.id=0432303daa8b4304a8e07032d6a80781&role.id=3d204e16b7214bf29bde33739ca9006a => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:33:45.540764 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac6d34-530e-4c3d-815a-5f6e80769fbd None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:45.541328 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac6d34-530e-4c3d-815a-5f6e80769fbd None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:45.541328 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac6d34-530e-4c3d-815a-5f6e80769fbd None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:45.542698 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 602/1220] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:33:45.547828 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f36d24-3c8b-410a-87fe-f34a9b44e6e1 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:45.548207 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f36d24-3c8b-410a-87fe-f34a9b44e6e1 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:45.548400 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f36d24-3c8b-410a-87fe-f34a9b44e6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:45.565546 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b6f36d24-3c8b-410a-87fe-f34a9b44e6e1 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:33:45.566819 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b6f36d24-3c8b-410a-87fe-f34a9b44e6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:33:45.633620 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 619/1221] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:33:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 03:33:45.656434 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac6d34-530e-4c3d-815a-5f6e80769fbd None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:45.778538 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac6d34-530e-4c3d-815a-5f6e80769fbd None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:45.818534 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ea683a-ecfe-4389-9d91-19dee9c4be5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:45.819283 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea683a-ecfe-4389-9d91-19dee9c4be5a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:45.819572 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea683a-ecfe-4389-9d91-19dee9c4be5a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:45.819851 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea683a-ecfe-4389-9d91-19dee9c4be5a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:45.829871 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ea683a-ecfe-4389-9d91-19dee9c4be5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:33:45.838134 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-a1ea683a-ecfe-4389-9d91-19dee9c4be5a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 03:33:45.838134 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:33:45.838134 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:33:45.838134 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:33:45.838134 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:33:45.838134 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:33:45.838134 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:33:45.838134 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:33:45.838134 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:33:45.838134 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:33:45.838134 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:33:45.838134 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:33:45.838134 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:33:45.838134 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:33:45.838134 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:33:45.838134 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:33:45.839304 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:33:45.839304 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:33:45.839304 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:33:45.839304 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:33:45.839304 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:33:45.839304 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:33:45.839304 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:33:45.839304 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:33:45.839304 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:33:45.839304 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:33:45.839304 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:33:45.839304 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:33:45.839304 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:33:45.839304 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:33:45.839304 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:33:45.839304 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:33:45.840208 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:33:45.840208 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:33:45.840208 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:33:45.840208 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:33:45.840208 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:33:45.840208 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:33:45.840208 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:33:45.840208 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:33:45.840208 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:33:45.840208 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:33:45.840208 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 03:33:45.840208 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:33:45.840208 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 603/1222] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jul 21 03:33:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:33:45.845376 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f36d24-3c8b-410a-87fe-f34a9b44e6e1 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:45.947277 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f36d24-3c8b-410a-87fe-f34a9b44e6e1 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:45.974963 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:33:45.986358 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f043c-2215-49bb-baab-f3935f4a48ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:45.987058 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f043c-2215-49bb-baab-f3935f4a48ed None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:45.987345 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f043c-2215-49bb-baab-f3935f4a48ed None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:45.987623 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f043c-2215-49bb-baab-f3935f4a48ed None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:45.988374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f043c-2215-49bb-baab-f3935f4a48ed None admin] RBAC: Adding query filter params (name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:33:45.988687 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f043c-2215-49bb-baab-f3935f4a48ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:33:45.990053 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f043c-2215-49bb-baab-f3935f4a48ed None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:33:46.004084 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 620/1223] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jul 21 03:33:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:33:46.005272 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ea683a-ecfe-4389-9d91-19dee9c4be5a None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:46.050992 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:33:46.111582 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ea683a-ecfe-4389-9d91-19dee9c4be5a None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:46.145389 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3ea10-b8cd-4556-ad34-99c2ae522227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:46.146194 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3ea10-b8cd-4556-ad34-99c2ae522227 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:46.146499 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3ea10-b8cd-4556-ad34-99c2ae522227 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:46.146782 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3ea10-b8cd-4556-ad34-99c2ae522227 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:46.160527 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf3ea10-b8cd-4556-ad34-99c2ae522227 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:33:46.161997 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf3ea10-b8cd-4556-ad34-99c2ae522227 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:33:46.179215 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-8bf3ea10-b8cd-4556-ad34-99c2ae522227 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:33:46.179215 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:33:46.179215 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:33:46.179215 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:33:46.179215 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:33:46.179215 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:33:46.179215 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:33:46.179215 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:33:46.179215 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:33:46.179215 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:33:46.179215 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:33:46.179215 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:33:46.179215 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:33:46.179215 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:33:46.179215 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:33:46.180304 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:33:46.180304 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:33:46.180304 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:33:46.180304 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:33:46.180304 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:33:46.180304 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:33:46.180304 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:33:46.180304 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:33:46.180304 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:33:46.180304 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:33:46.180304 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:33:46.180304 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:33:46.180304 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:33:46.180304 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:33:46.180304 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:33:46.180304 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:33:46.180304 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:33:46.181285 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:33:46.181285 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:33:46.181285 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:33:46.181285 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:33:46.181285 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 604/1224] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:33:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:33:46.186768 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f043c-2215-49bb-baab-f3935f4a48ed None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:46.289955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f043c-2215-49bb-baab-f3935f4a48ed None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:46.326102 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68ec71-1084-4a57-acee-fe9d9e5c4dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:46.326796 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68ec71-1084-4a57-acee-fe9d9e5c4dfa None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:46.327098 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68ec71-1084-4a57-acee-fe9d9e5c4dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:46.327426 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68ec71-1084-4a57-acee-fe9d9e5c4dfa None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:46.328350 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc68ec71-1084-4a57-acee-fe9d9e5c4dfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:33:46.328733 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc68ec71-1084-4a57-acee-fe9d9e5c4dfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:33:46.330898 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc68ec71-1084-4a57-acee-fe9d9e5c4dfa None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:33:46.344484 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 621/1225] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:33:46.350728 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3ea10-b8cd-4556-ad34-99c2ae522227 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:46.457818 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:33:46.466310 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3ea10-b8cd-4556-ad34-99c2ae522227 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:46.504323 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ac53f-352e-4f28-92d3-8d62d04bdd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:46.505168 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ac53f-352e-4f28-92d3-8d62d04bdd39 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:46.505452 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ac53f-352e-4f28-92d3-8d62d04bdd39 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:46.505724 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5ac53f-352e-4f28-92d3-8d62d04bdd39 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:46.513532 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ac53f-352e-4f28-92d3-8d62d04bdd39 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:33:46.515108 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5ac53f-352e-4f28-92d3-8d62d04bdd39 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:33:46.530429 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-6a5ac53f-352e-4f28-92d3-8d62d04bdd39 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 03:33:46.530429 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:33:46.530429 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:33:46.530429 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:33:46.530429 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:33:46.530429 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:33:46.530429 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:33:46.530429 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:33:46.530429 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:33:46.530429 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:33:46.530429 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:33:46.530429 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:33:46.530429 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 03:33:46.530429 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 03:33:46.530429 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 03:33:46.530429 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 03:33:46.531586 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:33:46.531586 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:33:46.531586 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 03:33:46.531586 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:33:46.531586 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 03:33:46.531586 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:33:46.531586 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:33:46.531586 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:33:46.531586 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:33:46.531586 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:33:46.531586 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:33:46.531586 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:33:46.531586 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:33:46.531586 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:33:46.531586 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:33:46.531586 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:33:46.531586 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:33:46.531586 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:33:46.532750 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:33:46.532750 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:33:46.532750 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 03:33:46.532750 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 03:33:46.532750 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 03:33:46.532750 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 03:33:46.532750 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 03:33:46.532750 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 03:33:46.532750 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 03:33:46.532750 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:33:46.532750 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 605/1226] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:33:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:33:46.537459 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68ec71-1084-4a57-acee-fe9d9e5c4dfa None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:46.589857 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:33:46.651433 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68ec71-1084-4a57-acee-fe9d9e5c4dfa None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:46.689050 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1fc55-3273-4992-b654-f16a96cc402f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:46.690368 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1fc55-3273-4992-b654-f16a96cc402f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:46.690769 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1fc55-3273-4992-b654-f16a96cc402f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:46.691051 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1fc55-3273-4992-b654-f16a96cc402f None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:46.691920 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c1fc55-3273-4992-b654-f16a96cc402f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:33:46.692239 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c1fc55-3273-4992-b654-f16a96cc402f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:33:46.693663 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c1fc55-3273-4992-b654-f16a96cc402f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:33:46.716072 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 622/1227] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Jul 21 03:33:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:33:46.721958 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ac53f-352e-4f28-92d3-8d62d04bdd39 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:46.826148 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5ac53f-352e-4f28-92d3-8d62d04bdd39 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:46.860349 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37a38f-94fb-4b8e-82c8-6c81d01f533c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:46.861156 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37a38f-94fb-4b8e-82c8-6c81d01f533c None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:46.861492 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37a38f-94fb-4b8e-82c8-6c81d01f533c None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:46.861765 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37a38f-94fb-4b8e-82c8-6c81d01f533c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:46.873122 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e37a38f-94fb-4b8e-82c8-6c81d01f533c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:33:46.874625 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e37a38f-94fb-4b8e-82c8-6c81d01f533c None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:33:46.894833 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-5e37a38f-94fb-4b8e-82c8-6c81d01f533c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:33:46.894833 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:33:46.894833 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:33:46.894833 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:33:46.894833 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:33:46.894833 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:33:46.894833 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:33:46.894833 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:33:46.894833 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:33:46.894833 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:33:46.894833 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:33:46.894833 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:33:46.894833 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:33:46.894833 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:33:46.894833 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:33:46.895943 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:33:46.895943 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:33:46.895943 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:33:46.895943 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:33:46.895943 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:33:46.895943 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:33:46.895943 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:33:46.895943 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:33:46.895943 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:33:46.895943 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:33:46.895943 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:33:46.895943 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:33:46.895943 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:33:46.895943 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:33:46.895943 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:33:46.895943 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:33:46.895943 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:33:46.901888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:33:46.901888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:33:46.901888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:33:46.901888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:33:46.901888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 606/1228] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:33:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:33:46.902333 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1fc55-3273-4992-b654-f16a96cc402f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:47.018693 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1fc55-3273-4992-b654-f16a96cc402f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:47.020936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:33:47.057045 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ac3cc-0e3a-4b91-9fb5-2b9a3947fc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:47.057712 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ac3cc-0e3a-4b91-9fb5-2b9a3947fc7d None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:47.058002 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ac3cc-0e3a-4b91-9fb5-2b9a3947fc7d None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:47.058283 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ac3cc-0e3a-4b91-9fb5-2b9a3947fc7d None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:47.059052 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ac3cc-0e3a-4b91-9fb5-2b9a3947fc7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:33:47.059362 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ac3cc-0e3a-4b91-9fb5-2b9a3947fc7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:33:47.060726 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ac3cc-0e3a-4b91-9fb5-2b9a3947fc7d None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:33:47.073702 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 623/1229] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:33:47.079403 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37a38f-94fb-4b8e-82c8-6c81d01f533c None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:47.090987 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:33:47.189240 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37a38f-94fb-4b8e-82c8-6c81d01f533c None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:47.226195 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dc409d-b9fe-4a52-b6bc-9d267bc6c852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:47.227129 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc409d-b9fe-4a52-b6bc-9d267bc6c852 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:47.227419 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc409d-b9fe-4a52-b6bc-9d267bc6c852 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:47.227707 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc409d-b9fe-4a52-b6bc-9d267bc6c852 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:47.235445 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dc409d-b9fe-4a52-b6bc-9d267bc6c852 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:33:47.237185 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dc409d-b9fe-4a52-b6bc-9d267bc6c852 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:33:47.253690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-e1dc409d-b9fe-4a52-b6bc-9d267bc6c852 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:33:47.253690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:33:47.253690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:33:47.253690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:33:47.253690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:33:47.253690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:33:47.253690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:33:47.253690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:33:47.253690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:33:47.253690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:33:47.253690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:33:47.253690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:33:47.253690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 03:33:47.253690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 03:33:47.253690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 03:33:47.254724 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 03:33:47.254724 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:33:47.254724 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:33:47.254724 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:33:47.254724 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:33:47.254724 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:33:47.254724 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:33:47.254724 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:33:47.254724 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:33:47.254724 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:33:47.254724 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:33:47.254724 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:33:47.254724 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:33:47.254724 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:33:47.254724 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:33:47.254724 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:33:47.254724 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:33:47.255636 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 03:33:47.255636 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 03:33:47.255636 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 03:33:47.255636 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 03:33:47.255636 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 03:33:47.255636 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 03:33:47.255636 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:33:47.255636 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:33:47.255636 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 607/1230] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:33:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:33:47.261783 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ac3cc-0e3a-4b91-9fb5-2b9a3947fc7d None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:47.375353 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ac3cc-0e3a-4b91-9fb5-2b9a3947fc7d None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:47.413641 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b3d74-588e-4484-a30c-1360888e585b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:47.414299 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b3d74-588e-4484-a30c-1360888e585b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:47.414619 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b3d74-588e-4484-a30c-1360888e585b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:47.414892 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b3d74-588e-4484-a30c-1360888e585b None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:47.415673 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4b3d74-588e-4484-a30c-1360888e585b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:33:47.417680 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4b3d74-588e-4484-a30c-1360888e585b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:33:47.417680 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4b3d74-588e-4484-a30c-1360888e585b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:33:47.433828 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 624/1231] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 03:33:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:33:47.441106 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dc409d-b9fe-4a52-b6bc-9d267bc6c852 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:47.521202 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:33:47.556221 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dc409d-b9fe-4a52-b6bc-9d267bc6c852 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:47.591814 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667a9a5-21f6-4f92-b2e0-f606aab1f3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:47.592692 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667a9a5-21f6-4f92-b2e0-f606aab1f3ee None admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:47.592974 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667a9a5-21f6-4f92-b2e0-f606aab1f3ee None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:47.593264 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667a9a5-21f6-4f92-b2e0-f606aab1f3ee None admin] PATH_INFO: `/v3/projects/0432303daa8b4304a8e07032d6a80781/users/cb39129b3ed04db28ed01860b37bd714/roles/3d204e16b7214bf29bde33739ca9006a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:47.610753 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5667a9a5-21f6-4f92-b2e0-f606aab1f3ee None admin] RBAC: Authorizing `identity:create_grant(project_id=0432303daa8b4304a8e07032d6a80781, user_id=cb39129b3ed04db28ed01860b37bd714, role_id=3d204e16b7214bf29bde33739ca9006a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:33:47.612979 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5667a9a5-21f6-4f92-b2e0-f606aab1f3ee None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:33:47.626707 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 608/1232] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 03:33:47 2022] PUT /identity/v3/projects/0432303daa8b4304a8e07032d6a80781/users/cb39129b3ed04db28ed01860b37bd714/roles/3d204e16b7214bf29bde33739ca9006a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:33:49.801810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f4c84-227d-467a-83a7-c8517c1240de None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:49.802335 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f4c84-227d-467a-83a7-c8517c1240de None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:49.802490 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f4c84-227d-467a-83a7-c8517c1240de None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:49.804134 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 625/1233] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:33:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 03:33:49.809629 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007cb589-8595-486d-b392-2c2fecc572bd None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:49.810081 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007cb589-8595-486d-b392-2c2fecc572bd None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:49.810190 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007cb589-8595-486d-b392-2c2fecc572bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:49.827248 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-007cb589-8595-486d-b392-2c2fecc572bd None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:33:49.828446 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-007cb589-8595-486d-b392-2c2fecc572bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:33:49.901262 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 609/1234] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:33:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 03:33:49.927028 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f4c84-227d-467a-83a7-c8517c1240de None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:49.958675 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:33:50.043428 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f4c84-227d-467a-83a7-c8517c1240de None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:50.080977 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ccc96-7e2e-4153-9d4a-0f26f38800a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:50.081953 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ccc96-7e2e-4153-9d4a-0f26f38800a2 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:50.082326 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ccc96-7e2e-4153-9d4a-0f26f38800a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:50.082472 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ccc96-7e2e-4153-9d4a-0f26f38800a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:50.093250 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ccc96-7e2e-4153-9d4a-0f26f38800a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:33:50.102242 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-d39ccc96-7e2e-4153-9d4a-0f26f38800a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 03:33:50.102242 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:33:50.102242 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:33:50.102242 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:33:50.102242 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:33:50.102242 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:33:50.102242 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:33:50.102242 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:33:50.102242 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:33:50.102242 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:33:50.102242 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:33:50.102242 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:33:50.102242 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:33:50.102242 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:33:50.102242 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:33:50.102242 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:33:50.103410 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:33:50.103410 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:33:50.103410 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:33:50.103410 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:33:50.103410 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:33:50.103410 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:33:50.103410 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:33:50.103410 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:33:50.103410 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:33:50.103410 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:33:50.103410 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:33:50.103410 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:33:50.103410 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:33:50.103410 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:33:50.103410 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:33:50.103410 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:33:50.104358 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:33:50.104358 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:33:50.104358 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:33:50.104358 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:33:50.104358 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:33:50.104358 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:33:50.104358 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:33:50.104358 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:33:50.104358 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:33:50.104358 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:33:50.104358 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 03:33:50.104358 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:33:50.104358 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 626/1235] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jul 21 03:33:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:33:50.109769 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007cb589-8595-486d-b392-2c2fecc572bd None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:50.158954 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:33:50.218017 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007cb589-8595-486d-b392-2c2fecc572bd None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:50.257907 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e62e4f-bce4-4773-841a-af9c0bacbc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:50.258816 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e62e4f-bce4-4773-841a-af9c0bacbc39 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:50.259243 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e62e4f-bce4-4773-841a-af9c0bacbc39 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:50.259629 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e62e4f-bce4-4773-841a-af9c0bacbc39 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:50.260617 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e62e4f-bce4-4773-841a-af9c0bacbc39 None admin] RBAC: Adding query filter params (name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:33:50.261016 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e62e4f-bce4-4773-841a-af9c0bacbc39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:33:50.262767 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e62e4f-bce4-4773-841a-af9c0bacbc39 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:33:50.276456 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 610/1236] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jul 21 03:33:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:33:50.282631 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ccc96-7e2e-4153-9d4a-0f26f38800a2 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:50.375627 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:33:50.392843 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ccc96-7e2e-4153-9d4a-0f26f38800a2 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:50.427506 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd863d0-c45f-4af0-9a5f-e01234ec3ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:50.428296 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd863d0-c45f-4af0-9a5f-e01234ec3ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:50.428578 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd863d0-c45f-4af0-9a5f-e01234ec3ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:50.428848 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd863d0-c45f-4af0-9a5f-e01234ec3ec0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:50.439984 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd863d0-c45f-4af0-9a5f-e01234ec3ec0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:33:50.441406 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd863d0-c45f-4af0-9a5f-e01234ec3ec0 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:33:50.460679 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-0fd863d0-c45f-4af0-9a5f-e01234ec3ec0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:33:50.460679 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:33:50.460679 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:33:50.460679 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:33:50.460679 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:33:50.460679 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:33:50.460679 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:33:50.460679 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:33:50.460679 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:33:50.460679 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:33:50.460679 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:33:50.460679 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:33:50.460679 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:33:50.460679 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:33:50.460679 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:33:50.461663 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:33:50.461663 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:33:50.461663 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:33:50.461663 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:33:50.461663 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:33:50.461663 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:33:50.461663 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:33:50.461663 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:33:50.461663 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:33:50.461663 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:33:50.461663 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:33:50.461663 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:33:50.461663 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:33:50.461663 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:33:50.461663 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:33:50.461663 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:33:50.461663 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:33:50.463180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:33:50.463180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:33:50.463180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:33:50.463180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:33:50.463180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 627/1237] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:33:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:33:50.467888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e62e4f-bce4-4773-841a-af9c0bacbc39 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:50.577955 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e62e4f-bce4-4773-841a-af9c0bacbc39 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:50.587650 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:33:50.613117 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e179730-7a4e-445d-9007-91d739f62d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:50.613896 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e179730-7a4e-445d-9007-91d739f62d02 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:50.614253 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e179730-7a4e-445d-9007-91d739f62d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:50.614628 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e179730-7a4e-445d-9007-91d739f62d02 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:50.615419 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e179730-7a4e-445d-9007-91d739f62d02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:33:50.615800 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e179730-7a4e-445d-9007-91d739f62d02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:33:50.617257 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e179730-7a4e-445d-9007-91d739f62d02 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:33:50.634658 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 611/1238] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:33:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:33:50.635852 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd863d0-c45f-4af0-9a5f-e01234ec3ec0 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:50.744654 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd863d0-c45f-4af0-9a5f-e01234ec3ec0 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:50.779458 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c29d2d-ffd1-4f6f-8cf8-053dd7d7beb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:50.780363 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c29d2d-ffd1-4f6f-8cf8-053dd7d7beb6 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:50.780721 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c29d2d-ffd1-4f6f-8cf8-053dd7d7beb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:50.781072 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c29d2d-ffd1-4f6f-8cf8-053dd7d7beb6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:50.785016 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:33:50.790227 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c29d2d-ffd1-4f6f-8cf8-053dd7d7beb6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:33:50.791994 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c29d2d-ffd1-4f6f-8cf8-053dd7d7beb6 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:33:50.808388 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-63c29d2d-ffd1-4f6f-8cf8-053dd7d7beb6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 03:33:50.808388 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:33:50.808388 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:33:50.808388 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:33:50.808388 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:33:50.808388 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:33:50.808388 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:33:50.808388 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:33:50.808388 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:33:50.808388 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:33:50.808388 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:33:50.808388 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:33:50.808388 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 03:33:50.808388 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 03:33:50.808388 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 03:33:50.808388 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 03:33:50.815459 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:33:50.815459 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:33:50.815459 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 03:33:50.815459 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:33:50.815459 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 03:33:50.815459 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:33:50.815459 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:33:50.815459 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:33:50.815459 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:33:50.815459 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:33:50.815459 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:33:50.815459 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:33:50.815459 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:33:50.815459 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:33:50.815459 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:33:50.815459 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:33:50.815459 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:33:50.815459 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:33:50.816778 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:33:50.816778 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:33:50.816778 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 03:33:50.816778 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 03:33:50.816778 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 03:33:50.816778 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 03:33:50.816778 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 03:33:50.816778 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 03:33:50.816778 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 03:33:50.816778 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:33:50.816778 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 628/1239] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:33:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:33:50.817496 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e179730-7a4e-445d-9007-91d739f62d02 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:50.931728 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e179730-7a4e-445d-9007-91d739f62d02 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:50.968320 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee8b8d-c487-4d92-9b03-5df20a938a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:50.968987 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee8b8d-c487-4d92-9b03-5df20a938a7e None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:50.969265 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee8b8d-c487-4d92-9b03-5df20a938a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:50.969533 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ee8b8d-c487-4d92-9b03-5df20a938a7e None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:50.970370 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ee8b8d-c487-4d92-9b03-5df20a938a7e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:33:50.971222 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ee8b8d-c487-4d92-9b03-5df20a938a7e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:33:50.972652 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ee8b8d-c487-4d92-9b03-5df20a938a7e None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:33:50.991992 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 612/1240] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Jul 21 03:33:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:33:50.998150 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c29d2d-ffd1-4f6f-8cf8-053dd7d7beb6 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:51.111374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c29d2d-ffd1-4f6f-8cf8-053dd7d7beb6 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:51.152326 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097f4dc-55df-4510-a027-1aa39bb35441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:51.152979 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097f4dc-55df-4510-a027-1aa39bb35441 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:51.153267 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097f4dc-55df-4510-a027-1aa39bb35441 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:51.153546 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0097f4dc-55df-4510-a027-1aa39bb35441 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:51.223225 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:33:51.231623 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0097f4dc-55df-4510-a027-1aa39bb35441 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:33:51.233497 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0097f4dc-55df-4510-a027-1aa39bb35441 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:33:51.347770 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 629/1241] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:33:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 03:33:51.353917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee8b8d-c487-4d92-9b03-5df20a938a7e None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:51.383963 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:33:51.467324 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ee8b8d-c487-4d92-9b03-5df20a938a7e None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:51.511148 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a966a-34c8-4291-a6f9-431edf42e25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:51.511931 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a966a-34c8-4291-a6f9-431edf42e25d None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:51.512210 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a966a-34c8-4291-a6f9-431edf42e25d None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:51.512522 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a966a-34c8-4291-a6f9-431edf42e25d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:51.524729 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a966a-34c8-4291-a6f9-431edf42e25d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:33:51.526222 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a966a-34c8-4291-a6f9-431edf42e25d None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:33:51.543617 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-919a966a-34c8-4291-a6f9-431edf42e25d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:33:51.543617 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:33:51.543617 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:33:51.543617 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:33:51.543617 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:33:51.543617 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:33:51.543617 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:33:51.543617 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:33:51.543617 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:33:51.543617 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:33:51.543617 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:33:51.543617 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:33:51.543617 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:33:51.543617 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:33:51.543617 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:33:51.544549 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:33:51.544549 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:33:51.544549 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:33:51.544549 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:33:51.544549 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:33:51.544549 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:33:51.544549 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:33:51.544549 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:33:51.544549 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:33:51.544549 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:33:51.544549 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:33:51.544549 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:33:51.544549 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:33:51.544549 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:33:51.544549 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:33:51.544549 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:33:51.544549 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:33:51.545520 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:33:51.545520 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:33:51.545520 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:33:51.545520 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:33:51.546892 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 613/1242] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:33:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:33:51.550829 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097f4dc-55df-4510-a027-1aa39bb35441 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:51.653943 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:33:51.660798 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0097f4dc-55df-4510-a027-1aa39bb35441 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:51.700607 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f9313-c283-45d8-b4cd-fe0cb9ae267f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:51.701294 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f9313-c283-45d8-b4cd-fe0cb9ae267f None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:51.701568 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f9313-c283-45d8-b4cd-fe0cb9ae267f None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:51.701846 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f9313-c283-45d8-b4cd-fe0cb9ae267f None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:51.702611 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f9313-c283-45d8-b4cd-fe0cb9ae267f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:33:51.702929 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f9313-c283-45d8-b4cd-fe0cb9ae267f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:33:51.704314 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f9313-c283-45d8-b4cd-fe0cb9ae267f None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:33:51.717184 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 630/1243] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:33:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:33:51.722816 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a966a-34c8-4291-a6f9-431edf42e25d None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:51.819607 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:33:51.843894 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a966a-34c8-4291-a6f9-431edf42e25d None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:51.882704 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ad368-2279-4591-91a7-20a50eed7e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:51.883435 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ad368-2279-4591-91a7-20a50eed7e45 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:51.883731 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ad368-2279-4591-91a7-20a50eed7e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:51.884021 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099ad368-2279-4591-91a7-20a50eed7e45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:51.891191 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ad368-2279-4591-91a7-20a50eed7e45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:33:51.892685 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099ad368-2279-4591-91a7-20a50eed7e45 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:33:51.906565 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-099ad368-2279-4591-91a7-20a50eed7e45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:33:51.906565 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:33:51.906565 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:33:51.906565 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:33:51.906565 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:33:51.906565 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:33:51.906565 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:33:51.906565 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:33:51.906565 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:33:51.906565 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:33:51.906565 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:33:51.906565 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:33:51.906565 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 03:33:51.906565 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 03:33:51.906565 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 03:33:51.912679 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 03:33:51.912679 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:33:51.912679 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:33:51.912679 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:33:51.912679 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:33:51.912679 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:33:51.912679 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:33:51.912679 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:33:51.912679 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:33:51.912679 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:33:51.912679 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:33:51.912679 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:33:51.912679 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:33:51.912679 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:33:51.912679 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:33:51.912679 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:33:51.912679 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:33:51.913668 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 03:33:51.913668 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 03:33:51.913668 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 03:33:51.913668 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 03:33:51.913668 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 03:33:51.913668 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 03:33:51.913668 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:33:51.913668 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:33:51.913668 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 614/1244] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:33:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:33:51.914151 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f9313-c283-45d8-b4cd-fe0cb9ae267f None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:52.022889 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f9313-c283-45d8-b4cd-fe0cb9ae267f None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:52.058689 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a70718-7362-420b-88e8-71107728dc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:52.059340 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a70718-7362-420b-88e8-71107728dc27 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:52.059627 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a70718-7362-420b-88e8-71107728dc27 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:52.059900 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a70718-7362-420b-88e8-71107728dc27 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:52.060667 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a70718-7362-420b-88e8-71107728dc27 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:33:52.060968 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a70718-7362-420b-88e8-71107728dc27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:33:52.062382 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a70718-7362-420b-88e8-71107728dc27 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:33:52.075512 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 631/1245] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 03:33:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:33:52.081623 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ad368-2279-4591-91a7-20a50eed7e45 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:52.192766 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099ad368-2279-4591-91a7-20a50eed7e45 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:52.231136 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59764f-fad6-4174-abf4-220d63305525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:52.231980 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59764f-fad6-4174-abf4-220d63305525 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:52.232416 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59764f-fad6-4174-abf4-220d63305525 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:52.232787 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59764f-fad6-4174-abf4-220d63305525 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:52.233884 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59764f-fad6-4174-abf4-220d63305525 None admin] RBAC: Adding query filter params (role.id=3d204e16b7214bf29bde33739ca9006a, scope.project.id=0432303daa8b4304a8e07032d6a80781, user.id=cb39129b3ed04db28ed01860b37bd714) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:33:52.234236 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59764f-fad6-4174-abf4-220d63305525 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:33:52.235997 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59764f-fad6-4174-abf4-220d63305525 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:33:52.243115 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 615/1246] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:33:52 2022] GET /identity/v3/role_assignments?user.id=cb39129b3ed04db28ed01860b37bd714&scope.project.id=0432303daa8b4304a8e07032d6a80781&role.id=3d204e16b7214bf29bde33739ca9006a => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:33:54.636765 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34c122-a0dc-43f8-88b2-7719aa4442ba None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:54.637299 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34c122-a0dc-43f8-88b2-7719aa4442ba None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:54.637299 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34c122-a0dc-43f8-88b2-7719aa4442ba None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:54.638961 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 632/1247] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:33:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:33:54.644969 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e0b4f-b23c-4e15-8366-c70dc07378fd None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:54.645365 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e0b4f-b23c-4e15-8366-c70dc07378fd None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:54.645680 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e0b4f-b23c-4e15-8366-c70dc07378fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:54.651002 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:33:54.663537 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-147e0b4f-b23c-4e15-8366-c70dc07378fd None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:33:54.664740 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-147e0b4f-b23c-4e15-8366-c70dc07378fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:33:54.748534 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 616/1248] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:33:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 03:33:54.774501 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34c122-a0dc-43f8-88b2-7719aa4442ba None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:54.794026 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:33:54.888235 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34c122-a0dc-43f8-88b2-7719aa4442ba None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:54.931856 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471444dc-6aca-493d-b7b0-583156fccb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:54.932791 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471444dc-6aca-493d-b7b0-583156fccb13 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:54.933125 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471444dc-6aca-493d-b7b0-583156fccb13 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:54.933501 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471444dc-6aca-493d-b7b0-583156fccb13 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:54.945583 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471444dc-6aca-493d-b7b0-583156fccb13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:33:54.953940 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-471444dc-6aca-493d-b7b0-583156fccb13 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:33:54.953940 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:33:54.953940 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:33:54.953940 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:33:54.953940 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:33:54.953940 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:33:54.953940 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:33:54.953940 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:33:54.953940 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:33:54.953940 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:33:54.953940 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:33:54.953940 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:33:54.953940 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:33:54.953940 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:33:54.953940 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:33:54.953940 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:33:54.955429 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:33:54.955429 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:33:54.955429 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:33:54.955429 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:33:54.955429 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:33:54.955429 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:33:54.955429 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:33:54.955429 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:33:54.955429 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:33:54.955429 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:33:54.955429 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:33:54.955429 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:33:54.955429 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:33:54.955429 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:33:54.955429 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:33:54.955429 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:33:54.956304 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:33:54.956304 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:33:54.956304 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:33:54.956304 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:33:54.956304 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:33:54.956304 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:33:54.956304 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:33:54.956304 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:33:54.956304 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:33:54.956304 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:33:54.956304 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:33:54.956304 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:33:54.956304 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 633/1249] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 03:33:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:33:54.961652 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e0b4f-b23c-4e15-8366-c70dc07378fd None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:55.075700 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e0b4f-b23c-4e15-8366-c70dc07378fd None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:55.112537 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:33:55.117386 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e7e56a-3529-4a83-92ae-b3482cc2c380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:55.118163 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7e56a-3529-4a83-92ae-b3482cc2c380 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:55.118478 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7e56a-3529-4a83-92ae-b3482cc2c380 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:55.118863 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e7e56a-3529-4a83-92ae-b3482cc2c380 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:55.120004 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e7e56a-3529-4a83-92ae-b3482cc2c380 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:33:55.120183 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e7e56a-3529-4a83-92ae-b3482cc2c380 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:33:55.121590 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e7e56a-3529-4a83-92ae-b3482cc2c380 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:33:55.132276 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 617/1250] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:33:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:33:55.138356 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471444dc-6aca-493d-b7b0-583156fccb13 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:55.224825 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:33:55.250288 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471444dc-6aca-493d-b7b0-583156fccb13 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:55.286016 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34991e17-7dfa-4742-91d8-0d8fe9e67eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:55.286859 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34991e17-7dfa-4742-91d8-0d8fe9e67eb8 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:55.287227 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34991e17-7dfa-4742-91d8-0d8fe9e67eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:55.287512 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34991e17-7dfa-4742-91d8-0d8fe9e67eb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:55.300156 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34991e17-7dfa-4742-91d8-0d8fe9e67eb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:33:55.301679 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34991e17-7dfa-4742-91d8-0d8fe9e67eb8 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:33:55.320440 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-34991e17-7dfa-4742-91d8-0d8fe9e67eb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:33:55.320440 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:33:55.320440 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:33:55.320440 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:33:55.320440 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:33:55.320440 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:33:55.320440 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:33:55.320440 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:33:55.320440 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:33:55.320440 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:33:55.320440 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:33:55.320440 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:33:55.320440 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:33:55.320440 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:33:55.320440 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:33:55.321409 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:33:55.321409 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:33:55.321409 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:33:55.321409 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:33:55.321409 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:33:55.321409 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:33:55.321409 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:33:55.321409 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:33:55.321409 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:33:55.321409 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:33:55.321409 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:33:55.321409 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:33:55.321409 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:33:55.321409 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:33:55.321409 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:33:55.321409 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:33:55.321409 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:33:55.322298 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:33:55.322298 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:33:55.322298 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:33:55.322298 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:33:55.322298 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 634/1251] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:33:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:33:55.328012 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e7e56a-3529-4a83-92ae-b3482cc2c380 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:55.432439 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e7e56a-3529-4a83-92ae-b3482cc2c380 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:55.468327 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c45832-1732-49e9-b040-eb7c480a25be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:55.469072 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c45832-1732-49e9-b040-eb7c480a25be None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:55.469424 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c45832-1732-49e9-b040-eb7c480a25be None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:55.469811 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c45832-1732-49e9-b040-eb7c480a25be None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:55.471098 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c45832-1732-49e9-b040-eb7c480a25be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:33:55.471492 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c45832-1732-49e9-b040-eb7c480a25be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:33:55.473061 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c45832-1732-49e9-b040-eb7c480a25be None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:33:55.487911 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 618/1252] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:33:55.493672 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34991e17-7dfa-4742-91d8-0d8fe9e67eb8 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:55.604190 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34991e17-7dfa-4742-91d8-0d8fe9e67eb8 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:55.630905 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:33:55.639961 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d786248-b869-4639-9821-3b20af324d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:55.640768 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d786248-b869-4639-9821-3b20af324d7b None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:55.641085 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d786248-b869-4639-9821-3b20af324d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:55.641342 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d786248-b869-4639-9821-3b20af324d7b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:55.649783 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d786248-b869-4639-9821-3b20af324d7b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:33:55.651424 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d786248-b869-4639-9821-3b20af324d7b None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:33:55.666468 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-5d786248-b869-4639-9821-3b20af324d7b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 03:33:55.666468 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:33:55.666468 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:33:55.666468 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:33:55.666468 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:33:55.666468 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:33:55.666468 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:33:55.666468 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:33:55.666468 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:33:55.666468 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:33:55.666468 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:33:55.666468 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:33:55.666468 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 03:33:55.666468 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 03:33:55.666468 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 03:33:55.666468 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 03:33:55.667654 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:33:55.667654 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:33:55.667654 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 03:33:55.667654 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:33:55.667654 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 03:33:55.667654 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:33:55.667654 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:33:55.667654 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:33:55.667654 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:33:55.667654 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:33:55.667654 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:33:55.667654 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:33:55.667654 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:33:55.667654 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:33:55.667654 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:33:55.667654 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:33:55.667654 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:33:55.667654 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:33:55.668720 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:33:55.668720 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:33:55.668720 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 03:33:55.668720 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 03:33:55.668720 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 03:33:55.668720 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 03:33:55.668720 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 03:33:55.668720 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 03:33:55.668720 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 03:33:55.668720 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:33:55.668720 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 635/1253] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:33:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:33:55.673784 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c45832-1732-49e9-b040-eb7c480a25be None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:55.744573 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:33:55.794673 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c45832-1732-49e9-b040-eb7c480a25be None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:55.835267 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb33e6-8f22-4477-b1bc-208d2044c161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:55.835976 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb33e6-8f22-4477-b1bc-208d2044c161 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:55.836257 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb33e6-8f22-4477-b1bc-208d2044c161 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:55.836531 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb33e6-8f22-4477-b1bc-208d2044c161 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:55.837377 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eb33e6-8f22-4477-b1bc-208d2044c161 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:33:55.837685 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eb33e6-8f22-4477-b1bc-208d2044c161 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:33:55.839234 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eb33e6-8f22-4477-b1bc-208d2044c161 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:33:55.860137 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 619/1254] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Jul 21 03:33:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:33:55.866312 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d786248-b869-4639-9821-3b20af324d7b None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:55.973825 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d786248-b869-4639-9821-3b20af324d7b None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:56.008285 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f34c5-5ac7-4acd-8d4d-0dbdb18c1b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:56.008947 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f34c5-5ac7-4acd-8d4d-0dbdb18c1b59 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:56.009235 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f34c5-5ac7-4acd-8d4d-0dbdb18c1b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:56.009511 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6f34c5-5ac7-4acd-8d4d-0dbdb18c1b59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:56.067658 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:33:56.081970 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f34c5-5ac7-4acd-8d4d-0dbdb18c1b59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:33:56.083633 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6f34c5-5ac7-4acd-8d4d-0dbdb18c1b59 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:33:56.187436 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 636/1255] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:33:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 03:33:56.193864 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb33e6-8f22-4477-b1bc-208d2044c161 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:56.306242 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb33e6-8f22-4477-b1bc-208d2044c161 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:56.321291 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:33:56.344406 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d14e010-8f9c-47bc-8659-3817b9fce163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:56.345221 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14e010-8f9c-47bc-8659-3817b9fce163 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:56.345761 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14e010-8f9c-47bc-8659-3817b9fce163 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:56.346076 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14e010-8f9c-47bc-8659-3817b9fce163 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:56.358257 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d14e010-8f9c-47bc-8659-3817b9fce163 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:33:56.359998 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d14e010-8f9c-47bc-8659-3817b9fce163 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:33:56.378579 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-8d14e010-8f9c-47bc-8659-3817b9fce163 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:33:56.378579 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:33:56.378579 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:33:56.378579 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:33:56.378579 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:33:56.378579 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:33:56.378579 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:33:56.378579 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:33:56.378579 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:33:56.378579 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:33:56.378579 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:33:56.378579 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:33:56.378579 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:33:56.378579 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:33:56.378579 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:33:56.379682 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:33:56.379682 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:33:56.379682 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:33:56.379682 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:33:56.379682 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:33:56.379682 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:33:56.379682 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:33:56.379682 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:33:56.379682 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:33:56.379682 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:33:56.379682 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:33:56.379682 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:33:56.379682 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:33:56.379682 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:33:56.379682 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:33:56.379682 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:33:56.379682 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:33:56.380575 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:33:56.380575 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:33:56.380575 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:33:56.380575 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:33:56.380575 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 620/1256] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:33:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:33:56.385571 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f34c5-5ac7-4acd-8d4d-0dbdb18c1b59 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:56.500037 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:33:56.516903 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6f34c5-5ac7-4acd-8d4d-0dbdb18c1b59 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:56.554831 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2423f-750d-41e8-a02e-4b4e9267c926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:56.555509 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2423f-750d-41e8-a02e-4b4e9267c926 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:56.555799 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2423f-750d-41e8-a02e-4b4e9267c926 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:56.556081 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2423f-750d-41e8-a02e-4b4e9267c926 None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:56.556861 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2423f-750d-41e8-a02e-4b4e9267c926 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:33:56.557218 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2423f-750d-41e8-a02e-4b4e9267c926 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:33:56.558638 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2423f-750d-41e8-a02e-4b4e9267c926 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:33:56.572002 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 637/1257] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:33:56.577688 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d14e010-8f9c-47bc-8659-3817b9fce163 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:56.688159 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d14e010-8f9c-47bc-8659-3817b9fce163 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:56.726189 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade932e7-3d54-4764-83c2-64409fd9edb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:56.727102 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade932e7-3d54-4764-83c2-64409fd9edb8 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:56.727414 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade932e7-3d54-4764-83c2-64409fd9edb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:56.727717 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade932e7-3d54-4764-83c2-64409fd9edb8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:56.735015 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade932e7-3d54-4764-83c2-64409fd9edb8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:33:56.737156 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade932e7-3d54-4764-83c2-64409fd9edb8 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:33:56.751530 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-ade932e7-3d54-4764-83c2-64409fd9edb8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:33:56.751530 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:33:56.751530 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:33:56.751530 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:33:56.751530 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:33:56.751530 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:33:56.751530 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:33:56.751530 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:33:56.751530 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:33:56.751530 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:33:56.751530 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:33:56.751530 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:33:56.751530 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 03:33:56.751530 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 03:33:56.751530 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 03:33:56.752598 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 03:33:56.752598 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:33:56.752598 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:33:56.752598 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:33:56.752598 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:33:56.752598 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:33:56.752598 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:33:56.752598 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:33:56.752598 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:33:56.752598 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:33:56.752598 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:33:56.752598 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:33:56.752598 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:33:56.752598 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:33:56.752598 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:33:56.752598 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:33:56.752598 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:33:56.753710 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 03:33:56.753710 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 03:33:56.753710 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 03:33:56.753710 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 03:33:56.753710 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 03:33:56.753710 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 03:33:56.753710 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:33:56.753710 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:33:56.753710 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 621/1258] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:33:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:33:56.759077 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2423f-750d-41e8-a02e-4b4e9267c926 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:56.871680 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2423f-750d-41e8-a02e-4b4e9267c926 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:56.912915 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092f070-7c1e-447b-9da8-d3bf95ee5497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:56.913696 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092f070-7c1e-447b-9da8-d3bf95ee5497 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:56.913954 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092f070-7c1e-447b-9da8-d3bf95ee5497 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:56.914281 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092f070-7c1e-447b-9da8-d3bf95ee5497 None admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:56.915184 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092f070-7c1e-447b-9da8-d3bf95ee5497 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:33:56.915504 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092f070-7c1e-447b-9da8-d3bf95ee5497 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:33:56.917000 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092f070-7c1e-447b-9da8-d3bf95ee5497 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:33:56.931221 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 638/1259] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 03:33:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:33:56.937458 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade932e7-3d54-4764-83c2-64409fd9edb8 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:56.968032 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:33:57.047995 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade932e7-3d54-4764-83c2-64409fd9edb8 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:57.083702 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05db3ced-d9f4-4676-8c96-be93e5ee056b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:57.084378 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db3ced-d9f4-4676-8c96-be93e5ee056b None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:57.084664 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db3ced-d9f4-4676-8c96-be93e5ee056b None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:57.084941 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05db3ced-d9f4-4676-8c96-be93e5ee056b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:57.085798 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db3ced-d9f4-4676-8c96-be93e5ee056b None admin] RBAC: Adding query filter params (role.id=27e53d6c56f24c25a8c8057bfd36bcf1, scope.project.id=0432303daa8b4304a8e07032d6a80781, user.id=cb39129b3ed04db28ed01860b37bd714) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:33:57.086114 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db3ced-d9f4-4676-8c96-be93e5ee056b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:33:57.087633 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05db3ced-d9f4-4676-8c96-be93e5ee056b None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:33:57.093907 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 622/1260] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:33:56 2022] GET /identity/v3/role_assignments?user.id=cb39129b3ed04db28ed01860b37bd714&scope.project.id=0432303daa8b4304a8e07032d6a80781&role.id=27e53d6c56f24c25a8c8057bfd36bcf1 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:33:59.128889 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b41ad0-2dc6-42e1-9ba4-27acd5e5ebaf None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:59.129427 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b41ad0-2dc6-42e1-9ba4-27acd5e5ebaf None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:59.129427 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b41ad0-2dc6-42e1-9ba4-27acd5e5ebaf None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:59.130833 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 639/1261] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:33:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:33:59.135929 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd43882-92e0-4d47-9c00-94db93447d6f None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:59.136303 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd43882-92e0-4d47-9c00-94db93447d6f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:59.136487 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd43882-92e0-4d47-9c00-94db93447d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:59.153725 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-bbd43882-92e0-4d47-9c00-94db93447d6f None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:33:59.154941 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-bbd43882-92e0-4d47-9c00-94db93447d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:33:59.219971 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 623/1262] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:33:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 03:33:59.242145 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b41ad0-2dc6-42e1-9ba4-27acd5e5ebaf None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:59.253229 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:33:59.340967 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b41ad0-2dc6-42e1-9ba4-27acd5e5ebaf None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:59.372946 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17cb29-9b29-48fe-9095-ed9e96fab017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:59.373710 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17cb29-9b29-48fe-9095-ed9e96fab017 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:59.373992 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17cb29-9b29-48fe-9095-ed9e96fab017 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:59.374263 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17cb29-9b29-48fe-9095-ed9e96fab017 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:59.384705 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17cb29-9b29-48fe-9095-ed9e96fab017 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:33:59.392076 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-9d17cb29-9b29-48fe-9095-ed9e96fab017 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:33:59.392076 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:33:59.392076 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:33:59.392076 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:33:59.392076 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:33:59.392076 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:33:59.392076 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:33:59.392076 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:33:59.392076 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:33:59.392076 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:33:59.392076 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:33:59.392076 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:33:59.392076 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:33:59.392076 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:33:59.392076 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:33:59.392076 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:33:59.393304 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:33:59.393304 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:33:59.393304 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:33:59.393304 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:33:59.393304 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:33:59.393304 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:33:59.393304 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:33:59.393304 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:33:59.393304 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:33:59.393304 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:33:59.393304 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:33:59.393304 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:33:59.393304 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:33:59.393304 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:33:59.393304 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:33:59.393304 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:33:59.394476 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:33:59.394476 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:33:59.394476 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:33:59.394476 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:33:59.394476 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:33:59.394476 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:33:59.394476 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:33:59.394476 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:33:59.394476 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:33:59.394476 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:33:59.394476 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:33:59.394476 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:33:59.394476 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 640/1263] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 03:33:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:33:59.399506 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd43882-92e0-4d47-9c00-94db93447d6f None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:59.417024 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:33:59.501303 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd43882-92e0-4d47-9c00-94db93447d6f None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:59.538550 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f353d5-e42a-4428-ae28-ab994b152ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:59.539211 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f353d5-e42a-4428-ae28-ab994b152ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:59.539495 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f353d5-e42a-4428-ae28-ab994b152ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:59.539771 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f353d5-e42a-4428-ae28-ab994b152ba4 None admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:59.540509 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f353d5-e42a-4428-ae28-ab994b152ba4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:33:59.540817 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f353d5-e42a-4428-ae28-ab994b152ba4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:33:59.542194 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f353d5-e42a-4428-ae28-ab994b152ba4 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:33:59.550561 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 624/1264] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:33:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:33:59.556478 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17cb29-9b29-48fe-9095-ed9e96fab017 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:59.619913 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:33:59.652886 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17cb29-9b29-48fe-9095-ed9e96fab017 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:59.684442 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca5c3f-678b-4a35-8bc3-f0051b9e3fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:59.685209 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca5c3f-678b-4a35-8bc3-f0051b9e3fbf None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:59.685490 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca5c3f-678b-4a35-8bc3-f0051b9e3fbf None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:59.685757 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca5c3f-678b-4a35-8bc3-f0051b9e3fbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:59.696709 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca5c3f-678b-4a35-8bc3-f0051b9e3fbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:33:59.698130 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca5c3f-678b-4a35-8bc3-f0051b9e3fbf None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:33:59.714590 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-30ca5c3f-678b-4a35-8bc3-f0051b9e3fbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:33:59.714590 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:33:59.714590 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:33:59.714590 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:33:59.714590 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:33:59.714590 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:33:59.714590 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:33:59.714590 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:33:59.714590 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:33:59.714590 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:33:59.714590 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:33:59.714590 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:33:59.714590 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:33:59.714590 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:33:59.714590 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:33:59.715622 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:33:59.715622 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:33:59.715622 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:33:59.715622 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:33:59.715622 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:33:59.715622 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:33:59.715622 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:33:59.715622 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:33:59.715622 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:33:59.715622 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:33:59.715622 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:33:59.715622 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:33:59.715622 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:33:59.715622 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:33:59.715622 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:33:59.715622 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:33:59.715622 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:33:59.716744 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:33:59.716744 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:33:59.716744 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:33:59.716744 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:33:59.716744 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 641/1265] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:33:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:33:59.722187 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f353d5-e42a-4428-ae28-ab994b152ba4 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:59.801036 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:33:59.819878 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f353d5-e42a-4428-ae28-ab994b152ba4 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:59.852367 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbffa777-a3d9-4b10-aa23-0292d38241f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:33:59.853023 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffa777-a3d9-4b10-aa23-0292d38241f2 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:33:59.853310 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffa777-a3d9-4b10-aa23-0292d38241f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:33:59.853588 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffa777-a3d9-4b10-aa23-0292d38241f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:33:59.854338 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbffa777-a3d9-4b10-aa23-0292d38241f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:33:59.854676 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbffa777-a3d9-4b10-aa23-0292d38241f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:33:59.856093 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbffa777-a3d9-4b10-aa23-0292d38241f2 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:33:59.868062 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 625/1266] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:33:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:33:59.873854 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca5c3f-678b-4a35-8bc3-f0051b9e3fbf None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:33:59.968820 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca5c3f-678b-4a35-8bc3-f0051b9e3fbf None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:33:59.988410 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:34:00.002226 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23f016-0337-4ed0-b805-b8d3d4925c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:34:00.003040 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23f016-0337-4ed0-b805-b8d3d4925c54 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:34:00.003325 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23f016-0337-4ed0-b805-b8d3d4925c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:34:00.003600 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23f016-0337-4ed0-b805-b8d3d4925c54 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:34:00.010859 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23f016-0337-4ed0-b805-b8d3d4925c54 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:34:00.012280 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23f016-0337-4ed0-b805-b8d3d4925c54 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:34:00.026404 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-ae23f016-0337-4ed0-b805-b8d3d4925c54 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 03:34:00.026404 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:34:00.026404 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:34:00.026404 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:34:00.026404 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:34:00.026404 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:34:00.026404 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:34:00.026404 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:34:00.026404 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:34:00.026404 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:34:00.026404 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:34:00.026404 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:34:00.026404 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 03:34:00.026404 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 03:34:00.026404 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 03:34:00.026404 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 03:34:00.027539 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:34:00.027539 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:34:00.027539 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 03:34:00.027539 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:34:00.027539 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 03:34:00.027539 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:34:00.027539 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:34:00.027539 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:34:00.027539 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:34:00.027539 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:34:00.027539 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:34:00.027539 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:34:00.027539 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:34:00.027539 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:34:00.027539 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:34:00.027539 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:34:00.027539 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:34:00.027539 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:34:00.028536 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:34:00.028536 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:34:00.028536 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 03:34:00.028536 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 03:34:00.028536 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 03:34:00.028536 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 03:34:00.028536 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 03:34:00.028536 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 03:34:00.028536 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 03:34:00.028536 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:34:00.028536 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 642/1267] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:33:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:34:00.033933 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbffa777-a3d9-4b10-aa23-0292d38241f2 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:34:00.130737 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbffa777-a3d9-4b10-aa23-0292d38241f2 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:34:00.164466 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7868f2e5-4606-4caf-9889-d07264d3a441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:34:00.165127 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868f2e5-4606-4caf-9889-d07264d3a441 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:34:00.165416 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868f2e5-4606-4caf-9889-d07264d3a441 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:34:00.165696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868f2e5-4606-4caf-9889-d07264d3a441 None admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:34:00.166567 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7868f2e5-4606-4caf-9889-d07264d3a441 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:34:00.166884 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7868f2e5-4606-4caf-9889-d07264d3a441 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:34:00.168310 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7868f2e5-4606-4caf-9889-d07264d3a441 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:34:00.176686 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:34:00.184987 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 626/1268] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Jul 21 03:34:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:34:00.190549 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23f016-0337-4ed0-b805-b8d3d4925c54 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:34:00.285486 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23f016-0337-4ed0-b805-b8d3d4925c54 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:34:00.316561 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01efe4-e26f-459a-9f64-ffb9333a05ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:34:00.317327 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01efe4-e26f-459a-9f64-ffb9333a05ea None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:34:00.317609 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01efe4-e26f-459a-9f64-ffb9333a05ea None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:34:00.317881 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01efe4-e26f-459a-9f64-ffb9333a05ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:34:00.327981 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01efe4-e26f-459a-9f64-ffb9333a05ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:34:00.329400 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01efe4-e26f-459a-9f64-ffb9333a05ea None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:34:00.346760 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-cd01efe4-e26f-459a-9f64-ffb9333a05ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:34:00.346760 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:34:00.346760 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:34:00.346760 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:34:00.346760 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:34:00.346760 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:34:00.346760 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:34:00.346760 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:34:00.346760 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:34:00.346760 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:34:00.346760 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:34:00.346760 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:34:00.346760 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:34:00.346760 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:34:00.346760 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:34:00.347783 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:34:00.347783 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:34:00.347783 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:34:00.347783 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:34:00.347783 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:34:00.347783 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:34:00.347783 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:34:00.347783 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:34:00.347783 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:34:00.347783 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:34:00.347783 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:34:00.347783 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:34:00.347783 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:34:00.347783 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:34:00.347783 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:34:00.347783 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:34:00.347783 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:34:00.353164 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:34:00.353164 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:34:00.353164 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:34:00.353164 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:34:00.353164 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 643/1269] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:34:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:34:00.353504 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7868f2e5-4606-4caf-9889-d07264d3a441 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:34:00.452100 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7868f2e5-4606-4caf-9889-d07264d3a441 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:34:00.491261 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f26e4-8a36-424e-a8ac-db87d05b16da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:34:00.492177 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f26e4-8a36-424e-a8ac-db87d05b16da None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:34:00.492465 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f26e4-8a36-424e-a8ac-db87d05b16da None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:34:00.492803 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f26e4-8a36-424e-a8ac-db87d05b16da None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:34:00.493523 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f26e4-8a36-424e-a8ac-db87d05b16da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:34:00.493831 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f26e4-8a36-424e-a8ac-db87d05b16da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:34:00.495241 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f26e4-8a36-424e-a8ac-db87d05b16da None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:34:00.506694 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 627/1270] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:34:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:34:00.512337 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01efe4-e26f-459a-9f64-ffb9333a05ea None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:34:00.543623 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:34:00.610320 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01efe4-e26f-459a-9f64-ffb9333a05ea None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:34:00.643288 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05d3d5-faa7-4677-a8dd-921cfbccdfad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:34:00.644062 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05d3d5-faa7-4677-a8dd-921cfbccdfad None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:34:00.644347 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05d3d5-faa7-4677-a8dd-921cfbccdfad None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:34:00.644622 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05d3d5-faa7-4677-a8dd-921cfbccdfad None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:34:00.651460 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e05d3d5-faa7-4677-a8dd-921cfbccdfad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:34:00.652879 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e05d3d5-faa7-4677-a8dd-921cfbccdfad None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:34:00.666739 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-2e05d3d5-faa7-4677-a8dd-921cfbccdfad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:34:00.666739 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:34:00.666739 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:34:00.666739 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:34:00.666739 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:34:00.666739 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:34:00.666739 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:34:00.666739 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:34:00.666739 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:34:00.666739 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:34:00.666739 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:34:00.666739 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:34:00.666739 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 03:34:00.666739 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 03:34:00.666739 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 03:34:00.667794 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 03:34:00.667794 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:34:00.667794 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:34:00.667794 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:34:00.667794 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:34:00.667794 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:34:00.667794 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:34:00.667794 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:34:00.667794 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:34:00.667794 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:34:00.667794 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:34:00.667794 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:34:00.667794 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:34:00.667794 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:34:00.667794 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:34:00.667794 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:34:00.667794 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:34:00.668711 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 03:34:00.668711 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 03:34:00.668711 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 03:34:00.668711 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 03:34:00.668711 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 03:34:00.668711 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 03:34:00.668711 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:34:00.668711 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:34:00.668711 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 644/1271] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:34:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:34:00.673654 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f26e4-8a36-424e-a8ac-db87d05b16da None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:34:00.733185 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:34:00.775404 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f26e4-8a36-424e-a8ac-db87d05b16da None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:34:00.807044 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239bae1c-2758-479a-818e-4d4276651025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:34:00.807635 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239bae1c-2758-479a-818e-4d4276651025 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:34:00.807915 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239bae1c-2758-479a-818e-4d4276651025 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:34:00.808189 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239bae1c-2758-479a-818e-4d4276651025 None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:34:00.808973 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239bae1c-2758-479a-818e-4d4276651025 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:34:00.809284 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239bae1c-2758-479a-818e-4d4276651025 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:34:00.810732 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239bae1c-2758-479a-818e-4d4276651025 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:34:00.822774 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 628/1272] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 03:34:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:34:00.828761 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05d3d5-faa7-4677-a8dd-921cfbccdfad None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:34:00.915576 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:34:00.924745 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05d3d5-faa7-4677-a8dd-921cfbccdfad None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:34:00.957127 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ebb55-37b0-452f-ab13-047fd8fab946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:34:00.957990 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ebb55-37b0-452f-ab13-047fd8fab946 None admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:34:00.958274 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ebb55-37b0-452f-ab13-047fd8fab946 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:34:00.958577 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ebb55-37b0-452f-ab13-047fd8fab946 None admin] PATH_INFO: `/v3/projects/0432303daa8b4304a8e07032d6a80781/users/cb39129b3ed04db28ed01860b37bd714/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:34:00.960496 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ebb55-37b0-452f-ab13-047fd8fab946 None admin] RBAC: Authorizing `identity:create_grant(project_id=0432303daa8b4304a8e07032d6a80781, user_id=cb39129b3ed04db28ed01860b37bd714, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:34:00.961913 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ebb55-37b0-452f-ab13-047fd8fab946 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:34:00.973937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 645/1273] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jul 21 03:34:00 2022] PUT /identity/v3/projects/0432303daa8b4304a8e07032d6a80781/users/cb39129b3ed04db28ed01860b37bd714/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:34:02.956294 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c24ac-76b8-4c34-904f-5db0a5b3789f None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:34:02.956831 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c24ac-76b8-4c34-904f-5db0a5b3789f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:34:02.956831 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c24ac-76b8-4c34-904f-5db0a5b3789f None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:34:02.958186 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 629/1274] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 03:34:02.963272 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76c6c6-4c85-4330-9b4c-10706a6e16a5 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:34:02.963640 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76c6c6-4c85-4330-9b4c-10706a6e16a5 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:34:02.963778 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76c6c6-4c85-4330-9b4c-10706a6e16a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:34:02.980699 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-ea76c6c6-4c85-4330-9b4c-10706a6e16a5 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:34:02.981894 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ea76c6c6-4c85-4330-9b4c-10706a6e16a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:34:03.046231 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 646/1275] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:34:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 03:34:03.069448 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c24ac-76b8-4c34-904f-5db0a5b3789f None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:34:03.167206 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c24ac-76b8-4c34-904f-5db0a5b3789f None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:34:03.183424 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:34:03.199494 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06593e4-52cd-4e0c-888a-64d78621fe71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:34:03.200265 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06593e4-52cd-4e0c-888a-64d78621fe71 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:34:03.200545 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06593e4-52cd-4e0c-888a-64d78621fe71 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:34:03.200812 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06593e4-52cd-4e0c-888a-64d78621fe71 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:34:03.211093 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06593e4-52cd-4e0c-888a-64d78621fe71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 03:34:03.218674 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-e06593e4-52cd-4e0c-888a-64d78621fe71 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:34:03.218674 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:34:03.218674 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:34:03.218674 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:34:03.218674 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:34:03.218674 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:34:03.218674 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:34:03.218674 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:34:03.218674 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:34:03.218674 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:34:03.218674 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:34:03.218674 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:34:03.218674 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 03:34:03.218674 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 03:34:03.218674 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 03:34:03.218674 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 03:34:03.219759 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 03:34:03.219759 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 03:34:03.219759 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 03:34:03.219759 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 03:34:03.219759 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:34:03.219759 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:34:03.219759 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:34:03.219759 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:34:03.219759 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:34:03.219759 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:34:03.219759 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:34:03.219759 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:34:03.219759 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:34:03.219759 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:34:03.219759 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:34:03.219759 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:34:03.221554 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:34:03.221554 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:34:03.221554 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:34:03.221554 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:34:03.221554 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 03:34:03.221554 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 03:34:03.221554 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 03:34:03.221554 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 03:34:03.221554 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 03:34:03.221554 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 03:34:03.221554 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 03:34:03.221554 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:34:03.221554 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 630/1276] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jul 21 03:34:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 03:34:03.226057 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76c6c6-4c85-4330-9b4c-10706a6e16a5 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:34:03.303827 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:34:03.321878 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76c6c6-4c85-4330-9b4c-10706a6e16a5 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:34:03.354886 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e14332-db93-4616-bdfc-c968f2f4d7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:34:03.355538 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e14332-db93-4616-bdfc-c968f2f4d7e7 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:34:03.355826 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e14332-db93-4616-bdfc-c968f2f4d7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:34:03.356105 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e14332-db93-4616-bdfc-c968f2f4d7e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:34:03.356848 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e14332-db93-4616-bdfc-c968f2f4d7e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:34:03.357159 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e14332-db93-4616-bdfc-c968f2f4d7e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:34:03.358546 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e14332-db93-4616-bdfc-c968f2f4d7e7 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:34:03.366409 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 647/1277] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jul 21 03:34:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:34:03.371856 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06593e4-52cd-4e0c-888a-64d78621fe71 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:34:03.467761 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06593e4-52cd-4e0c-888a-64d78621fe71 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:34:03.499040 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f275233-2c71-4d43-9d7a-5a6ae3774732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:34:03.499753 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f275233-2c71-4d43-9d7a-5a6ae3774732 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:34:03.500033 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f275233-2c71-4d43-9d7a-5a6ae3774732 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:34:03.500306 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f275233-2c71-4d43-9d7a-5a6ae3774732 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:34:03.511002 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f275233-2c71-4d43-9d7a-5a6ae3774732 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:34:03.512434 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f275233-2c71-4d43-9d7a-5a6ae3774732 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:34:03.529556 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-1f275233-2c71-4d43-9d7a-5a6ae3774732 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:34:03.529556 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:34:03.529556 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:34:03.529556 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:34:03.529556 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:34:03.529556 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:34:03.529556 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:34:03.529556 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:34:03.529556 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:34:03.529556 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:34:03.529556 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:34:03.529556 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:34:03.529556 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:34:03.529556 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:34:03.529556 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:34:03.530618 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:34:03.530618 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:34:03.530618 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:34:03.530618 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:34:03.530618 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:34:03.530618 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:34:03.530618 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:34:03.530618 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:34:03.530618 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:34:03.530618 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:34:03.530618 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:34:03.530618 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:34:03.530618 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:34:03.530618 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:34:03.530618 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:34:03.530618 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:34:03.530618 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:34:03.531722 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:34:03.531722 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:34:03.531722 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:34:03.531722 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:34:03.531722 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 631/1278] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:34:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:34:03.536248 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e14332-db93-4616-bdfc-c968f2f4d7e7 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:34:03.630536 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e14332-db93-4616-bdfc-c968f2f4d7e7 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:34:03.662374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c8b60-9ed2-43fc-8d75-42608dd158db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:34:03.663040 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c8b60-9ed2-43fc-8d75-42608dd158db None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:34:03.663324 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c8b60-9ed2-43fc-8d75-42608dd158db None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:34:03.663600 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c8b60-9ed2-43fc-8d75-42608dd158db None admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:34:03.664310 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2c8b60-9ed2-43fc-8d75-42608dd158db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:34:03.664612 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2c8b60-9ed2-43fc-8d75-42608dd158db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:34:03.665951 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2c8b60-9ed2-43fc-8d75-42608dd158db None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:34:03.677132 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 648/1279] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:34:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:34:03.682620 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f275233-2c71-4d43-9d7a-5a6ae3774732 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:34:03.715148 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:34:03.784236 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f275233-2c71-4d43-9d7a-5a6ae3774732 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:34:03.816763 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a66ff-37ec-414d-9548-3251ee1db730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:34:03.817569 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a66ff-37ec-414d-9548-3251ee1db730 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:34:03.817858 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a66ff-37ec-414d-9548-3251ee1db730 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:34:03.818139 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a66ff-37ec-414d-9548-3251ee1db730 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:34:03.825603 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a66ff-37ec-414d-9548-3251ee1db730 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:34:03.827104 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a66ff-37ec-414d-9548-3251ee1db730 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:34:03.841681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-6b5a66ff-37ec-414d-9548-3251ee1db730 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 03:34:03.841681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:34:03.841681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:34:03.841681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:34:03.841681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:34:03.841681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:34:03.841681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:34:03.841681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:34:03.841681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:34:03.841681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:34:03.841681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:34:03.841681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:34:03.841681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 03:34:03.841681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 03:34:03.841681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 03:34:03.841681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 03:34:03.842952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:34:03.842952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:34:03.842952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 03:34:03.842952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:34:03.842952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 03:34:03.842952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 03:34:03.842952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:34:03.842952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:34:03.842952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:34:03.842952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:34:03.842952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:34:03.842952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:34:03.842952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:34:03.842952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:34:03.842952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:34:03.842952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:34:03.842952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:34:03.842952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:34:03.844174 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:34:03.844174 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:34:03.844174 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 03:34:03.844174 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 03:34:03.844174 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 03:34:03.844174 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 03:34:03.844174 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 03:34:03.844174 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 03:34:03.844174 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 03:34:03.844174 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:34:03.844174 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 632/1280] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:34:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:34:03.848914 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c8b60-9ed2-43fc-8d75-42608dd158db None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:34:03.852654 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:34:03.946072 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c8b60-9ed2-43fc-8d75-42608dd158db None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:34:03.978620 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c19b0-3144-48da-81df-7f87c9f8aeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:34:03.979269 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c19b0-3144-48da-81df-7f87c9f8aeb8 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:34:03.979549 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c19b0-3144-48da-81df-7f87c9f8aeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:34:03.979821 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c19b0-3144-48da-81df-7f87c9f8aeb8 None admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:34:03.980643 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85c19b0-3144-48da-81df-7f87c9f8aeb8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:34:03.980948 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85c19b0-3144-48da-81df-7f87c9f8aeb8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:34:03.982359 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85c19b0-3144-48da-81df-7f87c9f8aeb8 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:34:03.999174 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 649/1281] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Jul 21 03:34:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:34:04.005550 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a66ff-37ec-414d-9548-3251ee1db730 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:34:04.092891 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:34:04.103406 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a66ff-37ec-414d-9548-3251ee1db730 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:34:04.136557 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5cbd73-e92e-4ccb-995f-9c782900b1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:34:04.137192 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5cbd73-e92e-4ccb-995f-9c782900b1e3 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:34:04.137479 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5cbd73-e92e-4ccb-995f-9c782900b1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:34:04.137755 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5cbd73-e92e-4ccb-995f-9c782900b1e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:34:04.204070 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5cbd73-e92e-4ccb-995f-9c782900b1e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:34:04.205536 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5cbd73-e92e-4ccb-995f-9c782900b1e3 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:34:04.290422 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:34:04.301280 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 633/1282] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jul 21 03:34:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 03:34:04.307142 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c19b0-3144-48da-81df-7f87c9f8aeb8 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:34:04.366361 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:34:04.402980 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c19b0-3144-48da-81df-7f87c9f8aeb8 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:34:04.436249 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac2a22-cf4b-486d-a376-0ffe0c69ddf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:34:04.437037 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac2a22-cf4b-486d-a376-0ffe0c69ddf4 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:34:04.437317 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac2a22-cf4b-486d-a376-0ffe0c69ddf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:34:04.437586 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac2a22-cf4b-486d-a376-0ffe0c69ddf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:34:04.447262 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac2a22-cf4b-486d-a376-0ffe0c69ddf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:34:04.448686 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ac2a22-cf4b-486d-a376-0ffe0c69ddf4 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:34:04.466062 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-b9ac2a22-cf4b-486d-a376-0ffe0c69ddf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:34:04.466062 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:34:04.466062 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:34:04.466062 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:34:04.466062 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:34:04.466062 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:34:04.466062 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:34:04.466062 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:34:04.466062 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:34:04.466062 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:34:04.466062 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:34:04.466062 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:34:04.466062 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 03:34:04.466062 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 03:34:04.466062 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 03:34:04.467008 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 03:34:04.467008 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:34:04.467008 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:34:04.467008 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:34:04.467008 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:34:04.467008 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:34:04.467008 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:34:04.467008 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:34:04.467008 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:34:04.467008 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:34:04.467008 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:34:04.467008 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:34:04.467008 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:34:04.467008 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:34:04.467008 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:34:04.467008 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:34:04.467008 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:34:04.468050 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 03:34:04.468050 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 03:34:04.468050 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 03:34:04.468050 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:34:04.468050 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 650/1283] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:34:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:34:04.473489 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5cbd73-e92e-4ccb-995f-9c782900b1e3 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:34:04.569861 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5cbd73-e92e-4ccb-995f-9c782900b1e3 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:34:04.603098 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57561617-bad7-49ab-ad67-b16dfe529b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:34:04.603752 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57561617-bad7-49ab-ad67-b16dfe529b14 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:34:04.604042 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57561617-bad7-49ab-ad67-b16dfe529b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:34:04.604324 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57561617-bad7-49ab-ad67-b16dfe529b14 None admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:34:04.605040 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57561617-bad7-49ab-ad67-b16dfe529b14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:34:04.605356 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57561617-bad7-49ab-ad67-b16dfe529b14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:34:04.606757 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57561617-bad7-49ab-ad67-b16dfe529b14 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:34:04.617802 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 634/1284] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jul 21 03:34:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:34:04.622919 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac2a22-cf4b-486d-a376-0ffe0c69ddf4 None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:34:04.717809 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac2a22-cf4b-486d-a376-0ffe0c69ddf4 None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:34:04.732532 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:34:04.752249 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53bae03-1bc7-4081-9837-b1c9816a324c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:34:04.753037 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53bae03-1bc7-4081-9837-b1c9816a324c None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:34:04.753320 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53bae03-1bc7-4081-9837-b1c9816a324c None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:34:04.753590 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53bae03-1bc7-4081-9837-b1c9816a324c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:34:04.760104 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53bae03-1bc7-4081-9837-b1c9816a324c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:34:04.761523 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53bae03-1bc7-4081-9837-b1c9816a324c None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:34:04.775615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application [None req-e53bae03-1bc7-4081-9837-b1c9816a324c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:34:04.775615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:34:04.775615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:34:04.775615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:34:04.775615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:34:04.775615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:34:04.775615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:34:04.775615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:34:04.775615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:34:04.775615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:34:04.775615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:34:04.775615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:34:04.775615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 03:34:04.775615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 03:34:04.775615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 03:34:04.776661 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 03:34:04.776661 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:34:04.776661 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:34:04.776661 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:34:04.776661 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:34:04.776661 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:34:04.776661 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:34:04.776661 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:34:04.776661 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application with Lock( Jul 21 03:34:04.776661 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:34:04.776661 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:34:04.776661 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:34:04.776661 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:34:04.776661 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:34:04.776661 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:34:04.776661 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:34:04.776661 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:34:04.777963 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 03:34:04.777963 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 03:34:04.777963 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 03:34:04.777963 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 03:34:04.777963 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 03:34:04.777963 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 03:34:04.777963 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 03:34:04.777963 dv-cinder-850318-2-smb devstack@keystone.service[80332]: ERROR keystone.server.flask.application Jul 21 03:34:04.777963 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 651/1285] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jul 21 03:34:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:34:04.782632 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57561617-bad7-49ab-ad67-b16dfe529b14 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:34:04.831489 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:34:04.879173 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57561617-bad7-49ab-ad67-b16dfe529b14 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:34:04.912107 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b8063d-fd0a-4e45-b120-380728e8b61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:34:04.912750 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8063d-fd0a-4e45-b120-380728e8b61a None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:34:04.913035 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8063d-fd0a-4e45-b120-380728e8b61a None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:34:04.913309 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8063d-fd0a-4e45-b120-380728e8b61a None admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:34:04.914098 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b8063d-fd0a-4e45-b120-380728e8b61a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:34:04.914406 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b8063d-fd0a-4e45-b120-380728e8b61a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:34:04.915853 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b8063d-fd0a-4e45-b120-380728e8b61a None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:34:04.927456 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 635/1286] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jul 21 03:34:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:34:04.933330 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53bae03-1bc7-4081-9837-b1c9816a324c None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:34:05.029835 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53bae03-1bc7-4081-9837-b1c9816a324c None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:34:05.061235 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17f9cb-8a4b-45bb-9357-1c3c25912d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:34:05.061866 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17f9cb-8a4b-45bb-9357-1c3c25912d01 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:34:05.062152 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17f9cb-8a4b-45bb-9357-1c3c25912d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:34:05.062429 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17f9cb-8a4b-45bb-9357-1c3c25912d01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:34:05.063279 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17f9cb-8a4b-45bb-9357-1c3c25912d01 None admin] RBAC: Adding query filter params (role.id=27e53d6c56f24c25a8c8057bfd36bcf1, scope.project.id=0432303daa8b4304a8e07032d6a80781, user.id=cb39129b3ed04db28ed01860b37bd714) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:34:05.063589 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17f9cb-8a4b-45bb-9357-1c3c25912d01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:34:05.065530 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17f9cb-8a4b-45bb-9357-1c3c25912d01 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:34:05.071189 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 652/1287] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jul 21 03:34:04 2022] GET /identity/v3/role_assignments?user.id=cb39129b3ed04db28ed01860b37bd714&scope.project.id=0432303daa8b4304a8e07032d6a80781&role.id=27e53d6c56f24c25a8c8057bfd36bcf1 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:34:07.059937 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c2ba7-91f3-4de1-895f-e87ce11589cb None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:34:07.060447 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c2ba7-91f3-4de1-895f-e87ce11589cb None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:34:07.060447 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c2ba7-91f3-4de1-895f-e87ce11589cb None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:34:07.061776 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 636/1288] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:34:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:34:07.066817 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74bb9c-3ce7-4816-8bdf-1cbdb027fb3c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:34:07.067234 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74bb9c-3ce7-4816-8bdf-1cbdb027fb3c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:34:07.067383 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f74bb9c-3ce7-4816-8bdf-1cbdb027fb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:34:07.084328 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-1f74bb9c-3ce7-4816-8bdf-1cbdb027fb3c None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:34:07.085490 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1f74bb9c-3ce7-4816-8bdf-1cbdb027fb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:34:07.113925 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:34:07.151653 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 653/1289] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:34:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 03:34:07.174738 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c2ba7-91f3-4de1-895f-e87ce11589cb None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:34:07.271644 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c2ba7-91f3-4de1-895f-e87ce11589cb None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:34:07.281916 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:34:07.304147 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa8528-5abd-47a5-bbe1-d2497584ddfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:34:07.304928 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa8528-5abd-47a5-bbe1-d2497584ddfd None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:34:07.305209 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa8528-5abd-47a5-bbe1-d2497584ddfd None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:34:07.305485 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa8528-5abd-47a5-bbe1-d2497584ddfd None admin] PATH_INFO: `/v3/services/placement` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:34:07.306129 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa8528-5abd-47a5-bbe1-d2497584ddfd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:34:07.307538 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa8528-5abd-47a5-bbe1-d2497584ddfd None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:34:07.319643 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-94aa8528-5abd-47a5-bbe1-d2497584ddfd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 03:34:07.319643 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:34:07.319643 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 03:34:07.319643 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 03:34:07.319643 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 03:34:07.319643 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 03:34:07.319643 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 03:34:07.319643 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:34:07.319643 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 03:34:07.319643 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:34:07.319643 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 03:34:07.319643 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:34:07.319643 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:34:07.319643 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:34:07.319643 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:34:07.319643 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:34:07.319643 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:34:07.320858 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:34:07.320858 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:34:07.320858 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:34:07.320858 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:34:07.320858 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:34:07.320858 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:34:07.320858 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 03:34:07.320858 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 03:34:07.320858 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 03:34:07.320858 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 03:34:07.320858 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:34:07.320858 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:34:07.320858 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:34:07.320858 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:34:07.320858 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:34:07.320858 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:34:07.321748 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:34:07.321748 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:34:07.321748 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:34:07.321748 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:34:07.321748 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:34:07.321748 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:34:07.321748 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:34:07.321748 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:34:07.321748 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:34:07.321748 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:34:07.321748 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 03:34:07.321748 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:34:07.321748 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 03:34:07.321748 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:34:07.321748 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 637/1290] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Jul 21 03:34:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:34:07.326673 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f74bb9c-3ce7-4816-8bdf-1cbdb027fb3c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:34:07.420334 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f74bb9c-3ce7-4816-8bdf-1cbdb027fb3c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:34:07.455447 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52654ed6-479b-4b20-8546-69368bea6833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:34:07.456265 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52654ed6-479b-4b20-8546-69368bea6833 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:34:07.456567 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52654ed6-479b-4b20-8546-69368bea6833 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:34:07.456850 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52654ed6-479b-4b20-8546-69368bea6833 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:34:07.457748 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52654ed6-479b-4b20-8546-69368bea6833 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:34:07.458131 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52654ed6-479b-4b20-8546-69368bea6833 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:34:07.459728 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52654ed6-479b-4b20-8546-69368bea6833 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:34:07.470161 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 654/1291] 10.222.0.20 () {56 vars in 1116 bytes} [Thu Jul 21 03:34:07 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:34:07.472593 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa8528-5abd-47a5-bbe1-d2497584ddfd None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:34:07.577093 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa8528-5abd-47a5-bbe1-d2497584ddfd None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:34:07.609249 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdffb50-6b0a-4c76-967e-e08125717348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:34:07.609903 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdffb50-6b0a-4c76-967e-e08125717348 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:34:07.610188 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdffb50-6b0a-4c76-967e-e08125717348 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:34:07.610474 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdffb50-6b0a-4c76-967e-e08125717348 None admin] PATH_INFO: `/v3/services` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:34:07.611674 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdffb50-6b0a-4c76-967e-e08125717348 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:34:07.611983 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdffb50-6b0a-4c76-967e-e08125717348 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:34:07.613363 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdffb50-6b0a-4c76-967e-e08125717348 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:34:07.617694 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 638/1292] 10.222.0.20 () {56 vars in 1116 bytes} [Thu Jul 21 03:34:07 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:34:09.583424 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a43e3-f796-4899-8a24-602b58eb916a None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:34:09.583977 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a43e3-f796-4899-8a24-602b58eb916a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:34:09.583977 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a43e3-f796-4899-8a24-602b58eb916a None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:34:09.585358 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 655/1293] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:34:09.590352 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4941755-9155-4ffb-be30-55d538770462 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:34:09.590801 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4941755-9155-4ffb-be30-55d538770462 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:34:09.590947 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4941755-9155-4ffb-be30-55d538770462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:34:09.608829 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-b4941755-9155-4ffb-be30-55d538770462 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:34:09.610050 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b4941755-9155-4ffb-be30-55d538770462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:34:09.639168 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:34:09.676748 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 639/1294] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:34:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 03:34:09.699113 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a43e3-f796-4899-8a24-602b58eb916a None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:34:09.730038 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:34:09.799522 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a43e3-f796-4899-8a24-602b58eb916a None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:34:09.832292 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f02d3-ffaa-44b7-a523-c91574b6d2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:34:09.832943 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f02d3-ffaa-44b7-a523-c91574b6d2b8 None admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:34:09.833230 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f02d3-ffaa-44b7-a523-c91574b6d2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:34:09.833558 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f02d3-ffaa-44b7-a523-c91574b6d2b8 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:34:09.834233 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39f02d3-ffaa-44b7-a523-c91574b6d2b8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:34:09.835621 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39f02d3-ffaa-44b7-a523-c91574b6d2b8 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:34:09.848470 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 656/1295] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jul 21 03:34:09 2022] POST /identity/v3/services => generated 246 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:34:11.916447 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd1c70-751e-4aab-8d07-401b5de723c6 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:34:11.916988 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd1c70-751e-4aab-8d07-401b5de723c6 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:34:11.916988 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd1c70-751e-4aab-8d07-401b5de723c6 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:34:11.918339 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 640/1296] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:34:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:34:11.924188 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2d217-64b3-4495-9314-2bd2e41faabc None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:34:11.924564 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2d217-64b3-4495-9314-2bd2e41faabc None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:34:11.924751 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2d217-64b3-4495-9314-2bd2e41faabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:34:11.941221 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f9f2d217-64b3-4495-9314-2bd2e41faabc None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:34:11.942407 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f9f2d217-64b3-4495-9314-2bd2e41faabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:34:12.012530 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 657/1297] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:34:11 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 03:34:12.035972 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd1c70-751e-4aab-8d07-401b5de723c6 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:34:12.132083 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd1c70-751e-4aab-8d07-401b5de723c6 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:34:12.167129 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d057a-3626-4343-ad4b-1fcf45874de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:34:12.167922 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d057a-3626-4343-ad4b-1fcf45874de7 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:34:12.168202 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d057a-3626-4343-ad4b-1fcf45874de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:34:12.168473 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d057a-3626-4343-ad4b-1fcf45874de7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:34:12.169118 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7d057a-3626-4343-ad4b-1fcf45874de7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:34:12.170507 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7d057a-3626-4343-ad4b-1fcf45874de7 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:34:12.181959 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-2c7d057a-3626-4343-ad4b-1fcf45874de7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 03:34:12.181959 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:34:12.181959 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 03:34:12.181959 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 03:34:12.181959 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 03:34:12.181959 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 03:34:12.181959 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 03:34:12.181959 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:34:12.181959 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 03:34:12.181959 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:34:12.181959 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 03:34:12.181959 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:34:12.181959 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:34:12.181959 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:34:12.181959 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:34:12.181959 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:34:12.181959 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:34:12.183156 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:34:12.183156 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:34:12.183156 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:34:12.183156 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:34:12.183156 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:34:12.183156 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:34:12.183156 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 03:34:12.183156 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 03:34:12.183156 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 03:34:12.183156 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 03:34:12.183156 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:34:12.183156 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:34:12.183156 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:34:12.183156 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:34:12.183156 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:34:12.183156 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:34:12.184193 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:34:12.184193 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:34:12.184193 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:34:12.184193 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:34:12.184193 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:34:12.184193 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:34:12.184193 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:34:12.184193 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:34:12.184193 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:34:12.184193 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:34:12.184193 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 03:34:12.184193 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:34:12.184193 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 03:34:12.184193 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:34:12.184193 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 641/1298] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Jul 21 03:34:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:34:12.189336 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2d217-64b3-4495-9314-2bd2e41faabc None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:34:12.207871 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:34:12.286838 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2d217-64b3-4495-9314-2bd2e41faabc None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:34:12.318582 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3a6c7-d655-4abf-b60a-c1dfd54b86eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:34:12.319235 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3a6c7-d655-4abf-b60a-c1dfd54b86eb None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:34:12.319521 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3a6c7-d655-4abf-b60a-c1dfd54b86eb None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:34:12.319800 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3a6c7-d655-4abf-b60a-c1dfd54b86eb None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:34:12.320504 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3a6c7-d655-4abf-b60a-c1dfd54b86eb None admin] RBAC: Adding query filter params (name=placement) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:34:12.320813 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3a6c7-d655-4abf-b60a-c1dfd54b86eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:34:12.322170 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3a6c7-d655-4abf-b60a-c1dfd54b86eb None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:34:12.327169 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 658/1299] 10.222.0.20 () {56 vars in 1116 bytes} [Thu Jul 21 03:34:12 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:34:12.333439 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d057a-3626-4343-ad4b-1fcf45874de7 None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:34:12.364157 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:34:12.430162 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7d057a-3626-4343-ad4b-1fcf45874de7 None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:34:12.466918 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff54efa-55be-4589-b96c-13bd5b290652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:34:12.467687 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff54efa-55be-4589-b96c-13bd5b290652 None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:34:12.467985 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff54efa-55be-4589-b96c-13bd5b290652 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:34:12.468266 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff54efa-55be-4589-b96c-13bd5b290652 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:34:12.469214 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff54efa-55be-4589-b96c-13bd5b290652 None admin] RBAC: Adding query filter params (interface=public, service_id=fce098e74aa348a1a291aa8eae12d7ed, region_id=RegionOne) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:34:12.469517 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff54efa-55be-4589-b96c-13bd5b290652 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:34:12.471213 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff54efa-55be-4589-b96c-13bd5b290652 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:34:12.477964 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 642/1300] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Jul 21 03:34:12 2022] GET /identity/v3/endpoints?service_id=fce098e74aa348a1a291aa8eae12d7ed&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:34:12.483810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3a6c7-d655-4abf-b60a-c1dfd54b86eb None admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:34:12.570246 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:34:12.588309 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3a6c7-d655-4abf-b60a-c1dfd54b86eb None admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:34:12.620401 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b17891-baa0-4f71-aab8-1c9d061bd1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:34:12.621051 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b17891-baa0-4f71-aab8-1c9d061bd1e4 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:34:12.621337 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b17891-baa0-4f71-aab8-1c9d061bd1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:34:12.621621 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b17891-baa0-4f71-aab8-1c9d061bd1e4 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:34:12.622299 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b17891-baa0-4f71-aab8-1c9d061bd1e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:34:12.623688 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b17891-baa0-4f71-aab8-1c9d061bd1e4 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:34:12.630941 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 659/1301] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Jul 21 03:34:12 2022] GET /identity/v3/services => generated 2191 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 03:34:14.640685 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125a4af-0cb7-4c47-b9ea-036a453eff73 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:34:14.641248 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125a4af-0cb7-4c47-b9ea-036a453eff73 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:34:14.641248 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125a4af-0cb7-4c47-b9ea-036a453eff73 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:34:14.642661 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 643/1302] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:34:14.648065 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50db3d-00d4-4ff6-9998-5ac405fc1ac8 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:34:14.648433 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50db3d-00d4-4ff6-9998-5ac405fc1ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:34:14.648619 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50db3d-00d4-4ff6-9998-5ac405fc1ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:34:14.664796 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-2f50db3d-00d4-4ff6-9998-5ac405fc1ac8 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:34:14.665956 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2f50db3d-00d4-4ff6-9998-5ac405fc1ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:34:14.731716 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 660/1303] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:34:14 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 03:34:14.755428 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125a4af-0cb7-4c47-b9ea-036a453eff73 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:34:14.847146 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:34:14.853944 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125a4af-0cb7-4c47-b9ea-036a453eff73 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:34:14.886159 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63939839-c8cb-4195-abdc-a1a573a9504f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:34:14.886969 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63939839-c8cb-4195-abdc-a1a573a9504f None admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:34:14.887253 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63939839-c8cb-4195-abdc-a1a573a9504f None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:34:14.887525 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63939839-c8cb-4195-abdc-a1a573a9504f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:34:14.888165 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63939839-c8cb-4195-abdc-a1a573a9504f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:34:14.889527 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63939839-c8cb-4195-abdc-a1a573a9504f None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:34:14.901419 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application [None req-63939839-c8cb-4195-abdc-a1a573a9504f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 03:34:14.901419 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:34:14.901419 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 03:34:14.901419 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 03:34:14.901419 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 03:34:14.901419 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 03:34:14.901419 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 03:34:14.901419 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:34:14.901419 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 03:34:14.901419 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:34:14.901419 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 03:34:14.901419 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:34:14.901419 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 03:34:14.901419 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 03:34:14.901419 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 03:34:14.901419 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 03:34:14.901419 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 03:34:14.902610 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 03:34:14.902610 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 03:34:14.902610 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 03:34:14.902610 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 03:34:14.902610 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 03:34:14.902610 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 03:34:14.902610 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 03:34:14.902610 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 03:34:14.902610 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 03:34:14.902610 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 03:34:14.902610 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 03:34:14.902610 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 03:34:14.902610 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 03:34:14.902610 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 03:34:14.902610 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 03:34:14.902610 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 03:34:14.903630 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 03:34:14.903630 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application with Lock( Jul 21 03:34:14.903630 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 03:34:14.903630 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self._enter() Jul 21 03:34:14.903630 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 03:34:14.903630 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 03:34:14.903630 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 03:34:14.903630 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application return self.creator() Jul 21 03:34:14.903630 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 03:34:14.903630 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application created_value = creator( Jul 21 03:34:14.903630 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 03:34:14.903630 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 03:34:14.903630 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 03:34:14.903630 dv-cinder-850318-2-smb devstack@keystone.service[80331]: ERROR keystone.server.flask.application Jul 21 03:34:14.903630 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 644/1304] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Jul 21 03:34:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 03:34:14.908819 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50db3d-00d4-4ff6-9998-5ac405fc1ac8 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:34:14.982664 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:34:15.005557 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50db3d-00d4-4ff6-9998-5ac405fc1ac8 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:34:15.039102 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c135f28-00e1-44cd-a53c-2437b3cb6412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:34:15.039752 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c135f28-00e1-44cd-a53c-2437b3cb6412 None admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:34:15.040040 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c135f28-00e1-44cd-a53c-2437b3cb6412 None admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:34:15.040319 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c135f28-00e1-44cd-a53c-2437b3cb6412 None admin] PATH_INFO: `/v3/services` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:34:15.041022 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c135f28-00e1-44cd-a53c-2437b3cb6412 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:34:15.041331 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c135f28-00e1-44cd-a53c-2437b3cb6412 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:34:15.042718 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c135f28-00e1-44cd-a53c-2437b3cb6412 None admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:34:15.047694 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 661/1305] 10.222.0.20 () {56 vars in 1116 bytes} [Thu Jul 21 03:34:14 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:34:15.053895 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63939839-c8cb-4195-abdc-a1a573a9504f None admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:34:15.150977 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63939839-c8cb-4195-abdc-a1a573a9504f None admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:34:15.183446 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c602369d-54ea-4ca3-8a21-086137723108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:34:15.184031 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602369d-54ea-4ca3-8a21-086137723108 None admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:34:15.184319 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602369d-54ea-4ca3-8a21-086137723108 None admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:34:15.184601 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602369d-54ea-4ca3-8a21-086137723108 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:34:15.185332 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c602369d-54ea-4ca3-8a21-086137723108 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:34:15.186721 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c602369d-54ea-4ca3-8a21-086137723108 None admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:34:15.203797 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 645/1306] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Jul 21 03:34:15 2022] POST /identity/v3/endpoints => generated 331 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:34:25.045191 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=30 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:34:25.199604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:35:17.183700 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7347e93-6cdc-4898-83d2-b86127f9c172 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:35:17.184815 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7347e93-6cdc-4898-83d2-b86127f9c172 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:35:17.185329 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7347e93-6cdc-4898-83d2-b86127f9c172 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:35:17.192519 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf91ad-771a-4a05-86f7-0d1298e1e952 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:35:17.193411 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf91ad-771a-4a05-86f7-0d1298e1e952 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:35:17.193907 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf91ad-771a-4a05-86f7-0d1298e1e952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:35:17.197298 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 662/1307] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:35:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:35:17.269950 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-4fcf91ad-771a-4a05-86f7-0d1298e1e952 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:35:17.271669 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4fcf91ad-771a-4a05-86f7-0d1298e1e952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:35:17.391172 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 646/1308] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:35:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:35:17.436279 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82803980-2c72-40c8-a969-225cc215062e None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:35:17.436970 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82803980-2c72-40c8-a969-225cc215062e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:35:17.437314 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82803980-2c72-40c8-a969-225cc215062e None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:35:17.439798 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 663/1309] 10.222.0.20 () {54 vars in 965 bytes} [Thu Jul 21 03:35:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:35:17.451075 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a7b34-ad6d-4b35-bc53-f5d6f4d2cf54 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:35:17.451409 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a7b34-ad6d-4b35-bc53-f5d6f4d2cf54 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:35:17.451656 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a7b34-ad6d-4b35-bc53-f5d6f4d2cf54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:35:17.570718 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-6e8a7b34-ad6d-4b35-bc53-f5d6f4d2cf54 None None] MFA Rules not processed for user `b68c257254de483ab65eb5dc5684a704`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:35:17.571830 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6e8a7b34-ad6d-4b35-bc53-f5d6f4d2cf54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:35:17.601003 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:35:17.683558 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82803980-2c72-40c8-a969-225cc215062e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:35:17.685549 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-82803980-2c72-40c8-a969-225cc215062e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:35:17.689265 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 647/1310] 10.222.0.20 () {58 vars in 1062 bytes} [Thu Jul 21 03:35:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:35:17.848932 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82803980-2c72-40c8-a969-225cc215062e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:35:17.925411 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a2429c-c4d6-42e9-a8af-98460ac9b22c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:35:17.926056 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2429c-c4d6-42e9-a8af-98460ac9b22c service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:35:17.926338 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2429c-c4d6-42e9-a8af-98460ac9b22c service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:35:17.926655 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2429c-c4d6-42e9-a8af-98460ac9b22c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:35:17.928273 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-20a2429c-c4d6-42e9-a8af-98460ac9b22c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:35:17.984182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:35:18.041291 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a2429c-c4d6-42e9-a8af-98460ac9b22c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:35:18.042756 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a2429c-c4d6-42e9-a8af-98460ac9b22c service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:35:18.062152 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 664/1311] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:35:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:35:20.442163 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296bc096-385e-4966-ac78-c347b7ad0e59 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:35:20.442741 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296bc096-385e-4966-ac78-c347b7ad0e59 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:35:20.442741 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296bc096-385e-4966-ac78-c347b7ad0e59 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:35:20.444168 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 648/1312] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 03:35:20.450247 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0592d0-07b2-41aa-9d2b-db08a059c085 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:35:20.450830 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0592d0-07b2-41aa-9d2b-db08a059c085 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:35:20.451005 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0592d0-07b2-41aa-9d2b-db08a059c085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:35:20.540238 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-9a0592d0-07b2-41aa-9d2b-db08a059c085 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:35:20.541525 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9a0592d0-07b2-41aa-9d2b-db08a059c085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:35:20.645118 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 665/1313] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:35:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:35:20.684905 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296bc096-385e-4966-ac78-c347b7ad0e59 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:35:20.686597 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-296bc096-385e-4966-ac78-c347b7ad0e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:35:20.806093 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296bc096-385e-4966-ac78-c347b7ad0e59 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:35:20.877715 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:35:20.880469 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaccb98a-5131-4b6b-bd43-8a976a533e4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:35:20.881291 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccb98a-5131-4b6b-bd43-8a976a533e4b service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:35:20.881617 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccb98a-5131-4b6b-bd43-8a976a533e4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:35:20.882087 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccb98a-5131-4b6b-bd43-8a976a533e4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:35:20.884025 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-aaccb98a-5131-4b6b-bd43-8a976a533e4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:35:20.994022 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaccb98a-5131-4b6b-bd43-8a976a533e4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:35:20.995427 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaccb98a-5131-4b6b-bd43-8a976a533e4b service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:35:21.013444 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 649/1314] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:35:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:35:23.346877 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbebc8e-ae50-453d-b0b4-b5617fc480b2 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:35:23.347410 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbebc8e-ae50-453d-b0b4-b5617fc480b2 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:35:23.347499 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbebc8e-ae50-453d-b0b4-b5617fc480b2 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:35:23.348824 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 666/1315] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:35:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:35:23.353934 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549749c7-3388-4479-b297-54c6746e4e5c None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:35:23.354376 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549749c7-3388-4479-b297-54c6746e4e5c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:35:23.354538 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549749c7-3388-4479-b297-54c6746e4e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:35:23.419157 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-549749c7-3388-4479-b297-54c6746e4e5c None None] MFA Rules not processed for user `b4287006dc2145adb045a433972123e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:35:23.420367 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-549749c7-3388-4479-b297-54c6746e4e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:35:23.473284 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:35:23.521567 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 650/1316] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:35:23 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:35:23.562010 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbebc8e-ae50-453d-b0b4-b5617fc480b2 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:35:23.563591 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4dbebc8e-ae50-453d-b0b4-b5617fc480b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:35:23.573869 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:35:23.667532 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbebc8e-ae50-453d-b0b4-b5617fc480b2 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:35:23.740048 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068b7ae4-58c4-4740-ab8d-0104e806c652 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:35:23.740625 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b7ae4-58c4-4740-ab8d-0104e806c652 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:35:23.740906 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b7ae4-58c4-4740-ab8d-0104e806c652 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:35:23.741182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068b7ae4-58c4-4740-ab8d-0104e806c652 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:35:23.742831 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-068b7ae4-58c4-4740-ab8d-0104e806c652 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:35:23.803809 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:35:23.849818 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b7ae4-58c4-4740-ab8d-0104e806c652 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:35:23.851282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068b7ae4-58c4-4740-ab8d-0104e806c652 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:35:23.869729 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 667/1317] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:35:23 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:35:26.442623 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44dd3ff-5595-4316-b2ec-03ce8a75ede7 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:35:26.443158 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44dd3ff-5595-4316-b2ec-03ce8a75ede7 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:35:26.443158 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44dd3ff-5595-4316-b2ec-03ce8a75ede7 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:35:26.444536 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 651/1318] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:35:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:35:26.449700 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c0066-8c4e-4940-bbf4-ffcdc25c513d None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:35:26.450174 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c0066-8c4e-4940-bbf4-ffcdc25c513d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:35:26.450288 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c0066-8c4e-4940-bbf4-ffcdc25c513d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:35:26.514054 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-406c0066-8c4e-4940-bbf4-ffcdc25c513d None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:35:26.515321 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-406c0066-8c4e-4940-bbf4-ffcdc25c513d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:35:26.610516 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 668/1319] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:35:26 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:35:26.650120 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44dd3ff-5595-4316-b2ec-03ce8a75ede7 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:35:26.651666 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f44dd3ff-5595-4316-b2ec-03ce8a75ede7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:35:26.754351 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44dd3ff-5595-4316-b2ec-03ce8a75ede7 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:35:26.825167 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288c4ec-b689-4ba2-97a3-9e4ee363b19f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:35:26.825816 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288c4ec-b689-4ba2-97a3-9e4ee363b19f service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:35:26.826100 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288c4ec-b689-4ba2-97a3-9e4ee363b19f service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:35:26.826377 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288c4ec-b689-4ba2-97a3-9e4ee363b19f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:35:26.828034 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7288c4ec-b689-4ba2-97a3-9e4ee363b19f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:35:26.835955 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:35:26.934518 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7288c4ec-b689-4ba2-97a3-9e4ee363b19f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:35:26.935945 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7288c4ec-b689-4ba2-97a3-9e4ee363b19f service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:35:26.953670 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 652/1320] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:35:26 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:35:29.641967 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc84ac-0e43-444d-ad1f-48558ac5d70e None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:35:29.642546 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc84ac-0e43-444d-ad1f-48558ac5d70e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:35:29.642644 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc84ac-0e43-444d-ad1f-48558ac5d70e None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:35:29.643977 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 669/1321] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:35:29.649585 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e7250-d321-46a2-a42a-d3ebf0ee0b57 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:35:29.650070 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e7250-d321-46a2-a42a-d3ebf0ee0b57 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:35:29.650223 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e7250-d321-46a2-a42a-d3ebf0ee0b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:35:29.721336 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-b60e7250-d321-46a2-a42a-d3ebf0ee0b57 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:35:29.722713 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b60e7250-d321-46a2-a42a-d3ebf0ee0b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:35:29.784348 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:35:29.827143 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 653/1322] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:35:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:35:29.877625 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a84178-72eb-4e1d-bb86-73fb49c7db9a None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:35:29.877909 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a84178-72eb-4e1d-bb86-73fb49c7db9a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:35:29.878219 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a84178-72eb-4e1d-bb86-73fb49c7db9a None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:35:29.879650 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 670/1323] 10.222.0.20 () {54 vars in 965 bytes} [Thu Jul 21 03:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 03:35:29.885816 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce0511-4088-4fb6-82fc-d8d09501ec09 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:35:29.886113 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce0511-4088-4fb6-82fc-d8d09501ec09 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:35:29.886396 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce0511-4088-4fb6-82fc-d8d09501ec09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:35:29.965309 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-3dce0511-4088-4fb6-82fc-d8d09501ec09 None None] MFA Rules not processed for user `b68c257254de483ab65eb5dc5684a704`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:35:29.966566 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3dce0511-4088-4fb6-82fc-d8d09501ec09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:35:30.043742 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 654/1324] 10.222.0.20 () {58 vars in 1062 bytes} [Thu Jul 21 03:35:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:35:30.052760 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a84178-72eb-4e1d-bb86-73fb49c7db9a None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:35:30.054286 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d3a84178-72eb-4e1d-bb86-73fb49c7db9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:35:30.073089 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:35:30.163655 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a84178-72eb-4e1d-bb86-73fb49c7db9a None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:35:30.235606 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcafb155-ca90-4424-a089-9dcbe20c82ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:35:30.236352 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafb155-ca90-4424-a089-9dcbe20c82ab service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:35:30.236636 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafb155-ca90-4424-a089-9dcbe20c82ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:35:30.236913 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcafb155-ca90-4424-a089-9dcbe20c82ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:35:30.238567 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-fcafb155-ca90-4424-a089-9dcbe20c82ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:35:30.309439 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:35:30.350474 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcafb155-ca90-4424-a089-9dcbe20c82ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:35:30.351928 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcafb155-ca90-4424-a089-9dcbe20c82ab service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:35:30.369427 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 671/1325] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:35:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:35:32.695560 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4ea70-6d1d-485f-a6fe-f5af7b3e5737 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:35:32.695560 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4ea70-6d1d-485f-a6fe-f5af7b3e5737 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:35:32.695560 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4ea70-6d1d-485f-a6fe-f5af7b3e5737 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:35:32.695560 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 655/1326] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:35:32.700329 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b125292-24f0-4bde-84af-d7e191b7eb47 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:35:32.700739 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b125292-24f0-4bde-84af-d7e191b7eb47 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:35:32.700891 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b125292-24f0-4bde-84af-d7e191b7eb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:35:32.768252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-4b125292-24f0-4bde-84af-d7e191b7eb47 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:35:32.769460 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4b125292-24f0-4bde-84af-d7e191b7eb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:35:32.873641 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 672/1327] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:35:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:35:32.913477 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a4ea70-6d1d-485f-a6fe-f5af7b3e5737 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:35:32.915046 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-79a4ea70-6d1d-485f-a6fe-f5af7b3e5737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:35:32.978339 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:35:33.024888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a4ea70-6d1d-485f-a6fe-f5af7b3e5737 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:35:33.101626 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98817e0e-ebb3-4067-9d66-f9703e9ed573 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:35:33.102282 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98817e0e-ebb3-4067-9d66-f9703e9ed573 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:35:33.102603 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98817e0e-ebb3-4067-9d66-f9703e9ed573 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:35:33.102885 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98817e0e-ebb3-4067-9d66-f9703e9ed573 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:35:33.104537 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-98817e0e-ebb3-4067-9d66-f9703e9ed573 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:35:33.214331 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:35:33.217044 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98817e0e-ebb3-4067-9d66-f9703e9ed573 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:35:33.219005 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98817e0e-ebb3-4067-9d66-f9703e9ed573 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:35:33.237869 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 656/1328] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:35:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:35:35.502236 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8255fc-584f-40f0-8bf2-a113d45e6900 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:35:35.502839 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8255fc-584f-40f0-8bf2-a113d45e6900 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:35:35.503000 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8255fc-584f-40f0-8bf2-a113d45e6900 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:35:35.504553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 673/1329] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:35:35.510290 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f073fc6-85cf-4038-bb11-9c9d9451f56f None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:35:35.510832 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f073fc6-85cf-4038-bb11-9c9d9451f56f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:35:35.510936 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f073fc6-85cf-4038-bb11-9c9d9451f56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:35:35.577254 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-0f073fc6-85cf-4038-bb11-9c9d9451f56f None None] MFA Rules not processed for user `b4287006dc2145adb045a433972123e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:35:35.578485 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0f073fc6-85cf-4038-bb11-9c9d9451f56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:35:35.673123 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 657/1330] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:35:35 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:35:35.711576 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8255fc-584f-40f0-8bf2-a113d45e6900 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:35:35.713504 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-dc8255fc-584f-40f0-8bf2-a113d45e6900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:35:35.743203 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:35:35.816575 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8255fc-584f-40f0-8bf2-a113d45e6900 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:35:35.893536 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b1dc3-98ae-4634-ba53-de75b4c95275 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:35:35.894181 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b1dc3-98ae-4634-ba53-de75b4c95275 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:35:35.894479 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b1dc3-98ae-4634-ba53-de75b4c95275 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:35:35.894763 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b1dc3-98ae-4634-ba53-de75b4c95275 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:35:35.896398 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-861b1dc3-98ae-4634-ba53-de75b4c95275 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:35:35.971752 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:35:36.004177 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b1dc3-98ae-4634-ba53-de75b4c95275 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:35:36.005609 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b1dc3-98ae-4634-ba53-de75b4c95275 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:35:36.023841 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 674/1331] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:35:35 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:35:38.446968 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeeb3c8-986f-4cbd-81ca-013912996769 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:35:38.447537 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeeb3c8-986f-4cbd-81ca-013912996769 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:35:38.447537 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeeb3c8-986f-4cbd-81ca-013912996769 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:35:38.448893 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 658/1332] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:35:38.454119 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a81f4-71c2-4783-b6e2-e71d80832cbc None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:35:38.455070 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a81f4-71c2-4783-b6e2-e71d80832cbc None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:35:38.455250 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a81f4-71c2-4783-b6e2-e71d80832cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:35:38.517963 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-738a81f4-71c2-4783-b6e2-e71d80832cbc None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:35:38.519174 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-738a81f4-71c2-4783-b6e2-e71d80832cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:35:38.612513 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 675/1333] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:35:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:35:38.649438 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeeb3c8-986f-4cbd-81ca-013912996769 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:35:38.650993 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1eeeb3c8-986f-4cbd-81ca-013912996769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:35:38.718916 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:35:38.752748 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeeb3c8-986f-4cbd-81ca-013912996769 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:35:38.823924 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9532827d-3937-4ded-84e4-9ec88fa15f22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:35:38.824953 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532827d-3937-4ded-84e4-9ec88fa15f22 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:35:38.824953 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532827d-3937-4ded-84e4-9ec88fa15f22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:35:38.825136 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9532827d-3937-4ded-84e4-9ec88fa15f22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:35:38.826762 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9532827d-3937-4ded-84e4-9ec88fa15f22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:35:38.944423 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9532827d-3937-4ded-84e4-9ec88fa15f22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:35:38.945868 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9532827d-3937-4ded-84e4-9ec88fa15f22 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:35:38.956460 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:35:38.965251 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 659/1334] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:35:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:35:41.019892 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4cbdd0-f2bb-4f63-99e6-dfe0b1eecec4 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:35:41.020413 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4cbdd0-f2bb-4f63-99e6-dfe0b1eecec4 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:35:41.020413 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4cbdd0-f2bb-4f63-99e6-dfe0b1eecec4 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:35:41.021756 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 676/1335] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:35:41.027081 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a9495-8f1c-4a4a-ba20-1b201e4e94fe None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:35:41.027462 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a9495-8f1c-4a4a-ba20-1b201e4e94fe None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:35:41.027639 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a9495-8f1c-4a4a-ba20-1b201e4e94fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:35:41.091991 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-5a5a9495-8f1c-4a4a-ba20-1b201e4e94fe None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:35:41.093215 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5a5a9495-8f1c-4a4a-ba20-1b201e4e94fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:35:41.187497 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 660/1336] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:35:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:35:41.230013 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4cbdd0-f2bb-4f63-99e6-dfe0b1eecec4 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:35:41.231555 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-aa4cbdd0-f2bb-4f63-99e6-dfe0b1eecec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:35:41.271495 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:35:41.332984 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4cbdd0-f2bb-4f63-99e6-dfe0b1eecec4 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:35:41.402969 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd5789-2636-485d-af12-ce54c030c9db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:35:41.403603 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd5789-2636-485d-af12-ce54c030c9db service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:35:41.403886 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd5789-2636-485d-af12-ce54c030c9db service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:35:41.404159 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd5789-2636-485d-af12-ce54c030c9db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:35:41.405779 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7bbd5789-2636-485d-af12-ce54c030c9db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:35:41.486914 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:35:41.512156 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd5789-2636-485d-af12-ce54c030c9db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:35:41.513572 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd5789-2636-485d-af12-ce54c030c9db service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:35:41.531511 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 677/1337] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:35:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:35:43.866626 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388201c6-7441-4704-a9b2-2c8a4fc60370 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:35:43.867152 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388201c6-7441-4704-a9b2-2c8a4fc60370 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:35:43.867152 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388201c6-7441-4704-a9b2-2c8a4fc60370 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:35:43.868539 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 661/1338] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:35:43.873620 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46b3e1-eaff-4247-9797-4b0ceeddc9bd None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:35:43.874045 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46b3e1-eaff-4247-9797-4b0ceeddc9bd None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:35:43.874184 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46b3e1-eaff-4247-9797-4b0ceeddc9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:35:43.937513 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-0f46b3e1-eaff-4247-9797-4b0ceeddc9bd None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:35:43.938791 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0f46b3e1-eaff-4247-9797-4b0ceeddc9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:35:44.033671 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 678/1339] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:35:43 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:35:44.069935 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388201c6-7441-4704-a9b2-2c8a4fc60370 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:35:44.071517 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-388201c6-7441-4704-a9b2-2c8a4fc60370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:35:44.145252 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:35:44.174982 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388201c6-7441-4704-a9b2-2c8a4fc60370 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:35:44.247587 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16fb550-acc3-4cb6-8899-68dcb6de9a60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:35:44.248703 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fb550-acc3-4cb6-8899-68dcb6de9a60 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:35:44.249210 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fb550-acc3-4cb6-8899-68dcb6de9a60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:35:44.249715 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fb550-acc3-4cb6-8899-68dcb6de9a60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:35:44.253413 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b16fb550-acc3-4cb6-8899-68dcb6de9a60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:35:44.360236 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16fb550-acc3-4cb6-8899-68dcb6de9a60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:35:44.361713 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16fb550-acc3-4cb6-8899-68dcb6de9a60 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:35:44.379175 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 662/1340] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:35:44 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:35:48.586853 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd3f51-9c90-4743-81bf-1ac0429b49cd None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:35:48.587364 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd3f51-9c90-4743-81bf-1ac0429b49cd None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:35:48.587473 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd3f51-9c90-4743-81bf-1ac0429b49cd None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:35:48.588933 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 679/1341] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:35:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:35:48.594269 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f26f76-346c-481e-9ee0-cf5da69328fd None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:35:48.594678 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f26f76-346c-481e-9ee0-cf5da69328fd None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:35:48.594864 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f26f76-346c-481e-9ee0-cf5da69328fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:35:48.599132 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:35:48.660529 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c3f26f76-346c-481e-9ee0-cf5da69328fd None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:35:48.661651 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c3f26f76-346c-481e-9ee0-cf5da69328fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:35:48.763695 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 663/1342] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:35:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:35:48.805156 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd3f51-9c90-4743-81bf-1ac0429b49cd None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:35:48.806836 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-27fd3f51-9c90-4743-81bf-1ac0429b49cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:35:48.858049 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:35:48.917742 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd3f51-9c90-4743-81bf-1ac0429b49cd None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:35:48.992668 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff146c85-5569-4579-b808-4a07abbaf6a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:35:48.993320 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff146c85-5569-4579-b808-4a07abbaf6a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:35:48.993609 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff146c85-5569-4579-b808-4a07abbaf6a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:35:48.993892 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff146c85-5569-4579-b808-4a07abbaf6a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:35:48.995580 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ff146c85-5569-4579-b808-4a07abbaf6a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:35:49.092507 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:35:49.109311 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff146c85-5569-4579-b808-4a07abbaf6a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:35:49.110700 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff146c85-5569-4579-b808-4a07abbaf6a3 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:35:49.128663 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 680/1343] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:35:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 03:35:51.785764 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9752f-6855-42a4-9b76-5b1336f95303 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:35:51.786316 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9752f-6855-42a4-9b76-5b1336f95303 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:35:51.786418 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9752f-6855-42a4-9b76-5b1336f95303 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:35:51.787795 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 664/1344] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:35:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:35:51.793648 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25da32-2e8d-4454-ba6f-4eb617b41a6c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:35:51.794203 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25da32-2e8d-4454-ba6f-4eb617b41a6c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:35:51.794203 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25da32-2e8d-4454-ba6f-4eb617b41a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:35:51.858892 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-3d25da32-2e8d-4454-ba6f-4eb617b41a6c None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:35:51.860085 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3d25da32-2e8d-4454-ba6f-4eb617b41a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:35:51.957048 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 681/1345] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:35:51 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:35:51.994160 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd9752f-6855-42a4-9b76-5b1336f95303 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:35:51.995726 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-afd9752f-6855-42a4-9b76-5b1336f95303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:35:52.081700 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:35:52.099193 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd9752f-6855-42a4-9b76-5b1336f95303 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:35:52.172156 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5158317-d27c-4d1e-a433-ecd181be9830 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:35:52.172818 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5158317-d27c-4d1e-a433-ecd181be9830 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:35:52.173103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5158317-d27c-4d1e-a433-ecd181be9830 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:35:52.173380 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5158317-d27c-4d1e-a433-ecd181be9830 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:35:52.175063 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e5158317-d27c-4d1e-a433-ecd181be9830 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:35:52.287470 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5158317-d27c-4d1e-a433-ecd181be9830 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:35:52.288835 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5158317-d27c-4d1e-a433-ecd181be9830 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:35:52.307430 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 665/1346] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:35:51 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:35:56.266283 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477c1a7-8426-497e-93d4-852807e02800 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:35:56.267338 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477c1a7-8426-497e-93d4-852807e02800 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:35:56.267338 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477c1a7-8426-497e-93d4-852807e02800 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:35:56.268709 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 682/1347] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:35:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:35:56.274194 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa78d6f-a1cd-4e5e-9052-7c465d77bb18 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:35:56.274652 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa78d6f-a1cd-4e5e-9052-7c465d77bb18 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:35:56.275536 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa78d6f-a1cd-4e5e-9052-7c465d77bb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:35:56.291142 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:35:56.344174 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-aaa78d6f-a1cd-4e5e-9052-7c465d77bb18 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:35:56.346073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-aaa78d6f-a1cd-4e5e-9052-7c465d77bb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:35:56.467100 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 666/1348] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:35:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:35:56.505629 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477c1a7-8426-497e-93d4-852807e02800 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:35:56.507335 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4477c1a7-8426-497e-93d4-852807e02800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:35:56.570541 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:35:56.619276 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477c1a7-8426-497e-93d4-852807e02800 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:35:56.700257 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e219ebf-d364-47a6-99b2-32c7b0301e0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:35:56.700909 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e219ebf-d364-47a6-99b2-32c7b0301e0a service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:35:56.701226 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e219ebf-d364-47a6-99b2-32c7b0301e0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:35:56.701499 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e219ebf-d364-47a6-99b2-32c7b0301e0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:35:56.703182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2e219ebf-d364-47a6-99b2-32c7b0301e0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:35:56.817067 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:35:56.821176 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e219ebf-d364-47a6-99b2-32c7b0301e0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:35:56.823034 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e219ebf-d364-47a6-99b2-32c7b0301e0a service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:35:56.843307 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 683/1349] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:35:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:36:01.766194 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e939916-43d5-43f0-8db3-d25354b9733d None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:01.767601 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e939916-43d5-43f0-8db3-d25354b9733d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:01.768053 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e939916-43d5-43f0-8db3-d25354b9733d None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:01.769830 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 667/1350] 10.222.0.20 () {54 vars in 921 bytes} [Thu Jul 21 03:36:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:36:01.775412 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a0bde-2ba6-402b-a8ec-ce2a73c98c51 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:01.776189 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a0bde-2ba6-402b-a8ec-ce2a73c98c51 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:01.776625 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a0bde-2ba6-402b-a8ec-ce2a73c98c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:01.859540 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-281a0bde-2ba6-402b-a8ec-ce2a73c98c51 None None] MFA Rules not processed for user `cb39129b3ed04db28ed01860b37bd714`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:36:01.861585 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-281a0bde-2ba6-402b-a8ec-ce2a73c98c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:01.996016 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 684/1351] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Jul 21 03:36:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:36:06.062306 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b08a11-1b7e-4c1b-a338-0773bb4a9c59 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:06.062870 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b08a11-1b7e-4c1b-a338-0773bb4a9c59 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:06.062870 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b08a11-1b7e-4c1b-a338-0773bb4a9c59 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:06.064420 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 668/1352] 10.222.0.20 () {54 vars in 921 bytes} [Thu Jul 21 03:36:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:36:06.069484 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc24c38-55c8-4859-9d6a-9b31ae61d441 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:06.070328 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc24c38-55c8-4859-9d6a-9b31ae61d441 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:06.070904 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc24c38-55c8-4859-9d6a-9b31ae61d441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:06.132443 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:36:06.161112 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-3dc24c38-55c8-4859-9d6a-9b31ae61d441 None None] MFA Rules not processed for user `cb39129b3ed04db28ed01860b37bd714`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:36:06.162429 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3dc24c38-55c8-4859-9d6a-9b31ae61d441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:06.290746 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 685/1353] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Jul 21 03:36:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:36:06.464523 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=59 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:36:07.566708 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90851003-8113-469d-9e86-0030524715e9 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:07.567369 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90851003-8113-469d-9e86-0030524715e9 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:07.567369 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90851003-8113-469d-9e86-0030524715e9 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:07.568763 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 669/1354] 10.222.0.20 () {54 vars in 921 bytes} [Thu Jul 21 03:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:36:07.574069 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c49c8-7135-49e6-8098-ddd67e35c59d None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:07.574568 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c49c8-7135-49e6-8098-ddd67e35c59d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:07.574673 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6c49c8-7135-49e6-8098-ddd67e35c59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:07.649087 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-7e6c49c8-7135-49e6-8098-ddd67e35c59d None None] MFA Rules not processed for user `cb39129b3ed04db28ed01860b37bd714`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:36:07.650278 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7e6c49c8-7135-49e6-8098-ddd67e35c59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:07.693987 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:36:07.762616 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 686/1355] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Jul 21 03:36:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:36:11.164501 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bca03a-d9e8-4cc8-bbd1-c05d36933f9d None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:11.165437 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bca03a-d9e8-4cc8-bbd1-c05d36933f9d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:11.165932 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bca03a-d9e8-4cc8-bbd1-c05d36933f9d None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:11.171606 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 670/1356] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:36:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:36:11.175487 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d84d2-0221-4d94-b9c2-9afaefeb2dd7 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:11.175487 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d84d2-0221-4d94-b9c2-9afaefeb2dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:11.176014 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d84d2-0221-4d94-b9c2-9afaefeb2dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:11.256627 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-8d3d84d2-0221-4d94-b9c2-9afaefeb2dd7 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:36:11.257947 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8d3d84d2-0221-4d94-b9c2-9afaefeb2dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:11.365621 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 687/1357] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:36:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:36:11.422268 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5afd4-e749-46cb-bd21-7db3c0de8ba3 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:11.423530 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5afd4-e749-46cb-bd21-7db3c0de8ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:11.424528 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5afd4-e749-46cb-bd21-7db3c0de8ba3 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:11.426863 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 671/1358] 10.222.0.20 () {54 vars in 962 bytes} [Thu Jul 21 03:36:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:36:11.435712 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de60f5-490b-41b8-a9e2-b3444e3eeefe None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:11.436074 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de60f5-490b-41b8-a9e2-b3444e3eeefe None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:11.436285 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de60f5-490b-41b8-a9e2-b3444e3eeefe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:11.456595 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:36:11.523374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f8de60f5-490b-41b8-a9e2-b3444e3eeefe None None] MFA Rules not processed for user `cefbe2d0c739428ab0d4dfeaed6c37ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:36:11.524616 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f8de60f5-490b-41b8-a9e2-b3444e3eeefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:11.651741 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 688/1359] 10.222.0.20 () {58 vars in 1059 bytes} [Thu Jul 21 03:36:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:36:11.660113 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5afd4-e749-46cb-bd21-7db3c0de8ba3 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:36:11.661918 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7bb5afd4-e749-46cb-bd21-7db3c0de8ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:11.816079 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb5afd4-e749-46cb-bd21-7db3c0de8ba3 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:36:11.893450 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:36:11.934725 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e1dfb8-422a-4cb1-8dcd-547cf62b2e24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:36:11.935280 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1dfb8-422a-4cb1-8dcd-547cf62b2e24 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:11.935568 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1dfb8-422a-4cb1-8dcd-547cf62b2e24 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:11.935848 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1dfb8-422a-4cb1-8dcd-547cf62b2e24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:11.937482 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f5e1dfb8-422a-4cb1-8dcd-547cf62b2e24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:12.032105 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e1dfb8-422a-4cb1-8dcd-547cf62b2e24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:36:12.033723 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e1dfb8-422a-4cb1-8dcd-547cf62b2e24 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:36:12.055620 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 672/1360] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:36:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:36:14.308486 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542e1bd-5241-4293-bc79-787037c39513 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:14.308901 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542e1bd-5241-4293-bc79-787037c39513 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:14.308977 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3542e1bd-5241-4293-bc79-787037c39513 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:14.310517 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 689/1361] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:36:14.315642 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df490315-5c7a-4b44-bc33-27c480d240d1 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:14.316145 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df490315-5c7a-4b44-bc33-27c480d240d1 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:14.316145 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df490315-5c7a-4b44-bc33-27c480d240d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:14.384352 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-df490315-5c7a-4b44-bc33-27c480d240d1 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:36:14.385541 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-df490315-5c7a-4b44-bc33-27c480d240d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:14.433945 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:36:14.502607 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 673/1362] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:36:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:36:14.546953 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542e1bd-5241-4293-bc79-787037c39513 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:36:14.548956 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3542e1bd-5241-4293-bc79-787037c39513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:14.626535 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:36:14.730829 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3542e1bd-5241-4293-bc79-787037c39513 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:36:14.865084 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a0599-f2a6-456a-accc-3e0ce7127126 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:36:14.865744 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a0599-f2a6-456a-accc-3e0ce7127126 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:14.866030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a0599-f2a6-456a-accc-3e0ce7127126 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:14.866427 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a0599-f2a6-456a-accc-3e0ce7127126 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:14.868176 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6d8a0599-f2a6-456a-accc-3e0ce7127126 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:14.893945 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:36:14.966186 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a0599-f2a6-456a-accc-3e0ce7127126 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:36:14.967975 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a0599-f2a6-456a-accc-3e0ce7127126 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:36:14.987307 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 690/1363] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:36:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:36:17.358972 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d7af8-36fd-4384-9d2b-e8dbf9f6a0fe None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:17.360646 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d7af8-36fd-4384-9d2b-e8dbf9f6a0fe None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:17.360999 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d7af8-36fd-4384-9d2b-e8dbf9f6a0fe None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:17.366367 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 674/1364] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:36:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:36:17.368455 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3548fa6-e8f8-47e9-9db3-ebde8d0f5b4f None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:17.368885 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3548fa6-e8f8-47e9-9db3-ebde8d0f5b4f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:17.369083 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3548fa6-e8f8-47e9-9db3-ebde8d0f5b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:17.444627 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e3548fa6-e8f8-47e9-9db3-ebde8d0f5b4f None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:36:17.445834 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e3548fa6-e8f8-47e9-9db3-ebde8d0f5b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:17.548666 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:36:17.551838 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 691/1365] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:36:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:36:17.598599 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917adc5-6778-48bc-8441-1f237e11f914 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:17.598981 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917adc5-6778-48bc-8441-1f237e11f914 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:17.599503 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917adc5-6778-48bc-8441-1f237e11f914 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:17.601310 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 675/1366] 10.222.0.20 () {54 vars in 962 bytes} [Thu Jul 21 03:36:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:36:17.606381 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44d46b-bac1-443c-85ea-87578dd01c52 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:17.606781 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44d46b-bac1-443c-85ea-87578dd01c52 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:17.607131 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de44d46b-bac1-443c-85ea-87578dd01c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:17.690525 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-de44d46b-bac1-443c-85ea-87578dd01c52 None None] MFA Rules not processed for user `cefbe2d0c739428ab0d4dfeaed6c37ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:36:17.691661 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-de44d46b-bac1-443c-85ea-87578dd01c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:17.835371 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 692/1367] 10.222.0.20 () {58 vars in 1059 bytes} [Thu Jul 21 03:36:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:36:17.845029 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917adc5-6778-48bc-8441-1f237e11f914 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:36:17.846760 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3917adc5-6778-48bc-8441-1f237e11f914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:18.006585 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917adc5-6778-48bc-8441-1f237e11f914 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:36:18.028633 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:36:18.133894 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702717c5-c50d-497d-b99f-1189270add5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:36:18.134577 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702717c5-c50d-497d-b99f-1189270add5e service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:18.134866 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702717c5-c50d-497d-b99f-1189270add5e service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:18.135146 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702717c5-c50d-497d-b99f-1189270add5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:18.136792 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-702717c5-c50d-497d-b99f-1189270add5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:18.230272 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702717c5-c50d-497d-b99f-1189270add5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:36:18.231858 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702717c5-c50d-497d-b99f-1189270add5e service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:36:18.251587 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 676/1368] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:36:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 03:36:19.259727 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b44682-5010-41b6-a18b-4def6691c8b5 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:19.260286 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b44682-5010-41b6-a18b-4def6691c8b5 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:19.260286 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b44682-5010-41b6-a18b-4def6691c8b5 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:19.261843 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 693/1369] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:36:19.267325 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1986f-7ae2-4857-86f2-9512a36e24b1 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:19.267740 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1986f-7ae2-4857-86f2-9512a36e24b1 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:19.267879 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1986f-7ae2-4857-86f2-9512a36e24b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:19.300345 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:36:19.338063 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-65e1986f-7ae2-4857-86f2-9512a36e24b1 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:36:19.339291 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-65e1986f-7ae2-4857-86f2-9512a36e24b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:19.439687 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 677/1370] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:36:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:36:19.778013 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9931e63-ef9b-4204-96c1-ce8db50926df None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:19.778303 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9931e63-ef9b-4204-96c1-ce8db50926df None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:19.779191 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9931e63-ef9b-4204-96c1-ce8db50926df None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:19.780117 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 694/1371] 10.222.0.20 () {54 vars in 964 bytes} [Thu Jul 21 03:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:36:19.784849 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db9b8e-6ba6-44fe-a03f-0a3d8f6cda11 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:19.785139 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db9b8e-6ba6-44fe-a03f-0a3d8f6cda11 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:19.785876 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db9b8e-6ba6-44fe-a03f-0a3d8f6cda11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:19.864290 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c4db9b8e-6ba6-44fe-a03f-0a3d8f6cda11 None None] MFA Rules not processed for user `03f2ad420185421c97d5bc06be965bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:36:19.865493 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c4db9b8e-6ba6-44fe-a03f-0a3d8f6cda11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:19.915906 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:36:19.948480 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 678/1372] 10.222.0.20 () {58 vars in 1061 bytes} [Thu Jul 21 03:36:19 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:36:19.956219 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9931e63-ef9b-4204-96c1-ce8db50926df None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:36:19.957711 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a9931e63-ef9b-4204-96c1-ce8db50926df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:20.017533 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:36:20.072507 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9931e63-ef9b-4204-96c1-ce8db50926df None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:36:20.147861 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedfc166-9bf7-4f3f-9ab4-09ea8bc305fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:36:20.148671 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedfc166-9bf7-4f3f-9ab4-09ea8bc305fe service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:20.149054 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedfc166-9bf7-4f3f-9ab4-09ea8bc305fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:20.149428 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedfc166-9bf7-4f3f-9ab4-09ea8bc305fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:20.151216 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-bedfc166-9bf7-4f3f-9ab4-09ea8bc305fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:20.249803 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:36:20.265138 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedfc166-9bf7-4f3f-9ab4-09ea8bc305fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:36:20.266826 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedfc166-9bf7-4f3f-9ab4-09ea8bc305fe service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:36:20.286406 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 695/1373] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:36:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:36:20.400469 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d696a051-0988-4afa-8b41-4a4442e1dafb None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:20.401037 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d696a051-0988-4afa-8b41-4a4442e1dafb None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:20.401205 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d696a051-0988-4afa-8b41-4a4442e1dafb None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:20.402556 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 679/1374] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:36:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:36:20.408482 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc27ac-48d8-426a-ac6e-60e1edef07c5 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:20.408777 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc27ac-48d8-426a-ac6e-60e1edef07c5 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:20.409140 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc27ac-48d8-426a-ac6e-60e1edef07c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:20.487105 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-49fc27ac-48d8-426a-ac6e-60e1edef07c5 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:36:20.488652 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-49fc27ac-48d8-426a-ac6e-60e1edef07c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:20.606938 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 696/1375] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:36:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:36:20.651891 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d696a051-0988-4afa-8b41-4a4442e1dafb None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:36:20.654162 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d696a051-0988-4afa-8b41-4a4442e1dafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:20.830416 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d696a051-0988-4afa-8b41-4a4442e1dafb None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:36:20.882495 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:36:20.945166 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b92fea0-3f78-473f-8483-430caaabb3a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:36:20.945815 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92fea0-3f78-473f-8483-430caaabb3a7 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:20.946092 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92fea0-3f78-473f-8483-430caaabb3a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:20.946361 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b92fea0-3f78-473f-8483-430caaabb3a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:20.948045 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3b92fea0-3f78-473f-8483-430caaabb3a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:21.042969 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b92fea0-3f78-473f-8483-430caaabb3a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:36:21.044704 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b92fea0-3f78-473f-8483-430caaabb3a7 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:36:21.063337 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 680/1376] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:36:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:36:23.163794 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31fb787-323a-478e-8d98-6796f44dcaa3 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:23.164365 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31fb787-323a-478e-8d98-6796f44dcaa3 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:23.164632 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31fb787-323a-478e-8d98-6796f44dcaa3 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:23.166355 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 697/1377] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:36:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:36:23.172368 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299daa42-b92c-4726-b49f-ce9aac00b6d3 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:23.172809 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299daa42-b92c-4726-b49f-ce9aac00b6d3 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:23.173243 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299daa42-b92c-4726-b49f-ce9aac00b6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:23.256200 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-299daa42-b92c-4726-b49f-ce9aac00b6d3 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:36:23.257314 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-299daa42-b92c-4726-b49f-ce9aac00b6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:23.263959 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:36:23.355829 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 681/1378] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:36:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:36:23.399582 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31fb787-323a-478e-8d98-6796f44dcaa3 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:36:23.401167 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e31fb787-323a-478e-8d98-6796f44dcaa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:23.469456 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:36:23.555242 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31fb787-323a-478e-8d98-6796f44dcaa3 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:36:23.708139 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e26644-a90d-42d3-8c79-d62eda08093e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:36:23.708765 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e26644-a90d-42d3-8c79-d62eda08093e service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:23.709048 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e26644-a90d-42d3-8c79-d62eda08093e service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:23.709319 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e26644-a90d-42d3-8c79-d62eda08093e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:23.711172 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-82e26644-a90d-42d3-8c79-d62eda08093e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:23.735507 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:36:23.819476 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e26644-a90d-42d3-8c79-d62eda08093e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:36:23.821225 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e26644-a90d-42d3-8c79-d62eda08093e service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:36:23.839960 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 698/1379] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:36:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:36:25.898564 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1767587-fd04-4775-aa55-5802ec6e6f27 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:25.899116 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1767587-fd04-4775-aa55-5802ec6e6f27 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:25.899116 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1767587-fd04-4775-aa55-5802ec6e6f27 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:25.900667 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 682/1380] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:36:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:36:25.905642 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c440a-6f36-4422-bd28-3c97ca3a093a None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:25.906046 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c440a-6f36-4422-bd28-3c97ca3a093a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:25.906845 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c440a-6f36-4422-bd28-3c97ca3a093a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:25.972690 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-311c440a-6f36-4422-bd28-3c97ca3a093a None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:36:25.973901 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-311c440a-6f36-4422-bd28-3c97ca3a093a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:26.072444 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:36:26.080001 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 699/1381] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:36:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:36:26.124326 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1767587-fd04-4775-aa55-5802ec6e6f27 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:36:26.126758 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b1767587-fd04-4775-aa55-5802ec6e6f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:26.271670 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:36:26.284559 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1767587-fd04-4775-aa55-5802ec6e6f27 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:36:26.405542 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92820257-af75-404c-916c-e5a422f61db8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:36:26.406760 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92820257-af75-404c-916c-e5a422f61db8 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:26.407048 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92820257-af75-404c-916c-e5a422f61db8 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:26.407324 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92820257-af75-404c-916c-e5a422f61db8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:26.408998 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-92820257-af75-404c-916c-e5a422f61db8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:26.518875 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92820257-af75-404c-916c-e5a422f61db8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:36:26.520570 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92820257-af75-404c-916c-e5a422f61db8 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:36:26.534648 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:36:26.545426 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 683/1382] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:36:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:36:28.738345 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a51271-ce94-4df4-9265-79b1211a95dd None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:28.738931 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a51271-ce94-4df4-9265-79b1211a95dd None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:28.738931 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a51271-ce94-4df4-9265-79b1211a95dd None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:28.740500 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 700/1383] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:36:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:36:28.745864 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107e2e3-2d9e-4bfe-8ae6-36edd503b383 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:28.746413 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107e2e3-2d9e-4bfe-8ae6-36edd503b383 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:28.746413 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1107e2e3-2d9e-4bfe-8ae6-36edd503b383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:28.812201 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-1107e2e3-2d9e-4bfe-8ae6-36edd503b383 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:36:28.813881 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1107e2e3-2d9e-4bfe-8ae6-36edd503b383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:28.915865 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 684/1384] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:36:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:36:28.963130 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a51271-ce94-4df4-9265-79b1211a95dd None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:36:28.964605 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c9a51271-ce94-4df4-9265-79b1211a95dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:29.124532 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a51271-ce94-4df4-9265-79b1211a95dd None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:36:29.212510 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:36:29.266268 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715df55e-8e55-43e7-9d31-c7473ce3c15c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:36:29.266984 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715df55e-8e55-43e7-9d31-c7473ce3c15c service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:29.267275 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715df55e-8e55-43e7-9d31-c7473ce3c15c service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:29.267551 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715df55e-8e55-43e7-9d31-c7473ce3c15c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:29.269263 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-715df55e-8e55-43e7-9d31-c7473ce3c15c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:29.360029 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715df55e-8e55-43e7-9d31-c7473ce3c15c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:36:29.361658 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715df55e-8e55-43e7-9d31-c7473ce3c15c service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:36:29.379606 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 701/1385] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:36:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:36:31.415593 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94b720-7a3f-4c36-93ad-753c84d2a93e None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:31.416161 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94b720-7a3f-4c36-93ad-753c84d2a93e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:31.416161 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94b720-7a3f-4c36-93ad-753c84d2a93e None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:31.417513 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 685/1386] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:36:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:36:31.423208 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268bc10-5bcb-4305-be14-0f495cc90a81 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:31.423640 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268bc10-5bcb-4305-be14-0f495cc90a81 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:31.423779 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268bc10-5bcb-4305-be14-0f495cc90a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:31.490941 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-2268bc10-5bcb-4305-be14-0f495cc90a81 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:36:31.492163 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2268bc10-5bcb-4305-be14-0f495cc90a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:31.532912 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:36:31.597425 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 702/1387] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:36:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:36:31.651683 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94b720-7a3f-4c36-93ad-753c84d2a93e None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:36:31.653672 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ce94b720-7a3f-4c36-93ad-753c84d2a93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:31.754857 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:36:31.838149 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94b720-7a3f-4c36-93ad-753c84d2a93e None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:36:31.959702 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9e49a-5a0c-4956-8856-2b59f3029338 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:36:31.960872 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9e49a-5a0c-4956-8856-2b59f3029338 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:31.961247 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9e49a-5a0c-4956-8856-2b59f3029338 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:31.961629 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9e49a-5a0c-4956-8856-2b59f3029338 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:31.963918 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-60c9e49a-5a0c-4956-8856-2b59f3029338 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:32.007791 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:36:32.060857 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9e49a-5a0c-4956-8856-2b59f3029338 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:36:32.063119 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9e49a-5a0c-4956-8856-2b59f3029338 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:36:32.081374 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 686/1388] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:36:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:36:34.145850 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3618d12-3419-42c9-b266-8f5f6ccab7fb None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:34.146421 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3618d12-3419-42c9-b266-8f5f6ccab7fb None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:34.146421 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3618d12-3419-42c9-b266-8f5f6ccab7fb None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:34.148211 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 703/1389] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:36:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:36:34.153509 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae637f0-3257-4caf-b6ae-818b9c2b9d33 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:34.153936 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae637f0-3257-4caf-b6ae-818b9c2b9d33 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:34.154089 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae637f0-3257-4caf-b6ae-818b9c2b9d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:34.218213 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-bae637f0-3257-4caf-b6ae-818b9c2b9d33 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:36:34.220047 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-bae637f0-3257-4caf-b6ae-818b9c2b9d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:34.316232 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 687/1390] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:36:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:36:34.361464 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3618d12-3419-42c9-b266-8f5f6ccab7fb None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:36:34.363043 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b3618d12-3419-42c9-b266-8f5f6ccab7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:34.507588 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3618d12-3419-42c9-b266-8f5f6ccab7fb None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:36:34.524270 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:36:34.621917 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b64bf-e592-42fd-84b8-78f8529d31c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:36:34.622603 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b64bf-e592-42fd-84b8-78f8529d31c5 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:34.622890 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b64bf-e592-42fd-84b8-78f8529d31c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:34.623165 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b64bf-e592-42fd-84b8-78f8529d31c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:34.624830 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-514b64bf-e592-42fd-84b8-78f8529d31c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:34.714987 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b64bf-e592-42fd-84b8-78f8529d31c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:36:34.716613 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b64bf-e592-42fd-84b8-78f8529d31c5 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:36:34.735564 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 704/1391] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:36:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:36:35.233880 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c43862-b6f2-4e1d-bde0-8bd7b65c015b None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:35.234506 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c43862-b6f2-4e1d-bde0-8bd7b65c015b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:35.234506 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c43862-b6f2-4e1d-bde0-8bd7b65c015b None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:35.235859 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 688/1392] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:36:35.240983 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527aa435-719b-475f-bcc9-9b88b8e1e532 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:35.241386 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527aa435-719b-475f-bcc9-9b88b8e1e532 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:35.241549 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527aa435-719b-475f-bcc9-9b88b8e1e532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:35.267100 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:36:35.308173 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-527aa435-719b-475f-bcc9-9b88b8e1e532 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:36:35.309360 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-527aa435-719b-475f-bcc9-9b88b8e1e532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:35.406283 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 705/1393] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:36:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:36:35.463407 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd566bf-2215-4b00-827b-0094115678fa None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:35.463709 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd566bf-2215-4b00-827b-0094115678fa None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:35.464064 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd566bf-2215-4b00-827b-0094115678fa None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:35.465831 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 689/1394] 10.222.0.20 () {54 vars in 966 bytes} [Thu Jul 21 03:36:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:36:35.471273 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb38e5-84da-4c4c-91ef-894f79581e63 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:35.471570 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb38e5-84da-4c4c-91ef-894f79581e63 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:35.471850 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb38e5-84da-4c4c-91ef-894f79581e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:35.547641 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d2eb38e5-84da-4c4c-91ef-894f79581e63 None None] MFA Rules not processed for user `a567cddc98164bd39317a245626d0f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:36:35.548770 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d2eb38e5-84da-4c4c-91ef-894f79581e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:35.589695 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:36:35.624484 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 706/1395] 10.222.0.20 () {58 vars in 1063 bytes} [Thu Jul 21 03:36:35 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:36:35.632425 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd566bf-2215-4b00-827b-0094115678fa None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:36:35.634245 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4fd566bf-2215-4b00-827b-0094115678fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:35.648612 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:36:35.745643 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd566bf-2215-4b00-827b-0094115678fa None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:36:35.820072 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7195d8-491e-43f7-9f8a-ccf67f1e7bba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a567cddc98164bd39317a245626d0f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:36:35.820645 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7195d8-491e-43f7-9f8a-ccf67f1e7bba service glance] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:35.820926 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7195d8-491e-43f7-9f8a-ccf67f1e7bba service glance] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:35.821199 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7195d8-491e-43f7-9f8a-ccf67f1e7bba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:35.822843 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2e7195d8-491e-43f7-9f8a-ccf67f1e7bba service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:35.894347 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:36:35.936010 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7195d8-491e-43f7-9f8a-ccf67f1e7bba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:36:35.938041 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7195d8-491e-43f7-9f8a-ccf67f1e7bba service glance] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:36:35.955909 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 690/1396] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:36:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:36:36.657101 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16eb2b3-f63a-4f65-9972-3c79a29fe184 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:36.657559 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16eb2b3-f63a-4f65-9972-3c79a29fe184 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:36.657649 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16eb2b3-f63a-4f65-9972-3c79a29fe184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:36.725433 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e16eb2b3-f63a-4f65-9972-3c79a29fe184 None None] MFA Rules not processed for user `73fad109df9f449e8ac5f38749c01ace`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:36:36.726738 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e16eb2b3-f63a-4f65-9972-3c79a29fe184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:36.799146 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c2890-cd11-4820-9f89-3e2023a6b905 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:36.799680 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c2890-cd11-4820-9f89-3e2023a6b905 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:36.799883 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c2890-cd11-4820-9f89-3e2023a6b905 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:36.801798 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 691/1397] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:36:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 03:36:36.806799 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9fb36-12af-4bb1-a382-7de67c318fdd None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:36.807098 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9fb36-12af-4bb1-a382-7de67c318fdd None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:36.807387 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a9fb36-12af-4bb1-a382-7de67c318fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:36.813298 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 707/1398] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jul 21 03:36:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:36:36.856444 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5894bf-6c40-495c-a453-0048d3ef6fc5 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:36.856735 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5894bf-6c40-495c-a453-0048d3ef6fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:36.857015 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5894bf-6c40-495c-a453-0048d3ef6fc5 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:36.858904 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 708/1399] 10.222.0.20 () {54 vars in 943 bytes} [Thu Jul 21 03:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 03:36:36.865220 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e3bc2-a933-459e-92f4-bd67697bc39a None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:36.865515 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e3bc2-a933-459e-92f4-bd67697bc39a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:36.865796 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e3bc2-a933-459e-92f4-bd67697bc39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:36.881267 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-05a9fb36-12af-4bb1-a382-7de67c318fdd None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:36:36.882523 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-05a9fb36-12af-4bb1-a382-7de67c318fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:36.936186 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:36:36.944583 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-401e3bc2-a933-459e-92f4-bd67697bc39a None None] MFA Rules not processed for user `ce8bc228892e45c0a7d1b529c2f9a8f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:36:36.945796 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-401e3bc2-a933-459e-92f4-bd67697bc39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:36.983191 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 692/1400] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:36:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:36:37.029366 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9fb36-12af-4bb1-a382-7de67c318fdd None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:36:37.030609 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-05a9fb36-12af-4bb1-a382-7de67c318fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:37.052776 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 709/1401] 10.222.0.20 () {58 vars in 1040 bytes} [Thu Jul 21 03:36:36 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:36:37.056747 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:36:37.063358 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e3bc2-a933-459e-92f4-bd67697bc39a None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:36:37.075555 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e3bc2-a933-459e-92f4-bd67697bc39a None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:36:37.146977 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a9fb36-12af-4bb1-a382-7de67c318fdd None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:36:37.182580 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a42e9-42db-43d6-9e8b-f69ad9aa6a68 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8bc228892e45c0a7d1b529c2f9a8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:36:37.183244 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a42e9-42db-43d6-9e8b-f69ad9aa6a68 service swift] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:37.183531 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a42e9-42db-43d6-9e8b-f69ad9aa6a68 service swift] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:37.183805 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a42e9-42db-43d6-9e8b-f69ad9aa6a68 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:37.185566 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3b8a42e9-42db-43d6-9e8b-f69ad9aa6a68 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:37.189065 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:36:37.265752 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be9246-8256-4afd-97f4-6388c064f8d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:36:37.266405 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be9246-8256-4afd-97f4-6388c064f8d0 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:37.266719 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be9246-8256-4afd-97f4-6388c064f8d0 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:37.266993 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be9246-8256-4afd-97f4-6388c064f8d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:37.268645 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-37be9246-8256-4afd-97f4-6388c064f8d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:37.272264 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a42e9-42db-43d6-9e8b-f69ad9aa6a68 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:36:37.274139 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a42e9-42db-43d6-9e8b-f69ad9aa6a68 service swift] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:36:37.289462 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:36:37.292685 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 710/1402] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jul 21 03:36:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 03:36:37.370720 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be9246-8256-4afd-97f4-6388c064f8d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:36:37.372326 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be9246-8256-4afd-97f4-6388c064f8d0 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:36:37.392392 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 693/1403] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:36:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 03:36:39.484936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9df4fe-1d60-4860-91e3-a3572449e5d5 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:39.485526 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9df4fe-1d60-4860-91e3-a3572449e5d5 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:39.485526 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9df4fe-1d60-4860-91e3-a3572449e5d5 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:39.487419 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 711/1404] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:36:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:36:39.492581 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01256b1-bd65-4e00-999a-33f4844adf93 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:39.493024 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01256b1-bd65-4e00-999a-33f4844adf93 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:39.493134 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01256b1-bd65-4e00-999a-33f4844adf93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:39.567330 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d01256b1-bd65-4e00-999a-33f4844adf93 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:36:39.568550 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d01256b1-bd65-4e00-999a-33f4844adf93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:39.671204 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:36:39.682500 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 694/1405] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:36:39.728144 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9df4fe-1d60-4860-91e3-a3572449e5d5 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:36:39.729797 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-eb9df4fe-1d60-4860-91e3-a3572449e5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:39.894380 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:36:39.898797 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9df4fe-1d60-4860-91e3-a3572449e5d5 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:36:40.036805 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022a9b13-9961-4b49-9a94-78620042c279 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:36:40.037843 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a9b13-9961-4b49-9a94-78620042c279 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:40.038129 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a9b13-9961-4b49-9a94-78620042c279 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:40.038405 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022a9b13-9961-4b49-9a94-78620042c279 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:40.040110 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-022a9b13-9961-4b49-9a94-78620042c279 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:40.135934 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a9b13-9961-4b49-9a94-78620042c279 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:36:40.137536 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022a9b13-9961-4b49-9a94-78620042c279 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:36:40.157561 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 712/1406] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:36:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:36:42.263669 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01f5f6-9423-49a3-8e45-d10cbbf19683 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:42.264277 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01f5f6-9423-49a3-8e45-d10cbbf19683 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:42.264277 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01f5f6-9423-49a3-8e45-d10cbbf19683 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:42.265764 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 695/1407] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:36:42.270854 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5bc21-595c-4624-92cd-961f05941abb None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:42.271632 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5bc21-595c-4624-92cd-961f05941abb None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:42.271947 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5bc21-595c-4624-92cd-961f05941abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:42.276999 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:36:42.343032 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-5cb5bc21-595c-4624-92cd-961f05941abb None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:36:42.344772 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5cb5bc21-595c-4624-92cd-961f05941abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:42.451569 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 713/1408] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:36:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:36:42.497116 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01f5f6-9423-49a3-8e45-d10cbbf19683 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:36:42.498700 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-cd01f5f6-9423-49a3-8e45-d10cbbf19683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:42.660603 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01f5f6-9423-49a3-8e45-d10cbbf19683 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:36:42.736020 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:36:42.790693 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabb713-f4a9-4080-8dfd-fc24d3ff497b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:36:42.791744 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabb713-f4a9-4080-8dfd-fc24d3ff497b service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:42.792030 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabb713-f4a9-4080-8dfd-fc24d3ff497b service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:42.792307 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabb713-f4a9-4080-8dfd-fc24d3ff497b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:42.794117 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5aabb713-f4a9-4080-8dfd-fc24d3ff497b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:42.893082 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aabb713-f4a9-4080-8dfd-fc24d3ff497b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:36:42.894726 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aabb713-f4a9-4080-8dfd-fc24d3ff497b service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:36:42.914034 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 696/1409] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:36:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:36:52.449515 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=64 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:36:52.911371 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=64 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:36:59.380003 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95c437-c988-42d7-b1eb-af675acb49bb None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:59.380586 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95c437-c988-42d7-b1eb-af675acb49bb None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:59.380586 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95c437-c988-42d7-b1eb-af675acb49bb None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:59.381981 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 714/1410] 10.222.0.20 () {54 vars in 918 bytes} [Thu Jul 21 03:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 03:36:59.387102 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249bf46-f72f-4ab1-a54a-9f9539d3c704 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:59.387548 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249bf46-f72f-4ab1-a54a-9f9539d3c704 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:59.387652 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6249bf46-f72f-4ab1-a54a-9f9539d3c704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:59.460241 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-6249bf46-f72f-4ab1-a54a-9f9539d3c704 None None] MFA Rules not processed for user `cb39129b3ed04db28ed01860b37bd714`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:36:59.461645 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6249bf46-f72f-4ab1-a54a-9f9539d3c704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:59.566072 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 697/1411] 10.222.0.20 () {58 vars in 1015 bytes} [Thu Jul 21 03:36:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:36:59.580266 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43219a8-a538-41ff-a53c-305c5636a76c None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:59.580555 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43219a8-a538-41ff-a53c-305c5636a76c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:59.580884 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43219a8-a538-41ff-a53c-305c5636a76c None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:59.582236 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 715/1412] 10.222.0.20 () {54 vars in 918 bytes} [Thu Jul 21 03:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:36:59.586776 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802f149-7f49-4d59-b72f-2021238bbfd4 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:36:59.587063 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802f149-7f49-4d59-b72f-2021238bbfd4 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:36:59.587337 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802f149-7f49-4d59-b72f-2021238bbfd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:36:59.656138 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:36:59.658746 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-3802f149-7f49-4d59-b72f-2021238bbfd4 None None] MFA Rules not processed for user `cefbe2d0c739428ab0d4dfeaed6c37ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:36:59.660492 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3802f149-7f49-4d59-b72f-2021238bbfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:36:59.777618 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 698/1413] 10.222.0.20 () {58 vars in 1015 bytes} [Thu Jul 21 03:36:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:37:02.254504 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673d23a-3052-4a97-846a-5d2ae7332d63 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:02.255076 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673d23a-3052-4a97-846a-5d2ae7332d63 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:02.255076 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673d23a-3052-4a97-846a-5d2ae7332d63 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:02.256451 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 716/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 03:37:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:37:02.261846 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4de8b2-4fc7-437a-804f-ef5b579b4f74 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:02.262274 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4de8b2-4fc7-437a-804f-ef5b579b4f74 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:02.262406 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4de8b2-4fc7-437a-804f-ef5b579b4f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:02.325589 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-bf4de8b2-4fc7-437a-804f-ef5b579b4f74 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:37:02.326799 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-bf4de8b2-4fc7-437a-804f-ef5b579b4f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:02.380906 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:37:02.423407 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 699/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 03:37:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:37:02.467098 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5673d23a-3052-4a97-846a-5d2ae7332d63 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:37:02.469272 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5673d23a-3052-4a97-846a-5d2ae7332d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:02.610892 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5673d23a-3052-4a97-846a-5d2ae7332d63 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:37:02.685033 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:37:02.725780 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec40f89-7e5e-4057-bee5-1a919a75854c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:37:02.726431 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec40f89-7e5e-4057-bee5-1a919a75854c service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:02.726751 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec40f89-7e5e-4057-bee5-1a919a75854c service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:02.727023 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec40f89-7e5e-4057-bee5-1a919a75854c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:02.728661 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-fec40f89-7e5e-4057-bee5-1a919a75854c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:02.815326 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec40f89-7e5e-4057-bee5-1a919a75854c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:37:02.816911 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec40f89-7e5e-4057-bee5-1a919a75854c service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:37:02.834482 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 717/1416] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:37:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:37:03.731838 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938be12e-ca34-4eb6-9ef1-0d6863cfbf9e None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:03.732426 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938be12e-ca34-4eb6-9ef1-0d6863cfbf9e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:03.732426 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938be12e-ca34-4eb6-9ef1-0d6863cfbf9e None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:03.733770 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 700/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 03:37:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:37:03.739078 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80593319-5d34-475f-a3c4-fb11b59ede6d None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:03.739508 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80593319-5d34-475f-a3c4-fb11b59ede6d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:03.739874 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80593319-5d34-475f-a3c4-fb11b59ede6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:03.815708 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-80593319-5d34-475f-a3c4-fb11b59ede6d None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:37:03.816904 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-80593319-5d34-475f-a3c4-fb11b59ede6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:03.843732 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:37:03.912754 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 718/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 03:37:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:37:04.063428 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938be12e-ca34-4eb6-9ef1-0d6863cfbf9e None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:37:04.064904 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-938be12e-ca34-4eb6-9ef1-0d6863cfbf9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:04.206743 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938be12e-ca34-4eb6-9ef1-0d6863cfbf9e None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:37:04.246424 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:37:04.318875 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f77d68-5ee4-49b6-9da9-2512e1bbc687 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:37:04.319451 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f77d68-5ee4-49b6-9da9-2512e1bbc687 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:04.319739 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f77d68-5ee4-49b6-9da9-2512e1bbc687 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:04.320023 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f77d68-5ee4-49b6-9da9-2512e1bbc687 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:04.321696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-98f77d68-5ee4-49b6-9da9-2512e1bbc687 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:04.410877 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f77d68-5ee4-49b6-9da9-2512e1bbc687 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:37:04.412473 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f77d68-5ee4-49b6-9da9-2512e1bbc687 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:37:04.430687 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 701/1419] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:37:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:37:05.305113 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75063b62-9878-4fc7-81b2-94529377cc09 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:05.305733 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75063b62-9878-4fc7-81b2-94529377cc09 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:05.305733 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75063b62-9878-4fc7-81b2-94529377cc09 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:05.307093 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 719/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 03:37:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:37:05.311985 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73851f63-a0fb-4cf8-933b-c310e7ceaafa None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:05.312913 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73851f63-a0fb-4cf8-933b-c310e7ceaafa None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:05.313110 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73851f63-a0fb-4cf8-933b-c310e7ceaafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:05.367460 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:37:05.390230 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-73851f63-a0fb-4cf8-933b-c310e7ceaafa None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:37:05.391572 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-73851f63-a0fb-4cf8-933b-c310e7ceaafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:05.488012 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 702/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 03:37:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:37:05.637635 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75063b62-9878-4fc7-81b2-94529377cc09 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:37:05.639225 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-75063b62-9878-4fc7-81b2-94529377cc09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:05.781047 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75063b62-9878-4fc7-81b2-94529377cc09 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:37:05.793441 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:37:05.892398 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53411f-b8b3-4abb-976a-5f7c387d96c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:37:05.892977 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53411f-b8b3-4abb-976a-5f7c387d96c9 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:05.893254 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53411f-b8b3-4abb-976a-5f7c387d96c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:05.893526 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53411f-b8b3-4abb-976a-5f7c387d96c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:05.895199 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4c53411f-b8b3-4abb-976a-5f7c387d96c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:05.981574 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c53411f-b8b3-4abb-976a-5f7c387d96c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:37:05.983214 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c53411f-b8b3-4abb-976a-5f7c387d96c9 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:37:06.001723 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 720/1422] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:37:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:37:06.851753 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe43b9-6cb5-481a-b702-05fe9755fcb9 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:06.852350 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe43b9-6cb5-481a-b702-05fe9755fcb9 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:06.852350 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe43b9-6cb5-481a-b702-05fe9755fcb9 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:06.853768 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 703/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 03:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:37:06.858928 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1fe60-76a8-43a9-bdbe-51d7961f9efd None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:06.859399 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1fe60-76a8-43a9-bdbe-51d7961f9efd None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:06.860064 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1fe60-76a8-43a9-bdbe-51d7961f9efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:06.878532 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:37:06.933409 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f2e1fe60-76a8-43a9-bdbe-51d7961f9efd None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:37:06.934681 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f2e1fe60-76a8-43a9-bdbe-51d7961f9efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:07.029655 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 721/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 03:37:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:37:07.179767 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe43b9-6cb5-481a-b702-05fe9755fcb9 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:37:07.181288 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-78fe43b9-6cb5-481a-b702-05fe9755fcb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:07.289742 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:37:07.325163 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe43b9-6cb5-481a-b702-05fe9755fcb9 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:37:07.435931 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36070261-738f-4977-92b9-da7e483d4599 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:37:07.436576 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36070261-738f-4977-92b9-da7e483d4599 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:07.436878 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36070261-738f-4977-92b9-da7e483d4599 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:07.437139 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36070261-738f-4977-92b9-da7e483d4599 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:07.439586 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-36070261-738f-4977-92b9-da7e483d4599 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:07.515194 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:37:07.529141 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36070261-738f-4977-92b9-da7e483d4599 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:37:07.530782 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36070261-738f-4977-92b9-da7e483d4599 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:37:07.549704 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 704/1425] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:37:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:37:08.412522 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152df4c-6d59-434a-81d2-14854eaa9807 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:08.413132 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152df4c-6d59-434a-81d2-14854eaa9807 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:08.413132 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152df4c-6d59-434a-81d2-14854eaa9807 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:08.414473 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 722/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 03:37:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:37:08.419427 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1843e1f-9ee0-4d32-841a-fc4979d524be None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:08.419935 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1843e1f-9ee0-4d32-841a-fc4979d524be None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:08.420047 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1843e1f-9ee0-4d32-841a-fc4979d524be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:08.494625 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c1843e1f-9ee0-4d32-841a-fc4979d524be None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:37:08.495851 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c1843e1f-9ee0-4d32-841a-fc4979d524be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:08.590332 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 705/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 03:37:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:37:08.740906 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1152df4c-6d59-434a-81d2-14854eaa9807 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:37:08.742426 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1152df4c-6d59-434a-81d2-14854eaa9807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:08.825273 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:37:08.886338 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1152df4c-6d59-434a-81d2-14854eaa9807 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:37:08.996360 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4cda69-abaf-403c-a330-13fda1862169 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:37:08.996936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4cda69-abaf-403c-a330-13fda1862169 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:08.997221 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4cda69-abaf-403c-a330-13fda1862169 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:08.997496 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4cda69-abaf-403c-a330-13fda1862169 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:08.999159 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7b4cda69-abaf-403c-a330-13fda1862169 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:09.045856 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:37:09.086240 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4cda69-abaf-403c-a330-13fda1862169 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:37:09.087872 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4cda69-abaf-403c-a330-13fda1862169 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:37:09.106107 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 723/1428] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:37:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:37:09.937955 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8ee7e-18de-4a1d-ac13-93302d48586f None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:09.938522 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8ee7e-18de-4a1d-ac13-93302d48586f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:09.938522 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8ee7e-18de-4a1d-ac13-93302d48586f None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:09.939913 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 706/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 03:37:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:37:09.944866 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83180cc-3bbf-43ac-8318-cd4081aeb882 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:09.945298 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83180cc-3bbf-43ac-8318-cd4081aeb882 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:09.945411 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83180cc-3bbf-43ac-8318-cd4081aeb882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:10.022229 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e83180cc-3bbf-43ac-8318-cd4081aeb882 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:37:10.023406 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e83180cc-3bbf-43ac-8318-cd4081aeb882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:10.120049 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 724/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 03:37:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:37:10.268975 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8ee7e-18de-4a1d-ac13-93302d48586f None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:37:10.270502 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ead8ee7e-18de-4a1d-ac13-93302d48586f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:10.318522 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:37:10.413268 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8ee7e-18de-4a1d-ac13-93302d48586f None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:37:10.523510 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c50c6d-cfe2-480e-8d4f-f0eeb041be66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:37:10.524429 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c50c6d-cfe2-480e-8d4f-f0eeb041be66 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:10.524699 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c50c6d-cfe2-480e-8d4f-f0eeb041be66 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:10.524977 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c50c6d-cfe2-480e-8d4f-f0eeb041be66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:10.526654 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a3c50c6d-cfe2-480e-8d4f-f0eeb041be66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:10.533491 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:37:10.614819 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c50c6d-cfe2-480e-8d4f-f0eeb041be66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:37:10.616429 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c50c6d-cfe2-480e-8d4f-f0eeb041be66 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:37:10.633974 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 707/1431] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:37:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:37:11.434608 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee09f8-84c2-43f2-afdd-556e9549f207 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:11.435270 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee09f8-84c2-43f2-afdd-556e9549f207 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:11.435270 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee09f8-84c2-43f2-afdd-556e9549f207 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:11.436567 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 725/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 03:37:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:37:11.441380 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a339e6-5bcc-40fd-8cb5-01423c3e15b3 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:11.441789 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a339e6-5bcc-40fd-8cb5-01423c3e15b3 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:11.441943 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a339e6-5bcc-40fd-8cb5-01423c3e15b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:11.517292 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-31a339e6-5bcc-40fd-8cb5-01423c3e15b3 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:37:11.518510 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-31a339e6-5bcc-40fd-8cb5-01423c3e15b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:11.585661 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:37:11.614907 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 708/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 03:37:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:37:11.764862 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee09f8-84c2-43f2-afdd-556e9549f207 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:37:11.767067 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a9ee09f8-84c2-43f2-afdd-556e9549f207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:11.784735 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:37:11.915318 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee09f8-84c2-43f2-afdd-556e9549f207 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:37:12.001866 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:37:12.028745 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95d205-cfd9-4d87-9028-41a5086720e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:37:12.029430 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95d205-cfd9-4d87-9028-41a5086720e0 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:12.029754 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95d205-cfd9-4d87-9028-41a5086720e0 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:12.030068 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95d205-cfd9-4d87-9028-41a5086720e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:12.032996 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2b95d205-cfd9-4d87-9028-41a5086720e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:12.121773 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b95d205-cfd9-4d87-9028-41a5086720e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:37:12.123394 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b95d205-cfd9-4d87-9028-41a5086720e0 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:37:12.141487 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 726/1434] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:37:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:37:12.943536 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a0677-8689-464e-9986-e8f86ee48eae None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:12.944015 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a0677-8689-464e-9986-e8f86ee48eae None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:12.944124 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a0677-8689-464e-9986-e8f86ee48eae None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:12.945470 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 709/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 03:37:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:37:12.950207 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cca57a-c239-4a5c-9a21-8dc0f1a76b7b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:12.950632 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cca57a-c239-4a5c-9a21-8dc0f1a76b7b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:12.950795 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cca57a-c239-4a5c-9a21-8dc0f1a76b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:13.023626 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-81cca57a-c239-4a5c-9a21-8dc0f1a76b7b None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:37:13.025075 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-81cca57a-c239-4a5c-9a21-8dc0f1a76b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:13.065899 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:37:13.120586 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 727/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 03:37:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:37:13.272721 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a0677-8689-464e-9986-e8f86ee48eae None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:37:13.274483 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c92a0677-8689-464e-9986-e8f86ee48eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:13.417311 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a0677-8689-464e-9986-e8f86ee48eae None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:37:13.470471 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:37:13.529252 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e1a7f7-9a4a-420a-9fd8-36f5ae50d727 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:37:13.529828 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1a7f7-9a4a-420a-9fd8-36f5ae50d727 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:13.530113 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1a7f7-9a4a-420a-9fd8-36f5ae50d727 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:13.530390 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e1a7f7-9a4a-420a-9fd8-36f5ae50d727 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:13.532100 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-27e1a7f7-9a4a-420a-9fd8-36f5ae50d727 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:13.618472 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e1a7f7-9a4a-420a-9fd8-36f5ae50d727 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:37:13.620064 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e1a7f7-9a4a-420a-9fd8-36f5ae50d727 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:37:13.637590 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 710/1437] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:37:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:37:14.481675 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e16e9-33ec-44d3-8863-008a2603e954 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:14.482210 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e16e9-33ec-44d3-8863-008a2603e954 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:14.482210 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e16e9-33ec-44d3-8863-008a2603e954 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:14.483606 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 728/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 03:37:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:37:14.489113 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c6905-6d65-4b3e-bba3-a2476de6ac6b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:14.489515 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c6905-6d65-4b3e-bba3-a2476de6ac6b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:14.489674 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c6905-6d65-4b3e-bba3-a2476de6ac6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:14.564440 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-fc6c6905-6d65-4b3e-bba3-a2476de6ac6b None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:37:14.565653 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fc6c6905-6d65-4b3e-bba3-a2476de6ac6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:14.567656 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:37:14.662809 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 711/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 03:37:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:37:14.816616 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e16e9-33ec-44d3-8863-008a2603e954 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:37:14.818116 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-eb3e16e9-33ec-44d3-8863-008a2603e954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:14.961581 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e16e9-33ec-44d3-8863-008a2603e954 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:37:14.988772 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:37:15.072799 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e813d-30ab-4087-9b60-257dcab9ebff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:37:15.073366 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e813d-30ab-4087-9b60-257dcab9ebff service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:15.073652 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e813d-30ab-4087-9b60-257dcab9ebff service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:15.073923 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e813d-30ab-4087-9b60-257dcab9ebff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:15.075596 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6d1e813d-30ab-4087-9b60-257dcab9ebff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:15.162396 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1e813d-30ab-4087-9b60-257dcab9ebff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:37:15.164009 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1e813d-30ab-4087-9b60-257dcab9ebff service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:37:15.181376 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 729/1440] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:37:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:37:17.156518 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635a175-84f8-42f6-ab62-e6be6b12d7d7 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:17.157082 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635a175-84f8-42f6-ab62-e6be6b12d7d7 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:17.157082 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6635a175-84f8-42f6-ab62-e6be6b12d7d7 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:17.158491 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 712/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 03:37:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:37:17.163854 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222c8cb-ff02-43e8-95f7-9aadcbf24d86 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:17.164302 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222c8cb-ff02-43e8-95f7-9aadcbf24d86 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:17.164409 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5222c8cb-ff02-43e8-95f7-9aadcbf24d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:17.204702 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:37:17.229052 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-5222c8cb-ff02-43e8-95f7-9aadcbf24d86 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:37:17.230241 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5222c8cb-ff02-43e8-95f7-9aadcbf24d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:17.325753 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 730/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 03:37:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:37:17.365671 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6635a175-84f8-42f6-ab62-e6be6b12d7d7 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:37:17.367237 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6635a175-84f8-42f6-ab62-e6be6b12d7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:17.468643 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6635a175-84f8-42f6-ab62-e6be6b12d7d7 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:37:17.500866 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:37:17.541189 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74850af4-7b4b-4919-ac91-3ce6d574057e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:37:17.541837 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74850af4-7b4b-4919-ac91-3ce6d574057e service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:17.542123 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74850af4-7b4b-4919-ac91-3ce6d574057e service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:17.542404 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74850af4-7b4b-4919-ac91-3ce6d574057e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:17.544070 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-74850af4-7b4b-4919-ac91-3ce6d574057e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:17.653014 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74850af4-7b4b-4919-ac91-3ce6d574057e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:37:17.654451 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74850af4-7b4b-4919-ac91-3ce6d574057e service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:37:17.672696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 713/1443] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:37:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:37:19.853305 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422902c-1a71-4d5f-b0a7-58108f542aa1 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:19.853867 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422902c-1a71-4d5f-b0a7-58108f542aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:19.853867 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422902c-1a71-4d5f-b0a7-58108f542aa1 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:19.855300 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 731/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 03:37:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:37:19.860509 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d08e1-f77b-4a5f-b6f0-e15facdacbbe None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:19.860940 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d08e1-f77b-4a5f-b6f0-e15facdacbbe None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:19.861099 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d08e1-f77b-4a5f-b6f0-e15facdacbbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:19.925763 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-2b4d08e1-f77b-4a5f-b6f0-e15facdacbbe None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:37:19.927004 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2b4d08e1-f77b-4a5f-b6f0-e15facdacbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:19.939767 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:37:20.024889 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 714/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 03:37:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:37:20.062059 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422902c-1a71-4d5f-b0a7-58108f542aa1 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:37:20.064158 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7422902c-1a71-4d5f-b0a7-58108f542aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:20.166001 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422902c-1a71-4d5f-b0a7-58108f542aa1 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:37:20.178563 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:37:20.239829 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a97e9c-6c1f-4602-90b1-205ad0c2ac4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:37:20.240494 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a97e9c-6c1f-4602-90b1-205ad0c2ac4b service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:20.240782 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a97e9c-6c1f-4602-90b1-205ad0c2ac4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:20.241060 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a97e9c-6c1f-4602-90b1-205ad0c2ac4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:20.242754 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f1a97e9c-6c1f-4602-90b1-205ad0c2ac4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:20.350501 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a97e9c-6c1f-4602-90b1-205ad0c2ac4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:37:20.351946 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a97e9c-6c1f-4602-90b1-205ad0c2ac4b service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:37:20.370145 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 732/1446] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:37:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:37:22.807098 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a39a5e-2209-4689-ab83-c1d491c517a8 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:22.807659 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a39a5e-2209-4689-ab83-c1d491c517a8 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:22.807659 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a39a5e-2209-4689-ab83-c1d491c517a8 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:22.809044 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 715/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 03:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:37:22.814332 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c0525-4875-47c2-b323-dad17a2cbed2 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:22.814785 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c0525-4875-47c2-b323-dad17a2cbed2 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:22.814922 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c0525-4875-47c2-b323-dad17a2cbed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:22.861602 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:37:22.879459 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-ce6c0525-4875-47c2-b323-dad17a2cbed2 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:37:22.880689 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ce6c0525-4875-47c2-b323-dad17a2cbed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:22.974963 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 733/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 03:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:37:23.014307 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a39a5e-2209-4689-ab83-c1d491c517a8 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:37:23.016548 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-65a39a5e-2209-4689-ab83-c1d491c517a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:23.119674 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a39a5e-2209-4689-ab83-c1d491c517a8 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:37:23.159997 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:37:23.193681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29773546-322c-4482-ba25-bf9c77c1110d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:37:23.194331 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29773546-322c-4482-ba25-bf9c77c1110d service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:23.194651 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29773546-322c-4482-ba25-bf9c77c1110d service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:23.194943 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29773546-322c-4482-ba25-bf9c77c1110d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:23.196595 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-29773546-322c-4482-ba25-bf9c77c1110d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:23.304003 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29773546-322c-4482-ba25-bf9c77c1110d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:37:23.305369 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29773546-322c-4482-ba25-bf9c77c1110d service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:37:23.323479 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 716/1449] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:37:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:37:25.460174 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2eadb-0dfb-4d82-8f64-d9caaa3b09a8 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:25.460745 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2eadb-0dfb-4d82-8f64-d9caaa3b09a8 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:25.460745 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2eadb-0dfb-4d82-8f64-d9caaa3b09a8 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:25.462116 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 734/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 03:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:37:25.468041 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b3952-b05d-4715-87d9-20e6f124c3de None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:25.468473 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b3952-b05d-4715-87d9-20e6f124c3de None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:25.468607 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b3952-b05d-4715-87d9-20e6f124c3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:25.533119 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-115b3952-b05d-4715-87d9-20e6f124c3de None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:37:25.534335 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-115b3952-b05d-4715-87d9-20e6f124c3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:25.555245 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:37:25.631447 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 717/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 03:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:37:25.670408 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba2eadb-0dfb-4d82-8f64-d9caaa3b09a8 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:37:25.672024 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5ba2eadb-0dfb-4d82-8f64-d9caaa3b09a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:25.790486 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba2eadb-0dfb-4d82-8f64-d9caaa3b09a8 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:37:25.812789 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:37:25.883566 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ce8f66-bebe-4f64-9626-a73359473d30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:37:25.884214 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce8f66-bebe-4f64-9626-a73359473d30 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:25.884519 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce8f66-bebe-4f64-9626-a73359473d30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:25.884933 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce8f66-bebe-4f64-9626-a73359473d30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:25.886443 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d1ce8f66-bebe-4f64-9626-a73359473d30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:25.992386 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ce8f66-bebe-4f64-9626-a73359473d30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:37:25.993738 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ce8f66-bebe-4f64-9626-a73359473d30 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:37:26.011057 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 735/1452] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:37:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:37:28.092084 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f379a5-2910-4e22-bbe8-a12f5f20a467 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:28.092645 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f379a5-2910-4e22-bbe8-a12f5f20a467 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:28.092645 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f379a5-2910-4e22-bbe8-a12f5f20a467 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:28.094045 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 718/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 03:37:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:37:28.099291 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713efce3-f7e1-46fb-801e-4acf78c44ec9 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:28.099711 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713efce3-f7e1-46fb-801e-4acf78c44ec9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:28.099866 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713efce3-f7e1-46fb-801e-4acf78c44ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:28.160796 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:37:28.163425 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-713efce3-f7e1-46fb-801e-4acf78c44ec9 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:37:28.165146 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-713efce3-f7e1-46fb-801e-4acf78c44ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:28.258741 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 736/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 03:37:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:37:28.298681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f379a5-2910-4e22-bbe8-a12f5f20a467 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:37:28.300210 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-22f379a5-2910-4e22-bbe8-a12f5f20a467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:28.401404 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f379a5-2910-4e22-bbe8-a12f5f20a467 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:37:28.449428 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:37:28.474350 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f568f10-4cc0-4be6-b364-dfeb41e5655d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:37:28.475044 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f568f10-4cc0-4be6-b364-dfeb41e5655d service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:28.475332 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f568f10-4cc0-4be6-b364-dfeb41e5655d service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:28.475611 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f568f10-4cc0-4be6-b364-dfeb41e5655d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:28.477257 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4f568f10-4cc0-4be6-b364-dfeb41e5655d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:28.584042 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f568f10-4cc0-4be6-b364-dfeb41e5655d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:37:28.585513 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f568f10-4cc0-4be6-b364-dfeb41e5655d service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:37:28.603334 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 719/1455] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:37:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:37:30.698245 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef494042-9598-436f-ad46-ba7426635465 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:30.698802 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef494042-9598-436f-ad46-ba7426635465 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:30.698928 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef494042-9598-436f-ad46-ba7426635465 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:30.700320 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 737/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 03:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:37:30.706646 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de770a00-8316-49eb-a13b-fd79ea264b3d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:30.707052 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de770a00-8316-49eb-a13b-fd79ea264b3d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:30.707221 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de770a00-8316-49eb-a13b-fd79ea264b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:30.771395 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-de770a00-8316-49eb-a13b-fd79ea264b3d None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:37:30.772586 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-de770a00-8316-49eb-a13b-fd79ea264b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:30.803060 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:37:30.875012 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 720/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 03:37:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:37:30.915200 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef494042-9598-436f-ad46-ba7426635465 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:37:30.916741 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ef494042-9598-436f-ad46-ba7426635465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:31.021212 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef494042-9598-436f-ad46-ba7426635465 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:37:31.051504 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:37:31.099695 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce009d6-006f-4ecc-b55b-0819d30a4d51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:37:31.100350 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce009d6-006f-4ecc-b55b-0819d30a4d51 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:31.100729 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce009d6-006f-4ecc-b55b-0819d30a4d51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:31.101047 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce009d6-006f-4ecc-b55b-0819d30a4d51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:31.103119 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-bce009d6-006f-4ecc-b55b-0819d30a4d51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:31.217918 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce009d6-006f-4ecc-b55b-0819d30a4d51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:37:31.220074 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce009d6-006f-4ecc-b55b-0819d30a4d51 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:37:31.242751 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 738/1458] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:37:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:37:33.369036 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443656b8-afd7-4e48-b327-2a348ba4f783 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:33.369563 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443656b8-afd7-4e48-b327-2a348ba4f783 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:33.369563 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443656b8-afd7-4e48-b327-2a348ba4f783 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:33.371059 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 721/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 03:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:37:33.377303 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40764354-d5d7-4256-8cf6-0cee49c5c8d6 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:33.377856 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40764354-d5d7-4256-8cf6-0cee49c5c8d6 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:33.378349 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40764354-d5d7-4256-8cf6-0cee49c5c8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:33.458543 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-40764354-d5d7-4256-8cf6-0cee49c5c8d6 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:37:33.459756 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-40764354-d5d7-4256-8cf6-0cee49c5c8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:33.467973 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:37:33.554610 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 739/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 03:37:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:37:33.593755 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443656b8-afd7-4e48-b327-2a348ba4f783 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:37:33.595369 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-443656b8-afd7-4e48-b327-2a348ba4f783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:33.699185 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443656b8-afd7-4e48-b327-2a348ba4f783 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:37:33.757974 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:37:33.778014 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f64913-68d2-422b-856c-28f9c6960505 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:37:33.778706 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f64913-68d2-422b-856c-28f9c6960505 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:33.778995 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f64913-68d2-422b-856c-28f9c6960505 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:33.779274 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f64913-68d2-422b-856c-28f9c6960505 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:33.780945 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-54f64913-68d2-422b-856c-28f9c6960505 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:33.890210 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f64913-68d2-422b-856c-28f9c6960505 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:37:33.892204 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f64913-68d2-422b-856c-28f9c6960505 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:37:33.910684 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 722/1461] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:37:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:37:35.969402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a0e6b-5b9b-42b0-9e63-5b536979f8d3 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:35.969933 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a0e6b-5b9b-42b0-9e63-5b536979f8d3 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:35.969933 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a0e6b-5b9b-42b0-9e63-5b536979f8d3 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:35.971327 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 740/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 03:37:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:37:35.976677 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d051fee-20de-4a3f-a597-cba2e8b9f534 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:35.977074 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d051fee-20de-4a3f-a597-cba2e8b9f534 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:35.977245 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d051fee-20de-4a3f-a597-cba2e8b9f534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:36.041870 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-4d051fee-20de-4a3f-a597-cba2e8b9f534 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:37:36.043155 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4d051fee-20de-4a3f-a597-cba2e8b9f534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:36.080905 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:37:36.140340 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 723/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 03:37:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:37:36.178309 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a0e6b-5b9b-42b0-9e63-5b536979f8d3 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:37:36.179854 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-551a0e6b-5b9b-42b0-9e63-5b536979f8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:36.280694 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a0e6b-5b9b-42b0-9e63-5b536979f8d3 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:37:36.317600 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:37:36.352808 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac9deb-bf1a-406f-a71f-2ade354217de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:37:36.353448 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac9deb-bf1a-406f-a71f-2ade354217de service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:36.353730 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac9deb-bf1a-406f-a71f-2ade354217de service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:36.354005 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac9deb-bf1a-406f-a71f-2ade354217de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:36.355763 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-97ac9deb-bf1a-406f-a71f-2ade354217de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:36.463545 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac9deb-bf1a-406f-a71f-2ade354217de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:37:36.464966 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac9deb-bf1a-406f-a71f-2ade354217de service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:37:36.482809 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 741/1464] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:37:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:37:38.524102 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920e826-30a3-428e-aedb-f7047c160f60 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:38.524668 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920e826-30a3-428e-aedb-f7047c160f60 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:38.524668 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920e826-30a3-428e-aedb-f7047c160f60 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:38.526328 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 724/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 03:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:37:38.532137 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c074f5-10d5-4a24-9568-f92b21c4b422 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:38.532580 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c074f5-10d5-4a24-9568-f92b21c4b422 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:38.532714 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c074f5-10d5-4a24-9568-f92b21c4b422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:38.594987 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-26c074f5-10d5-4a24-9568-f92b21c4b422 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:37:38.596174 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-26c074f5-10d5-4a24-9568-f92b21c4b422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:38.613340 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:37:38.689315 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 742/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 03:37:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:37:38.727588 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c920e826-30a3-428e-aedb-f7047c160f60 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:37:38.729161 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c920e826-30a3-428e-aedb-f7047c160f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:38.830622 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c920e826-30a3-428e-aedb-f7047c160f60 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:37:38.896107 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:37:38.903620 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f957c1a-3a0f-439e-81d9-1d984b7c207a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:37:38.904266 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f957c1a-3a0f-439e-81d9-1d984b7c207a service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:38.904548 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f957c1a-3a0f-439e-81d9-1d984b7c207a service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:38.904821 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f957c1a-3a0f-439e-81d9-1d984b7c207a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:38.906483 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6f957c1a-3a0f-439e-81d9-1d984b7c207a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:39.013679 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f957c1a-3a0f-439e-81d9-1d984b7c207a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:37:39.015151 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f957c1a-3a0f-439e-81d9-1d984b7c207a service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:37:39.033977 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 725/1467] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:37:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:37:41.114858 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c82298-b045-48f1-ba0a-415495a5214e None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:41.115439 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c82298-b045-48f1-ba0a-415495a5214e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:41.115439 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c82298-b045-48f1-ba0a-415495a5214e None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:41.116794 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 743/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 03:37:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:37:41.122045 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d1c68-06aa-4b85-8acc-3fc19493898b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:41.122520 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d1c68-06aa-4b85-8acc-3fc19493898b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:41.122703 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d1c68-06aa-4b85-8acc-3fc19493898b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:41.186543 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-fb8d1c68-06aa-4b85-8acc-3fc19493898b None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:37:41.188208 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fb8d1c68-06aa-4b85-8acc-3fc19493898b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:41.234331 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:37:41.283094 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 726/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 03:37:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:37:41.320529 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c82298-b045-48f1-ba0a-415495a5214e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:37:41.322057 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-98c82298-b045-48f1-ba0a-415495a5214e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:41.425505 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c82298-b045-48f1-ba0a-415495a5214e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:37:41.475749 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:37:41.501991 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ef341-b4eb-4574-93cc-07dc92809ea7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:37:41.502829 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ef341-b4eb-4574-93cc-07dc92809ea7 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:37:41.503122 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ef341-b4eb-4574-93cc-07dc92809ea7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:37:41.503464 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ef341-b4eb-4574-93cc-07dc92809ea7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:37:41.505161 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-221ef341-b4eb-4574-93cc-07dc92809ea7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:37:41.617515 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ef341-b4eb-4574-93cc-07dc92809ea7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:37:41.619011 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ef341-b4eb-4574-93cc-07dc92809ea7 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:37:41.637210 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 744/1470] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:37:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:37:51.281262 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=22 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:37:51.634811 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=66 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:38:01.376563 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebc6dc-ba90-4890-81ad-3e72efc3f314 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:38:01.377138 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebc6dc-ba90-4890-81ad-3e72efc3f314 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:38:01.377138 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ebc6dc-ba90-4890-81ad-3e72efc3f314 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:38:01.378531 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 727/1471] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:38:01.383726 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74af94-fee4-49ed-9779-90090aa7b9ab None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:38:01.384140 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74af94-fee4-49ed-9779-90090aa7b9ab None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:38:01.384283 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74af94-fee4-49ed-9779-90090aa7b9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:38:01.449270 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-3e74af94-fee4-49ed-9779-90090aa7b9ab None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:38:01.450508 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3e74af94-fee4-49ed-9779-90090aa7b9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:38:01.545735 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 745/1472] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:38:01.628840 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c7f5e5-51b5-4ff1-af65-9dc9391142fd None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:38:01.629070 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c7f5e5-51b5-4ff1-af65-9dc9391142fd None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:38:01.629347 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c7f5e5-51b5-4ff1-af65-9dc9391142fd None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:38:01.630748 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 728/1473] 10.222.0.20 () {54 vars in 966 bytes} [Thu Jul 21 03:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:38:01.635569 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3249f-ef64-4f2d-9392-d535c50563f1 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:38:01.635864 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3249f-ef64-4f2d-9392-d535c50563f1 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:38:01.636145 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3249f-ef64-4f2d-9392-d535c50563f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:38:01.710396 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-12b3249f-ef64-4f2d-9392-d535c50563f1 None None] MFA Rules not processed for user `a567cddc98164bd39317a245626d0f5d`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:38:01.711643 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-12b3249f-ef64-4f2d-9392-d535c50563f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:38:01.732673 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:38:01.787226 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 746/1474] 10.222.0.20 () {58 vars in 1063 bytes} [Thu Jul 21 03:38:01 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:38:01.794833 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c7f5e5-51b5-4ff1-af65-9dc9391142fd None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:38:01.796342 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e4c7f5e5-51b5-4ff1-af65-9dc9391142fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:38:01.901365 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c7f5e5-51b5-4ff1-af65-9dc9391142fd None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:38:01.973579 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88daeed2-033c-4768-9c3a-f4ee1abcd7bc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a567cddc98164bd39317a245626d0f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:38:01.974227 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88daeed2-033c-4768-9c3a-f4ee1abcd7bc service glance] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:38:01.974541 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88daeed2-033c-4768-9c3a-f4ee1abcd7bc service glance] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:38:01.974826 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88daeed2-033c-4768-9c3a-f4ee1abcd7bc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:38:01.976477 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-88daeed2-033c-4768-9c3a-f4ee1abcd7bc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:38:02.030884 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:38:02.086743 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88daeed2-033c-4768-9c3a-f4ee1abcd7bc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:38:02.088191 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88daeed2-033c-4768-9c3a-f4ee1abcd7bc service glance] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:38:02.106320 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 729/1475] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:38:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:38:04.187374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b72f10-623e-4ce7-aba8-19fea881cac0 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:38:04.187935 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b72f10-623e-4ce7-aba8-19fea881cac0 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:38:04.187935 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b72f10-623e-4ce7-aba8-19fea881cac0 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:38:04.189308 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 747/1476] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:38:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:38:04.195009 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74417269-57f8-4b80-87c8-0aaa1c1a7236 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:38:04.195435 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74417269-57f8-4b80-87c8-0aaa1c1a7236 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:38:04.195565 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74417269-57f8-4b80-87c8-0aaa1c1a7236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:38:04.258773 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-74417269-57f8-4b80-87c8-0aaa1c1a7236 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:38:04.259976 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-74417269-57f8-4b80-87c8-0aaa1c1a7236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:38:04.353727 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 730/1477] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:38:04.377825 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b72f10-623e-4ce7-aba8-19fea881cac0 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:38:04.379373 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e7b72f10-623e-4ce7-aba8-19fea881cac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:38:04.502478 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b72f10-623e-4ce7-aba8-19fea881cac0 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:38:04.551663 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:38:04.595520 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a11fb1-1edf-4a23-b232-7bed62fcc1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:38:04.596186 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a11fb1-1edf-4a23-b232-7bed62fcc1fd admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:38:04.596475 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a11fb1-1edf-4a23-b232-7bed62fcc1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:38:04.596756 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a11fb1-1edf-4a23-b232-7bed62fcc1fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:38:04.597492 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a11fb1-1edf-4a23-b232-7bed62fcc1fd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:38:04.599316 dv-cinder-850318-2-smb devstack@keystone.service[80332]: WARNING py.warnings [None req-54a11fb1-1edf-4a23-b232-7bed62fcc1fd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 03:38:04.599316 dv-cinder-850318-2-smb devstack@keystone.service[80332]: warnings.warn(msg) Jul 21 03:38:04.599316 dv-cinder-850318-2-smb devstack@keystone.service[80332]: Jul 21 03:38:04.600488 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a11fb1-1edf-4a23-b232-7bed62fcc1fd admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:38:04.621634 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 748/1478] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jul 21 03:38:04 2022] GET /identity/v3/projects => generated 2553 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:38:06.657082 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71143dfa-9a2b-4796-9194-b208f1516aae None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:38:06.657649 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71143dfa-9a2b-4796-9194-b208f1516aae None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:38:06.657649 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71143dfa-9a2b-4796-9194-b208f1516aae None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:38:06.659523 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 731/1479] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:38:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:38:06.664716 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3494f-f614-4896-8fb7-83a115ad7f59 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:38:06.665146 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3494f-f614-4896-8fb7-83a115ad7f59 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:38:06.665273 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a3494f-f614-4896-8fb7-83a115ad7f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:38:06.728699 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-58a3494f-f614-4896-8fb7-83a115ad7f59 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:38:06.729905 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-58a3494f-f614-4896-8fb7-83a115ad7f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:38:06.824403 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 749/1480] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:38:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:38:06.868327 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71143dfa-9a2b-4796-9194-b208f1516aae None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:38:06.869917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-71143dfa-9a2b-4796-9194-b208f1516aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:38:06.879756 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:38:07.014207 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71143dfa-9a2b-4796-9194-b208f1516aae None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:38:07.092000 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:38:07.126629 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8034d1-83d1-43da-8488-662b5acc5ccb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:38:07.127315 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8034d1-83d1-43da-8488-662b5acc5ccb service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:38:07.127604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8034d1-83d1-43da-8488-662b5acc5ccb service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:38:07.127879 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8034d1-83d1-43da-8488-662b5acc5ccb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:38:07.129535 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-df8034d1-83d1-43da-8488-662b5acc5ccb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:38:07.218759 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8034d1-83d1-43da-8488-662b5acc5ccb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:38:07.220357 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8034d1-83d1-43da-8488-662b5acc5ccb service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:38:07.237859 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 732/1481] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:38:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:38:09.408066 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3986e12-18bd-4afc-9aca-a44437a9a4e2 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:38:09.408654 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3986e12-18bd-4afc-9aca-a44437a9a4e2 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:38:09.408654 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3986e12-18bd-4afc-9aca-a44437a9a4e2 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:38:09.410076 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 750/1482] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:38:09.415422 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561bb8a-c038-41d6-80e1-4aad311e7fc2 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:38:09.415826 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561bb8a-c038-41d6-80e1-4aad311e7fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:38:09.415988 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3561bb8a-c038-41d6-80e1-4aad311e7fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:38:09.480617 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-3561bb8a-c038-41d6-80e1-4aad311e7fc2 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:38:09.481820 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3561bb8a-c038-41d6-80e1-4aad311e7fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:38:09.527105 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:38:09.577785 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 733/1483] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:38:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:38:09.615310 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3986e12-18bd-4afc-9aca-a44437a9a4e2 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:38:09.616838 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a3986e12-18bd-4afc-9aca-a44437a9a4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:38:09.640291 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:38:09.720120 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3986e12-18bd-4afc-9aca-a44437a9a4e2 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:38:09.792415 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3631796-1f02-4f95-a6f6-4a683a0ea918 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:38:09.793066 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3631796-1f02-4f95-a6f6-4a683a0ea918 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:38:09.793357 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3631796-1f02-4f95-a6f6-4a683a0ea918 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:38:09.793637 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3631796-1f02-4f95-a6f6-4a683a0ea918 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:38:09.795339 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f3631796-1f02-4f95-a6f6-4a683a0ea918 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:38:09.869107 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:38:09.904084 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3631796-1f02-4f95-a6f6-4a683a0ea918 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:38:09.905511 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3631796-1f02-4f95-a6f6-4a683a0ea918 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:38:09.924159 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 751/1484] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:38:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:38:11.992010 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ddd08a-6a8e-438d-9791-a11a7110b84a None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:38:11.992635 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ddd08a-6a8e-438d-9791-a11a7110b84a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:38:11.992635 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ddd08a-6a8e-438d-9791-a11a7110b84a None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:38:11.993938 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 734/1485] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:38:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:38:11.999840 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f6ad8-9087-4393-aa0f-08ccd6822c99 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:38:12.000288 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f6ad8-9087-4393-aa0f-08ccd6822c99 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:38:12.000413 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44f6ad8-9087-4393-aa0f-08ccd6822c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:38:12.184329 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d44f6ad8-9087-4393-aa0f-08ccd6822c99 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:38:12.185559 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d44f6ad8-9087-4393-aa0f-08ccd6822c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:38:12.279323 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 752/1486] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:38:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:38:12.317994 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ddd08a-6a8e-438d-9791-a11a7110b84a None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:38:12.319562 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-55ddd08a-6a8e-438d-9791-a11a7110b84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:38:12.421647 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ddd08a-6a8e-438d-9791-a11a7110b84a None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:38:12.494524 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:38:12.496357 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa1849-2966-4a20-a173-ebfc59c18231 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:38:12.497011 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa1849-2966-4a20-a173-ebfc59c18231 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:38:12.497374 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa1849-2966-4a20-a173-ebfc59c18231 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:38:12.497650 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa1849-2966-4a20-a173-ebfc59c18231 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:38:12.499327 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d7aa1849-2966-4a20-a173-ebfc59c18231 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:38:12.606157 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa1849-2966-4a20-a173-ebfc59c18231 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:38:12.607627 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa1849-2966-4a20-a173-ebfc59c18231 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:38:12.626031 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 735/1487] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:38:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:38:14.746901 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12212b-1434-40c0-bac6-dd74662d9393 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:38:14.747446 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12212b-1434-40c0-bac6-dd74662d9393 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:38:14.747446 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12212b-1434-40c0-bac6-dd74662d9393 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:38:14.748841 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 753/1488] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:38:14.754578 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc918b-f0f5-4ca4-877c-5cd41272698e None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:38:14.755012 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc918b-f0f5-4ca4-877c-5cd41272698e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:38:14.755120 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dc918b-f0f5-4ca4-877c-5cd41272698e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:38:14.819309 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-90dc918b-f0f5-4ca4-877c-5cd41272698e None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:38:14.820523 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-90dc918b-f0f5-4ca4-877c-5cd41272698e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:38:14.875175 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:38:14.925030 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 736/1489] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:38:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:38:14.966236 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f12212b-1434-40c0-bac6-dd74662d9393 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:38:14.967768 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9f12212b-1434-40c0-bac6-dd74662d9393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:38:15.004242 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:38:15.072706 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f12212b-1434-40c0-bac6-dd74662d9393 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:38:15.144034 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d3505-a75b-4f0f-829a-060711d2507f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:38:15.144686 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d3505-a75b-4f0f-829a-060711d2507f service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:38:15.144969 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d3505-a75b-4f0f-829a-060711d2507f service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:38:15.145242 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d3505-a75b-4f0f-829a-060711d2507f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:38:15.146910 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-986d3505-a75b-4f0f-829a-060711d2507f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:38:15.223840 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:38:15.253605 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d3505-a75b-4f0f-829a-060711d2507f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:38:15.255061 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986d3505-a75b-4f0f-829a-060711d2507f service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:38:15.272467 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 754/1490] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:38:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:38:17.516846 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a761503-aa7b-4186-a351-62cd3322ee0e None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:38:17.517433 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a761503-aa7b-4186-a351-62cd3322ee0e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:38:17.517433 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a761503-aa7b-4186-a351-62cd3322ee0e None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:38:17.518844 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 737/1491] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jul 21 03:38:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:38:17.523971 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05719bbb-3e4c-45a7-ae0d-031a1a391170 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:38:17.524415 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05719bbb-3e4c-45a7-ae0d-031a1a391170 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:38:17.524533 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05719bbb-3e4c-45a7-ae0d-031a1a391170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:38:17.589175 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-05719bbb-3e4c-45a7-ae0d-031a1a391170 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:38:17.590398 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-05719bbb-3e4c-45a7-ae0d-031a1a391170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:38:17.684294 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 755/1492] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jul 21 03:38:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:38:17.723829 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a761503-aa7b-4186-a351-62cd3322ee0e None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:38:17.725348 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1a761503-aa7b-4186-a351-62cd3322ee0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:38:17.828504 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a761503-aa7b-4186-a351-62cd3322ee0e None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:38:17.900073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d59d6b-ff3f-4d75-96b8-9fa36bcf346d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:38:17.900730 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d59d6b-ff3f-4d75-96b8-9fa36bcf346d service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:38:17.901260 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d59d6b-ff3f-4d75-96b8-9fa36bcf346d service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:38:17.901540 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d59d6b-ff3f-4d75-96b8-9fa36bcf346d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:38:17.903214 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-72d59d6b-ff3f-4d75-96b8-9fa36bcf346d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:38:17.912714 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:38:18.010696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d59d6b-ff3f-4d75-96b8-9fa36bcf346d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:38:18.012140 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d59d6b-ff3f-4d75-96b8-9fa36bcf346d service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:38:18.029712 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 738/1493] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:38:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:38:27.682446 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=82 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:38:28.027524 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=50 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:39:49.603150 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175bfc1-e325-4f4c-9258-2123fd1e632d None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:39:49.603757 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175bfc1-e325-4f4c-9258-2123fd1e632d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:39:49.603757 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1175bfc1-e325-4f4c-9258-2123fd1e632d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:39:49.676454 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-1175bfc1-e325-4f4c-9258-2123fd1e632d None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:39:49.677651 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1175bfc1-e325-4f4c-9258-2123fd1e632d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:39:49.772793 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 756/1494] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:39:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:39:49.781064 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99afc1d-f241-4b1f-8baa-bcbeb74abc06 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:39:49.781602 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99afc1d-f241-4b1f-8baa-bcbeb74abc06 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:39:49.781602 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99afc1d-f241-4b1f-8baa-bcbeb74abc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:39:49.857433 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c99afc1d-f241-4b1f-8baa-bcbeb74abc06 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:39:49.858680 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c99afc1d-f241-4b1f-8baa-bcbeb74abc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:39:49.954933 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 739/1495] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:39:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:39:49.959620 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175bfc1-e325-4f4c-9258-2123fd1e632d None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:39:49.960816 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1175bfc1-e325-4f4c-9258-2123fd1e632d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:39:49.972017 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1175bfc1-e325-4f4c-9258-2123fd1e632d None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:39:50.031984 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:39:50.066330 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb12f0-3624-41ca-9eb1-81edef1dd848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:39:50.067023 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb12f0-3624-41ca-9eb1-81edef1dd848 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:39:50.067307 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb12f0-3624-41ca-9eb1-81edef1dd848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:39:50.067583 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb12f0-3624-41ca-9eb1-81edef1dd848 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:39:50.068306 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb12f0-3624-41ca-9eb1-81edef1dd848 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:39:50.068612 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb12f0-3624-41ca-9eb1-81edef1dd848 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:39:50.069619 dv-cinder-850318-2-smb devstack@keystone.service[80332]: WARNING py.warnings [None req-9ccb12f0-3624-41ca-9eb1-81edef1dd848 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 03:39:50.069619 dv-cinder-850318-2-smb devstack@keystone.service[80332]: warnings.warn(msg) Jul 21 03:39:50.069619 dv-cinder-850318-2-smb devstack@keystone.service[80332]: Jul 21 03:39:50.070521 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb12f0-3624-41ca-9eb1-81edef1dd848 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:39:50.081448 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 757/1496] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:39:50.089649 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99afc1d-f241-4b1f-8baa-bcbeb74abc06 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:39:50.099303 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99afc1d-f241-4b1f-8baa-bcbeb74abc06 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:39:50.160304 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:39:50.194093 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de5915-23d7-401a-b85f-86fff1eb7341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:39:50.194779 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de5915-23d7-401a-b85f-86fff1eb7341 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:39:50.195061 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de5915-23d7-401a-b85f-86fff1eb7341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:39:50.195332 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21de5915-23d7-401a-b85f-86fff1eb7341 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:39:50.196022 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de5915-23d7-401a-b85f-86fff1eb7341 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:39:50.197800 dv-cinder-850318-2-smb devstack@keystone.service[80331]: WARNING py.warnings [None req-21de5915-23d7-401a-b85f-86fff1eb7341 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 03:39:50.197800 dv-cinder-850318-2-smb devstack@keystone.service[80331]: warnings.warn(msg) Jul 21 03:39:50.197800 dv-cinder-850318-2-smb devstack@keystone.service[80331]: Jul 21 03:39:50.199007 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21de5915-23d7-401a-b85f-86fff1eb7341 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:39:50.253010 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 740/1497] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:39:50 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:39:50.257232 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb12f0-3624-41ca-9eb1-81edef1dd848 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:39:50.258781 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9ccb12f0-3624-41ca-9eb1-81edef1dd848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:39:50.292147 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb12f0-3624-41ca-9eb1-81edef1dd848 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:39:50.383873 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a6ea2-3fda-4b54-ab77-49fa22b13a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:39:50.384539 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a6ea2-3fda-4b54-ab77-49fa22b13a58 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:39:50.384847 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a6ea2-3fda-4b54-ab77-49fa22b13a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:39:50.385108 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a6ea2-3fda-4b54-ab77-49fa22b13a58 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:39:50.385794 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367a6ea2-3fda-4b54-ab77-49fa22b13a58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:39:50.386832 dv-cinder-850318-2-smb devstack@keystone.service[80332]: WARNING py.warnings [None req-367a6ea2-3fda-4b54-ab77-49fa22b13a58 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 03:39:50.386832 dv-cinder-850318-2-smb devstack@keystone.service[80332]: warnings.warn(msg) Jul 21 03:39:50.386832 dv-cinder-850318-2-smb devstack@keystone.service[80332]: Jul 21 03:39:50.388037 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367a6ea2-3fda-4b54-ab77-49fa22b13a58 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:39:50.427759 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 758/1498] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:39:50 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:39:50.431772 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de5915-23d7-401a-b85f-86fff1eb7341 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:39:50.433332 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-21de5915-23d7-401a-b85f-86fff1eb7341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:39:50.494152 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21de5915-23d7-401a-b85f-86fff1eb7341 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:39:50.575181 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:39:50.586639 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dede41-e51c-4d49-bd24-d702851d9ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:39:50.587307 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dede41-e51c-4d49-bd24-d702851d9ffe admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:39:50.587588 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dede41-e51c-4d49-bd24-d702851d9ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:39:50.587864 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dede41-e51c-4d49-bd24-d702851d9ffe admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:39:50.588586 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dede41-e51c-4d49-bd24-d702851d9ffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:39:50.589608 dv-cinder-850318-2-smb devstack@keystone.service[80331]: WARNING py.warnings [None req-b6dede41-e51c-4d49-bd24-d702851d9ffe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 03:39:50.589608 dv-cinder-850318-2-smb devstack@keystone.service[80331]: warnings.warn(msg) Jul 21 03:39:50.589608 dv-cinder-850318-2-smb devstack@keystone.service[80331]: Jul 21 03:39:50.590499 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dede41-e51c-4d49-bd24-d702851d9ffe admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:39:50.603012 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 741/1499] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:39:50.607024 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a6ea2-3fda-4b54-ab77-49fa22b13a58 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:39:50.608543 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-367a6ea2-3fda-4b54-ab77-49fa22b13a58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:39:50.619865 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a6ea2-3fda-4b54-ab77-49fa22b13a58 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:39:50.645392 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:39:50.713913 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b565d4-9f7b-4920-b5b6-af89f2740a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:39:50.714607 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b565d4-9f7b-4920-b5b6-af89f2740a5f admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:39:50.714889 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b565d4-9f7b-4920-b5b6-af89f2740a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:39:50.715164 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b565d4-9f7b-4920-b5b6-af89f2740a5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:39:50.715917 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b565d4-9f7b-4920-b5b6-af89f2740a5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:39:50.716918 dv-cinder-850318-2-smb devstack@keystone.service[80332]: WARNING py.warnings [None req-a9b565d4-9f7b-4920-b5b6-af89f2740a5f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 03:39:50.716918 dv-cinder-850318-2-smb devstack@keystone.service[80332]: warnings.warn(msg) Jul 21 03:39:50.716918 dv-cinder-850318-2-smb devstack@keystone.service[80332]: Jul 21 03:39:50.717792 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b565d4-9f7b-4920-b5b6-af89f2740a5f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:39:50.729906 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 759/1500] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:39:50.734186 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dede41-e51c-4d49-bd24-d702851d9ffe admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:39:50.735716 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b6dede41-e51c-4d49-bd24-d702851d9ffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:39:50.768691 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dede41-e51c-4d49-bd24-d702851d9ffe admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:39:50.862046 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979c8fbc-00f6-4b00-9024-fbded1c896b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:39:50.862986 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c8fbc-00f6-4b00-9024-fbded1c896b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:39:50.863264 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c8fbc-00f6-4b00-9024-fbded1c896b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:39:50.863534 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979c8fbc-00f6-4b00-9024-fbded1c896b8 admin admin] PATH_INFO: `/v3/projects/18c966d79d4a4385a8a6baa2c5dc10f3/users/fbcea21aae184f6fb0a99f20e8b47a88/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:39:50.885545 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c8fbc-00f6-4b00-9024-fbded1c896b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18c966d79d4a4385a8a6baa2c5dc10f3, user_id=fbcea21aae184f6fb0a99f20e8b47a88, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:39:50.886645 dv-cinder-850318-2-smb devstack@keystone.service[80331]: WARNING py.warnings [None req-979c8fbc-00f6-4b00-9024-fbded1c896b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 03:39:50.886645 dv-cinder-850318-2-smb devstack@keystone.service[80331]: warnings.warn(msg) Jul 21 03:39:50.886645 dv-cinder-850318-2-smb devstack@keystone.service[80331]: Jul 21 03:39:50.888619 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979c8fbc-00f6-4b00-9024-fbded1c896b8 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:39:50.917405 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 742/1501] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:39:50 2022] PUT /identity/v3/projects/18c966d79d4a4385a8a6baa2c5dc10f3/users/fbcea21aae184f6fb0a99f20e8b47a88/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:39:50.929960 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca9c9b-e6fe-4e56-9520-b78e4077b4dd None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:39:50.930250 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca9c9b-e6fe-4e56-9520-b78e4077b4dd None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:39:50.930573 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca9c9b-e6fe-4e56-9520-b78e4077b4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:39:50.992442 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-52ca9c9b-e6fe-4e56-9520-b78e4077b4dd None None] MFA Rules not processed for user `fbcea21aae184f6fb0a99f20e8b47a88`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:39:50.993675 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-52ca9c9b-e6fe-4e56-9520-b78e4077b4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:39:51.071107 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 760/1502] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:39:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:39:51.084317 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b96b4b-cc82-4bc9-b8fb-7cbf4a298ca6 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:39:51.084616 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b96b4b-cc82-4bc9-b8fb-7cbf4a298ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:39:51.084903 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b96b4b-cc82-4bc9-b8fb-7cbf4a298ca6 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:39:51.086274 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 743/1503] 10.222.0.20 () {54 vars in 964 bytes} [Thu Jul 21 03:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:39:51.090914 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83fb11-b737-480f-8fb0-da0d81b5fc05 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:39:51.091201 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83fb11-b737-480f-8fb0-da0d81b5fc05 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:39:51.091476 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83fb11-b737-480f-8fb0-da0d81b5fc05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:39:51.120222 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:39:51.163948 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-3d83fb11-b737-480f-8fb0-da0d81b5fc05 None None] MFA Rules not processed for user `03f2ad420185421c97d5bc06be965bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:39:51.165153 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3d83fb11-b737-480f-8fb0-da0d81b5fc05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:39:51.239959 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 761/1504] 10.222.0.20 () {58 vars in 1061 bytes} [Thu Jul 21 03:39:51 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:39:51.247673 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b96b4b-cc82-4bc9-b8fb-7cbf4a298ca6 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:39:51.249209 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e6b96b4b-cc82-4bc9-b8fb-7cbf4a298ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:39:51.298715 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:39:51.353478 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b96b4b-cc82-4bc9-b8fb-7cbf4a298ca6 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:39:51.430568 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7845d-138c-4066-8867-2a713302475a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:39:51.431247 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7845d-138c-4066-8867-2a713302475a service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:39:51.431533 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7845d-138c-4066-8867-2a713302475a service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:39:51.431808 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7845d-138c-4066-8867-2a713302475a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:39:51.433462 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b1e7845d-138c-4066-8867-2a713302475a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:39:51.533680 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e7845d-138c-4066-8867-2a713302475a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:39:51.535634 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e7845d-138c-4066-8867-2a713302475a service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:39:51.539120 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:39:51.554416 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 744/1505] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:39:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:39:51.594858 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ff954-ed55-4b1a-affb-b9541c78a3f7 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:39:51.595149 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ff954-ed55-4b1a-affb-b9541c78a3f7 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:39:51.595429 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ff954-ed55-4b1a-affb-b9541c78a3f7 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:39:51.596722 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 762/1506] 10.222.0.20 () {52 vars in 829 bytes} [Thu Jul 21 03:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:39:51.600669 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7845d-138c-4066-8867-2a713302475a service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:39:51.601896 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b1e7845d-138c-4066-8867-2a713302475a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:39:51.699801 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7845d-138c-4066-8867-2a713302475a service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:39:51.794715 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f0d2e-f6bc-44b4-935a-fde188d766bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:39:51.795619 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f0d2e-f6bc-44b4-935a-fde188d766bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:39:51.795911 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f0d2e-f6bc-44b4-935a-fde188d766bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:39:51.796191 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06f0d2e-f6bc-44b4-935a-fde188d766bd admin admin] PATH_INFO: `/v3/users/fbcea21aae184f6fb0a99f20e8b47a88` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:39:51.808317 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f0d2e-f6bc-44b4-935a-fde188d766bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbcea21aae184f6fb0a99f20e8b47a88)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:39:51.809372 dv-cinder-850318-2-smb devstack@keystone.service[80331]: WARNING py.warnings [None req-a06f0d2e-f6bc-44b4-935a-fde188d766bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 03:39:51.809372 dv-cinder-850318-2-smb devstack@keystone.service[80331]: warnings.warn(msg) Jul 21 03:39:51.809372 dv-cinder-850318-2-smb devstack@keystone.service[80331]: Jul 21 03:39:51.810620 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06f0d2e-f6bc-44b4-935a-fde188d766bd admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:39:51.821401 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:39:51.880503 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a06f0d2e-f6bc-44b4-935a-fde188d766bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbcea21aae184f6fb0a99f20e8b47a88'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:39:51.881148 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a06f0d2e-f6bc-44b4-935a-fde188d766bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbcea21aae184f6fb0a99f20e8b47a88'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:39:51.881457 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a06f0d2e-f6bc-44b4-935a-fde188d766bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbcea21aae184f6fb0a99f20e8b47a88'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:39:51.893536 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a06f0d2e-f6bc-44b4-935a-fde188d766bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbcea21aae184f6fb0a99f20e8b47a88'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:39:51.903074 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a06f0d2e-f6bc-44b4-935a-fde188d766bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbcea21aae184f6fb0a99f20e8b47a88'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:39:51.926917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 745/1507] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:39:51 2022] DELETE /identity/v3/users/fbcea21aae184f6fb0a99f20e8b47a88 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:39:51.931854 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4b43e-b3a2-428f-9d72-0bb8616fa329 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:39:51.932293 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4b43e-b3a2-428f-9d72-0bb8616fa329 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:39:51.932478 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4b43e-b3a2-428f-9d72-0bb8616fa329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:39:51.986999 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-9aa4b43e-b3a2-428f-9d72-0bb8616fa329 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:39:51.988232 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9aa4b43e-b3a2-428f-9d72-0bb8616fa329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:39:52.061963 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:39:52.075413 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 763/1508] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:39:52.085314 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f0d2e-f6bc-44b4-935a-fde188d766bd admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:39:52.086572 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a06f0d2e-f6bc-44b4-935a-fde188d766bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:39:52.183483 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06f0d2e-f6bc-44b4-935a-fde188d766bd admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:39:52.236224 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:39:52.257185 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d48020-75a5-4e34-9523-41a11c6f93cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:39:52.257829 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d48020-75a5-4e34-9523-41a11c6f93cd service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:39:52.258109 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d48020-75a5-4e34-9523-41a11c6f93cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:39:52.258382 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d48020-75a5-4e34-9523-41a11c6f93cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:39:52.260046 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-30d48020-75a5-4e34-9523-41a11c6f93cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:39:52.365715 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d48020-75a5-4e34-9523-41a11c6f93cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:39:52.367195 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d48020-75a5-4e34-9523-41a11c6f93cd service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:39:52.385625 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 746/1509] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:39:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:39:52.736820 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa4b43e-b3a2-428f-9d72-0bb8616fa329 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:39:52.738316 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9aa4b43e-b3a2-428f-9d72-0bb8616fa329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:39:52.750143 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa4b43e-b3a2-428f-9d72-0bb8616fa329 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:39:52.852349 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9d5a4-a5fd-49d5-978f-d8ad6f939c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:39:52.853207 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9d5a4-a5fd-49d5-978f-d8ad6f939c24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:39:52.853489 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9d5a4-a5fd-49d5-978f-d8ad6f939c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:39:52.853763 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9d5a4-a5fd-49d5-978f-d8ad6f939c24 admin admin] PATH_INFO: `/v3/projects/18c966d79d4a4385a8a6baa2c5dc10f3` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:39:52.863622 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef9d5a4-a5fd-49d5-978f-d8ad6f939c24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18c966d79d4a4385a8a6baa2c5dc10f3)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:39:52.864643 dv-cinder-850318-2-smb devstack@keystone.service[80332]: WARNING py.warnings [None req-2ef9d5a4-a5fd-49d5-978f-d8ad6f939c24 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 03:39:52.864643 dv-cinder-850318-2-smb devstack@keystone.service[80332]: warnings.warn(msg) Jul 21 03:39:52.864643 dv-cinder-850318-2-smb devstack@keystone.service[80332]: Jul 21 03:39:52.865840 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef9d5a4-a5fd-49d5-978f-d8ad6f939c24 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:39:52.923883 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2ef9d5a4-a5fd-49d5-978f-d8ad6f939c24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18c966d79d4a4385a8a6baa2c5dc10f3', 'request_id': 'req-2ef9d5a4-a5fd-49d5-978f-d8ad6f939c24'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:39:52.936577 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2ef9d5a4-a5fd-49d5-978f-d8ad6f939c24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18c966d79d4a4385a8a6baa2c5dc10f3', 'request_id': 'req-2ef9d5a4-a5fd-49d5-978f-d8ad6f939c24'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:39:52.946508 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2ef9d5a4-a5fd-49d5-978f-d8ad6f939c24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18c966d79d4a4385a8a6baa2c5dc10f3', 'request_id': 'req-2ef9d5a4-a5fd-49d5-978f-d8ad6f939c24'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:39:52.970393 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2ef9d5a4-a5fd-49d5-978f-d8ad6f939c24 admin admin] The token cache is being invalidate because project 18c966d79d4a4385a8a6baa2c5dc10f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:39:52.970694 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2ef9d5a4-a5fd-49d5-978f-d8ad6f939c24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:39:52.971121 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2ef9d5a4-a5fd-49d5-978f-d8ad6f939c24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:39:52.972556 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 764/1510] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:39:52 2022] DELETE /identity/v3/projects/18c966d79d4a4385a8a6baa2c5dc10f3 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:40:02.383347 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=62 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:40:02.968480 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:41:35.759491 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755f71d-d0b4-4a26-b7b8-b2a3a7ddb998 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:41:35.760064 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755f71d-d0b4-4a26-b7b8-b2a3a7ddb998 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:41:35.760064 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755f71d-d0b4-4a26-b7b8-b2a3a7ddb998 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:41:35.761502 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 747/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 03:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:41:35.766245 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02caf7cd-0134-437f-8ec0-66e83bd2294e None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:41:35.766745 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02caf7cd-0134-437f-8ec0-66e83bd2294e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:41:35.766853 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02caf7cd-0134-437f-8ec0-66e83bd2294e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:41:35.849217 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-02caf7cd-0134-437f-8ec0-66e83bd2294e None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:41:35.850572 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-02caf7cd-0134-437f-8ec0-66e83bd2294e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:41:35.950976 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 765/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 03:41:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:41:36.104384 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755f71d-d0b4-4a26-b7b8-b2a3a7ddb998 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:41:36.106517 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c755f71d-d0b4-4a26-b7b8-b2a3a7ddb998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:41:36.345660 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755f71d-d0b4-4a26-b7b8-b2a3a7ddb998 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:41:36.351062 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e8e7c-b1a6-4ff3-9a02-b268fa8cfbf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:41:36.351649 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e8e7c-b1a6-4ff3-9a02-b268fa8cfbf6 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:41:36.351932 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e8e7c-b1a6-4ff3-9a02-b268fa8cfbf6 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:41:36.352211 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e8e7c-b1a6-4ff3-9a02-b268fa8cfbf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:41:36.360003 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e8e7c-b1a6-4ff3-9a02-b268fa8cfbf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:41:36.361562 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e8e7c-b1a6-4ff3-9a02-b268fa8cfbf6 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:41:36.370896 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 748/1513] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:41:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:41:37.201139 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ba607-91ec-4872-ad7a-5d31ae1265e1 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:41:37.201670 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ba607-91ec-4872-ad7a-5d31ae1265e1 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:41:37.201792 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758ba607-91ec-4872-ad7a-5d31ae1265e1 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:41:37.203118 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 766/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 03:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:41:37.207925 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef4ce0-ea77-4033-9ece-b7ea502a506a None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:41:37.208874 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef4ce0-ea77-4033-9ece-b7ea502a506a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:41:37.209091 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef4ce0-ea77-4033-9ece-b7ea502a506a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:41:37.226888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-2eef4ce0-ea77-4033-9ece-b7ea502a506a None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:41:37.228097 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2eef4ce0-ea77-4033-9ece-b7ea502a506a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:41:37.236079 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 749/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 03:41:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:41:37.388708 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ba607-91ec-4872-ad7a-5d31ae1265e1 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:41:37.403393 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758ba607-91ec-4872-ad7a-5d31ae1265e1 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:41:37.408930 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312432f-b8f0-4331-9b6c-8618d1071011 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:41:37.409563 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312432f-b8f0-4331-9b6c-8618d1071011 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:41:37.409847 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312432f-b8f0-4331-9b6c-8618d1071011 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:41:37.410125 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312432f-b8f0-4331-9b6c-8618d1071011 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:41:37.418195 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e312432f-b8f0-4331-9b6c-8618d1071011 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:41:37.419809 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e312432f-b8f0-4331-9b6c-8618d1071011 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:41:37.429606 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 767/1516] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:41:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:41:37.700284 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e9939-9436-48bd-9a8b-c9898e6462d3 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:41:37.700475 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e9939-9436-48bd-9a8b-c9898e6462d3 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:41:37.700803 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e9939-9436-48bd-9a8b-c9898e6462d3 None None] PATH_INFO: `/v3` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:41:37.702118 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 750/1517] 10.222.0.36 () {54 vars in 925 bytes} [Thu Jul 21 03:41:37 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:41:37.708036 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b1d2b-b986-41ee-80dd-0cfb5d82c5c2 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:41:37.708435 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b1d2b-b986-41ee-80dd-0cfb5d82c5c2 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:41:37.708719 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b1d2b-b986-41ee-80dd-0cfb5d82c5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:41:37.767421 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-582b1d2b-b986-41ee-80dd-0cfb5d82c5c2 None None] MFA Rules not processed for user `cb39129b3ed04db28ed01860b37bd714`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:41:37.768624 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-582b1d2b-b986-41ee-80dd-0cfb5d82c5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:41:37.788215 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:41:37.842386 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 768/1518] 10.222.0.36 () {58 vars in 1015 bytes} [Thu Jul 21 03:41:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:41:46.938741 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d81d4-6ad6-44d8-a5cf-e32fb8d4d89d None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:41:46.939335 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d81d4-6ad6-44d8-a5cf-e32fb8d4d89d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:41:46.939335 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d81d4-6ad6-44d8-a5cf-e32fb8d4d89d None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:41:46.940632 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 751/1519] 10.222.0.20 () {54 vars in 961 bytes} [Thu Jul 21 03:41:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:41:46.945651 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9301a4-90d1-4036-b008-09c00d8ce5e6 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:41:46.946096 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9301a4-90d1-4036-b008-09c00d8ce5e6 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:41:46.946203 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9301a4-90d1-4036-b008-09c00d8ce5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:41:46.963869 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-bd9301a4-90d1-4036-b008-09c00d8ce5e6 None None] MFA Rules not processed for user `cb39129b3ed04db28ed01860b37bd714`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:41:46.964980 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-bd9301a4-90d1-4036-b008-09c00d8ce5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:41:46.973263 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 769/1520] 10.222.0.20 () {58 vars in 1058 bytes} [Thu Jul 21 03:41:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:41:46.980856 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d81d4-6ad6-44d8-a5cf-e32fb8d4d89d None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:41:46.994202 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d81d4-6ad6-44d8-a5cf-e32fb8d4d89d None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:41:46.999018 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec23a1f1-407e-49e0-b6cc-3c020186aae6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb39129b3ed04db28ed01860b37bd714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:41:46.999639 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23a1f1-407e-49e0-b6cc-3c020186aae6 service placement] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:41:46.999917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23a1f1-407e-49e0-b6cc-3c020186aae6 service placement] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:41:47.000187 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23a1f1-407e-49e0-b6cc-3c020186aae6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:41:47.008246 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec23a1f1-407e-49e0-b6cc-3c020186aae6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:41:47.009796 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec23a1f1-407e-49e0-b6cc-3c020186aae6 service placement] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:41:47.019661 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 752/1521] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:41:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:41:48.653887 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1d088-b01d-4450-8d22-042cfa54b404 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:41:48.654522 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1d088-b01d-4450-8d22-042cfa54b404 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:41:48.654522 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f1d088-b01d-4450-8d22-042cfa54b404 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:41:48.656145 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 770/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 03:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 03:41:48.660968 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce3fb6-198f-4b9d-b4fe-a0d56be1c877 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:41:48.661410 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce3fb6-198f-4b9d-b4fe-a0d56be1c877 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:41:48.661516 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce3fb6-198f-4b9d-b4fe-a0d56be1c877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:41:48.679324 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-76ce3fb6-198f-4b9d-b4fe-a0d56be1c877 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:41:48.680513 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-76ce3fb6-198f-4b9d-b4fe-a0d56be1c877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:41:48.688156 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 753/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 03:41:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:41:48.839552 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f1d088-b01d-4450-8d22-042cfa54b404 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:41:48.854046 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f1d088-b01d-4450-8d22-042cfa54b404 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:41:48.859498 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380b21c-8c54-4c94-8a4d-7b3ea618ff2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:41:48.860126 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380b21c-8c54-4c94-8a4d-7b3ea618ff2f service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:41:48.860409 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380b21c-8c54-4c94-8a4d-7b3ea618ff2f service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:41:48.860683 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380b21c-8c54-4c94-8a4d-7b3ea618ff2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:41:48.869120 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380b21c-8c54-4c94-8a4d-7b3ea618ff2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:41:48.870710 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380b21c-8c54-4c94-8a4d-7b3ea618ff2f service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:41:48.880447 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 771/1524] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:41:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:41:49.697711 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d55a6f-a6c8-4afb-be1e-c289a0a3a2cd None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:41:49.698242 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d55a6f-a6c8-4afb-be1e-c289a0a3a2cd None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:41:49.698242 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d55a6f-a6c8-4afb-be1e-c289a0a3a2cd None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:41:49.699583 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 754/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 03:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:41:49.704374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e10f35-8f10-4dd3-ae25-634f8b153dae None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:41:49.704776 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e10f35-8f10-4dd3-ae25-634f8b153dae None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:41:49.704930 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e10f35-8f10-4dd3-ae25-634f8b153dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:41:49.723137 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-04e10f35-8f10-4dd3-ae25-634f8b153dae None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:41:49.725011 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-04e10f35-8f10-4dd3-ae25-634f8b153dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:41:49.732973 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 772/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 03:41:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:41:49.886969 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d55a6f-a6c8-4afb-be1e-c289a0a3a2cd None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:41:49.901617 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d55a6f-a6c8-4afb-be1e-c289a0a3a2cd None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:41:49.907257 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b34ae-1668-4cef-995e-bc8688325d0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:41:49.907898 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b34ae-1668-4cef-995e-bc8688325d0f service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:41:49.908184 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b34ae-1668-4cef-995e-bc8688325d0f service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:41:49.908464 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b34ae-1668-4cef-995e-bc8688325d0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:41:49.916466 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b34ae-1668-4cef-995e-bc8688325d0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:41:49.918045 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b34ae-1668-4cef-995e-bc8688325d0f service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:41:49.927296 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 755/1527] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:41:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:41:54.310195 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101698aa-3082-416e-98ef-8797fcec4cfd None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:41:54.310792 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101698aa-3082-416e-98ef-8797fcec4cfd None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:41:54.310792 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101698aa-3082-416e-98ef-8797fcec4cfd None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:41:54.312174 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 773/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 03:41:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:41:54.317955 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453824f-ad3d-4af3-b09c-070aa86811de None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:41:54.318397 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453824f-ad3d-4af3-b09c-070aa86811de None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:41:54.318550 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453824f-ad3d-4af3-b09c-070aa86811de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:41:54.336563 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-2453824f-ad3d-4af3-b09c-070aa86811de None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:41:54.337742 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2453824f-ad3d-4af3-b09c-070aa86811de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:41:54.345320 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 756/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 03:41:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:41:54.417741 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101698aa-3082-416e-98ef-8797fcec4cfd None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:41:54.419537 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-101698aa-3082-416e-98ef-8797fcec4cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:41:54.495898 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101698aa-3082-416e-98ef-8797fcec4cfd None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:41:54.499467 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565fdb7d-fab1-43b8-9d9f-c55711b3a049 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:41:54.500111 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565fdb7d-fab1-43b8-9d9f-c55711b3a049 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:41:54.500401 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565fdb7d-fab1-43b8-9d9f-c55711b3a049 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:41:54.500685 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565fdb7d-fab1-43b8-9d9f-c55711b3a049 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:41:54.509882 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565fdb7d-fab1-43b8-9d9f-c55711b3a049 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:41:54.511348 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565fdb7d-fab1-43b8-9d9f-c55711b3a049 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:41:54.521140 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 774/1530] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:41:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:41:56.527185 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a6bcf-db0e-4f4a-9063-b239dee34ed1 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:41:56.527760 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a6bcf-db0e-4f4a-9063-b239dee34ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:41:56.527760 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24a6bcf-db0e-4f4a-9063-b239dee34ed1 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:41:56.529167 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 757/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 03:41:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:41:56.534839 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6119c-2cd3-4a85-b9bf-f73c3df7cc16 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:41:56.535264 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6119c-2cd3-4a85-b9bf-f73c3df7cc16 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:41:56.535403 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece6119c-2cd3-4a85-b9bf-f73c3df7cc16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:41:56.554680 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-ece6119c-2cd3-4a85-b9bf-f73c3df7cc16 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:41:56.555870 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ece6119c-2cd3-4a85-b9bf-f73c3df7cc16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:41:56.563615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 775/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 03:41:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:41:56.601356 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24a6bcf-db0e-4f4a-9063-b239dee34ed1 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:41:56.611955 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24a6bcf-db0e-4f4a-9063-b239dee34ed1 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:41:56.615392 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beabd676-1924-47db-bb7b-d67f1ade0c3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:41:56.616032 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabd676-1924-47db-bb7b-d67f1ade0c3b service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:41:56.616321 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabd676-1924-47db-bb7b-d67f1ade0c3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:41:56.616602 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabd676-1924-47db-bb7b-d67f1ade0c3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:41:56.625295 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beabd676-1924-47db-bb7b-d67f1ade0c3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:41:56.626763 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beabd676-1924-47db-bb7b-d67f1ade0c3b service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:41:56.636471 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 758/1533] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:41:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:42:00.123808 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c628216-d0c2-404d-be73-c8b91d3a29d1 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:42:00.124365 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c628216-d0c2-404d-be73-c8b91d3a29d1 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:42:00.124474 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c628216-d0c2-404d-be73-c8b91d3a29d1 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:42:00.125813 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 776/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 03:42:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:42:00.130921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3e123-29c5-4f04-ad32-9395810ad620 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:42:00.131368 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3e123-29c5-4f04-ad32-9395810ad620 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:42:00.131463 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa3e123-29c5-4f04-ad32-9395810ad620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:42:00.149671 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-efa3e123-29c5-4f04-ad32-9395810ad620 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:42:00.150888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-efa3e123-29c5-4f04-ad32-9395810ad620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:42:00.158810 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 759/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 03:42:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:42:00.460099 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c628216-d0c2-404d-be73-c8b91d3a29d1 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:42:00.461763 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9c628216-d0c2-404d-be73-c8b91d3a29d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:42:00.525082 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:42:00.538558 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c628216-d0c2-404d-be73-c8b91d3a29d1 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:42:00.542096 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0c877-4c07-402b-b713-85076da04b4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:42:00.542768 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0c877-4c07-402b-b713-85076da04b4b service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:42:00.543060 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0c877-4c07-402b-b713-85076da04b4b service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:42:00.543337 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0c877-4c07-402b-b713-85076da04b4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:42:00.552067 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c0c877-4c07-402b-b713-85076da04b4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:42:00.553485 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c0c877-4c07-402b-b713-85076da04b4b service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:42:00.562819 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 777/1536] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:42:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:42:02.607746 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe480f-12b5-43fe-a7d4-5ed1ce6746a0 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:42:02.608289 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe480f-12b5-43fe-a7d4-5ed1ce6746a0 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:42:02.608289 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe480f-12b5-43fe-a7d4-5ed1ce6746a0 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:42:02.609651 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 760/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 03:42:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:42:02.614714 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e01fd6-3cc2-46fc-bdd4-3ea543ca0978 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:42:02.615183 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e01fd6-3cc2-46fc-bdd4-3ea543ca0978 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:42:02.615289 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e01fd6-3cc2-46fc-bdd4-3ea543ca0978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:42:02.633420 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e2e01fd6-3cc2-46fc-bdd4-3ea543ca0978 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:42:02.634642 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e2e01fd6-3cc2-46fc-bdd4-3ea543ca0978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:42:02.642330 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 778/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 03:42:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:42:02.945325 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe480f-12b5-43fe-a7d4-5ed1ce6746a0 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:42:02.947045 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c2fe480f-12b5-43fe-a7d4-5ed1ce6746a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:42:02.954444 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=84 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:42:02.960766 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe480f-12b5-43fe-a7d4-5ed1ce6746a0 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:42:02.964220 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b4da3f-1e18-4bdc-a4b6-7bcea377c6d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:42:02.964854 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4da3f-1e18-4bdc-a4b6-7bcea377c6d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:42:02.965138 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4da3f-1e18-4bdc-a4b6-7bcea377c6d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:42:02.965414 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b4da3f-1e18-4bdc-a4b6-7bcea377c6d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:42:02.974170 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b4da3f-1e18-4bdc-a4b6-7bcea377c6d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:42:02.975629 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b4da3f-1e18-4bdc-a4b6-7bcea377c6d8 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:42:02.984894 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 761/1539] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:42:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:42:12.628224 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=11 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:42:12.980810 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=5 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:43:39.272256 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8894666-4d15-4577-a56a-d33ae1678f70 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:39.274280 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8894666-4d15-4577-a56a-d33ae1678f70 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:39.274280 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8894666-4d15-4577-a56a-d33ae1678f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:39.298127 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-c8894666-4d15-4577-a56a-d33ae1678f70 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:39.299726 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c8894666-4d15-4577-a56a-d33ae1678f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:39.313868 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 779/1540] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:43:39.323917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969e05e-db44-41c1-8e10-7e8d438358fd None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:39.325014 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969e05e-db44-41c1-8e10-7e8d438358fd None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:39.325516 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969e05e-db44-41c1-8e10-7e8d438358fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:39.344993 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-8969e05e-db44-41c1-8e10-7e8d438358fd None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:39.362094 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8969e05e-db44-41c1-8e10-7e8d438358fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:39.376073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 762/1541] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:43:39.380905 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8894666-4d15-4577-a56a-d33ae1678f70 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:39.392048 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8894666-4d15-4577-a56a-d33ae1678f70 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:39.399419 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805daf7-07c9-4bb2-aca0-7b959f3b997f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:39.400390 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805daf7-07c9-4bb2-aca0-7b959f3b997f admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:39.400896 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805daf7-07c9-4bb2-aca0-7b959f3b997f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:39.401405 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0805daf7-07c9-4bb2-aca0-7b959f3b997f admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:39.402545 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0805daf7-07c9-4bb2-aca0-7b959f3b997f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:43:39.406955 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb723941-c995-43f9-aa43-aef370467dfd None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:39.407595 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb723941-c995-43f9-aa43-aef370467dfd None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:39.408107 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb723941-c995-43f9-aa43-aef370467dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:39.416582 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0805daf7-07c9-4bb2-aca0-7b959f3b997f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:39.418765 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0805daf7-07c9-4bb2-aca0-7b959f3b997f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:39.440471 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-cb723941-c995-43f9-aa43-aef370467dfd None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:39.446087 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-cb723941-c995-43f9-aa43-aef370467dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:39.448486 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 780/1542] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:43:39.453586 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805daf7-07c9-4bb2-aca0-7b959f3b997f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:39.465598 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 763/1543] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:43:39.467433 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbff5e8-3c2a-42f7-8075-a6fd44dc9149 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:39.467951 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbff5e8-3c2a-42f7-8075-a6fd44dc9149 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:39.468602 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbff5e8-3c2a-42f7-8075-a6fd44dc9149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:39.473800 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0805daf7-07c9-4bb2-aca0-7b959f3b997f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:39.481519 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acc0327-eec2-40aa-9095-46636e270d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:39.481739 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc0327-eec2-40aa-9095-46636e270d49 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:39.481836 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc0327-eec2-40aa-9095-46636e270d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:39.482102 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acc0327-eec2-40aa-9095-46636e270d49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:39.482826 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc0327-eec2-40aa-9095-46636e270d49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:39.483844 dv-cinder-850318-2-smb devstack@keystone.service[80332]: WARNING py.warnings [None req-9acc0327-eec2-40aa-9095-46636e270d49 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 03:43:39.483844 dv-cinder-850318-2-smb devstack@keystone.service[80332]: warnings.warn(msg) Jul 21 03:43:39.483844 dv-cinder-850318-2-smb devstack@keystone.service[80332]: Jul 21 03:43:39.485029 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acc0327-eec2-40aa-9095-46636e270d49 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:39.498124 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-bdbff5e8-3c2a-42f7-8075-a6fd44dc9149 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:39.500357 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-bdbff5e8-3c2a-42f7-8075-a6fd44dc9149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:39.513847 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 764/1544] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:43:39.515613 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7c6ef-34db-424f-8588-1d036213c861 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:39.516122 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7c6ef-34db-424f-8588-1d036213c861 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:39.516617 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea7c6ef-34db-424f-8588-1d036213c861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:39.550776 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-2ea7c6ef-34db-424f-8588-1d036213c861 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:39.553324 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2ea7c6ef-34db-424f-8588-1d036213c861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:39.562859 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 781/1545] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:43:39 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:43:39.564341 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505fc6a-2c26-468e-8fe6-e935672d92c9 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:39.564599 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505fc6a-2c26-468e-8fe6-e935672d92c9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:39.564838 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505fc6a-2c26-468e-8fe6-e935672d92c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:39.566572 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 765/1546] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:43:39.568253 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ac9ac-f3b6-4f7a-b4d0-76dd892a0e26 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:39.568763 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ac9ac-f3b6-4f7a-b4d0-76dd892a0e26 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:39.569252 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5ac9ac-f3b6-4f7a-b4d0-76dd892a0e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:39.596552 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d505fc6a-2c26-468e-8fe6-e935672d92c9 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:39.597777 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d505fc6a-2c26-468e-8fe6-e935672d92c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:39.598983 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-fa5ac9ac-f3b6-4f7a-b4d0-76dd892a0e26 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:39.600371 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fa5ac9ac-f3b6-4f7a-b4d0-76dd892a0e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:39.685292 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 766/1547] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:43:39.686164 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ac9ac-f3b6-4f7a-b4d0-76dd892a0e26 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:39.686487 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 782/1548] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:43:39.687539 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505fc6a-2c26-468e-8fe6-e935672d92c9 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:39.698507 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5ac9ac-f3b6-4f7a-b4d0-76dd892a0e26 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:39.705184 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505fc6a-2c26-468e-8fe6-e935672d92c9 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:39.706726 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f179a61-1630-40e3-8a7b-46f4995b9a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:39.708004 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f179a61-1630-40e3-8a7b-46f4995b9a63 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:39.708349 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f179a61-1630-40e3-8a7b-46f4995b9a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:39.708632 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f179a61-1630-40e3-8a7b-46f4995b9a63 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:39.709330 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f179a61-1630-40e3-8a7b-46f4995b9a63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:39.710345 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81baf240-5dc5-4a7a-932f-90328d8482f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:39.710503 dv-cinder-850318-2-smb devstack@keystone.service[80331]: WARNING py.warnings [None req-2f179a61-1630-40e3-8a7b-46f4995b9a63 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 03:43:39.710503 dv-cinder-850318-2-smb devstack@keystone.service[80331]: warnings.warn(msg) Jul 21 03:43:39.710503 dv-cinder-850318-2-smb devstack@keystone.service[80331]: Jul 21 03:43:39.711042 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81baf240-5dc5-4a7a-932f-90328d8482f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:39.711323 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81baf240-5dc5-4a7a-932f-90328d8482f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:39.711597 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81baf240-5dc5-4a7a-932f-90328d8482f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:39.711990 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f179a61-1630-40e3-8a7b-46f4995b9a63 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:39.712324 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81baf240-5dc5-4a7a-932f-90328d8482f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:43:39.712636 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81baf240-5dc5-4a7a-932f-90328d8482f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:39.714211 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81baf240-5dc5-4a7a-932f-90328d8482f6 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:39.727094 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 783/1549] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:43:39.728542 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3f2a3-ce69-43f3-9509-bdf89fe58106 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:39.728893 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3f2a3-ce69-43f3-9509-bdf89fe58106 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:39.729200 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3f2a3-ce69-43f3-9509-bdf89fe58106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:39.740084 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 767/1550] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:43:39 2022] POST /identity/v3/users => generated 289 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:43:39.740084 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db400b-ca59-45af-bf20-053c7180922f None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:39.740084 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db400b-ca59-45af-bf20-053c7180922f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:39.740084 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db400b-ca59-45af-bf20-053c7180922f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:39.748044 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-bcf3f2a3-ce69-43f3-9509-bdf89fe58106 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:39.749234 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-bcf3f2a3-ce69-43f3-9509-bdf89fe58106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:39.756634 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-77db400b-ca59-45af-bf20-053c7180922f None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:39.757122 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 784/1551] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:43:39.757810 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-77db400b-ca59-45af-bf20-053c7180922f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:39.758533 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1366798-23e8-45c4-8b52-ca128f2b2006 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:39.758824 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1366798-23e8-45c4-8b52-ca128f2b2006 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:39.759095 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1366798-23e8-45c4-8b52-ca128f2b2006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:39.772003 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 768/1552] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:43:39.773165 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db400b-ca59-45af-bf20-053c7180922f None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:39.783053 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db400b-ca59-45af-bf20-053c7180922f None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:39.784828 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b1366798-23e8-45c4-8b52-ca128f2b2006 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:39.786665 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b1366798-23e8-45c4-8b52-ca128f2b2006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:39.788259 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a8456-61c4-47ef-bb77-dfea72a2fd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:39.788914 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a8456-61c4-47ef-bb77-dfea72a2fd29 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:39.789196 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a8456-61c4-47ef-bb77-dfea72a2fd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:39.789473 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a8456-61c4-47ef-bb77-dfea72a2fd29 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:39.790211 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a8456-61c4-47ef-bb77-dfea72a2fd29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:43:39.790546 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a8456-61c4-47ef-bb77-dfea72a2fd29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:39.791576 dv-cinder-850318-2-smb devstack@keystone.service[80331]: WARNING py.warnings [None req-0d0a8456-61c4-47ef-bb77-dfea72a2fd29 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 03:43:39.791576 dv-cinder-850318-2-smb devstack@keystone.service[80331]: warnings.warn(msg) Jul 21 03:43:39.791576 dv-cinder-850318-2-smb devstack@keystone.service[80331]: Jul 21 03:43:39.792456 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a8456-61c4-47ef-bb77-dfea72a2fd29 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:39.794668 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 785/1553] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:43:39.795864 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb11b9a-0fc4-4d7c-b49a-c1cb924869c8 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:39.796153 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb11b9a-0fc4-4d7c-b49a-c1cb924869c8 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:39.796438 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb11b9a-0fc4-4d7c-b49a-c1cb924869c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:39.809350 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 769/1554] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:43:39.810656 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6706a-a190-4b1f-9800-79d6298dd676 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:39.810948 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6706a-a190-4b1f-9800-79d6298dd676 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:39.811219 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6706a-a190-4b1f-9800-79d6298dd676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:39.815339 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-9cb11b9a-0fc4-4d7c-b49a-c1cb924869c8 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:39.816757 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9cb11b9a-0fc4-4d7c-b49a-c1cb924869c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:39.825109 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 786/1555] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:43:39.826187 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb11b9a-0fc4-4d7c-b49a-c1cb924869c8 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:39.829777 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-22b6706a-a190-4b1f-9800-79d6298dd676 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:39.831068 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-22b6706a-a190-4b1f-9800-79d6298dd676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:39.836259 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb11b9a-0fc4-4d7c-b49a-c1cb924869c8 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:39.839526 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 770/1556] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:43:39.840937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938fae17-ec74-464e-971e-756a289d2ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:39.841581 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fae17-ec74-464e-971e-756a289d2ba9 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:39.841865 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fae17-ec74-464e-971e-756a289d2ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:39.842140 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938fae17-ec74-464e-971e-756a289d2ba9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:39.843188 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938fae17-ec74-464e-971e-756a289d2ba9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:39.843878 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6706a-a190-4b1f-9800-79d6298dd676 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:39.845054 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938fae17-ec74-464e-971e-756a289d2ba9 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:39.854683 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6706a-a190-4b1f-9800-79d6298dd676 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:39.859687 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab90b2-a18e-45cb-9a47-65ecf7a546c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:39.860343 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab90b2-a18e-45cb-9a47-65ecf7a546c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:39.860624 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab90b2-a18e-45cb-9a47-65ecf7a546c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:39.860900 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab90b2-a18e-45cb-9a47-65ecf7a546c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:39.861653 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab90b2-a18e-45cb-9a47-65ecf7a546c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:39.863392 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab90b2-a18e-45cb-9a47-65ecf7a546c7 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:39.871414 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 787/1557] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:43:39 2022] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:43:39.873037 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ce59c-b97c-4da2-96d9-e3da31b9bace None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:39.873419 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 771/1558] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:43:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:43:39.874226 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ce59c-b97c-4da2-96d9-e3da31b9bace None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:39.874866 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27ce59c-b97c-4da2-96d9-e3da31b9bace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:39.877336 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e2779-a330-462e-9fa9-f3d62c9642c1 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:39.877631 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e2779-a330-462e-9fa9-f3d62c9642c1 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:39.877908 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e2779-a330-462e-9fa9-f3d62c9642c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:39.892607 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f27ce59c-b97c-4da2-96d9-e3da31b9bace None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:39.893806 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f27ce59c-b97c-4da2-96d9-e3da31b9bace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:39.895541 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-9d0e2779-a330-462e-9fa9-f3d62c9642c1 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:39.896695 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9d0e2779-a330-462e-9fa9-f3d62c9642c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:39.943253 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:43:39.955888 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 788/1559] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:43:39.957890 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d8e72-a55a-42c5-8596-134e25668b2b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:39.958283 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 772/1560] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:43:39.959069 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e2779-a330-462e-9fa9-f3d62c9642c1 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:39.962330 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d8e72-a55a-42c5-8596-134e25668b2b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:39.962660 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d8e72-a55a-42c5-8596-134e25668b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:39.968815 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e2779-a330-462e-9fa9-f3d62c9642c1 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:39.974865 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe09ce4f-f7c3-42f6-8ad5-0dd54469d578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:39.976027 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09ce4f-f7c3-42f6-8ad5-0dd54469d578 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:39.976320 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09ce4f-f7c3-42f6-8ad5-0dd54469d578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:39.976720 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe09ce4f-f7c3-42f6-8ad5-0dd54469d578 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:39.977418 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe09ce4f-f7c3-42f6-8ad5-0dd54469d578 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:39.979352 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe09ce4f-f7c3-42f6-8ad5-0dd54469d578 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:39.981833 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-de9d8e72-a55a-42c5-8596-134e25668b2b None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:39.983040 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-de9d8e72-a55a-42c5-8596-134e25668b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:39.991190 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 789/1561] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:43:39.992532 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d38e5-975a-4675-ba8d-47395ab250a8 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:39.992902 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d38e5-975a-4675-ba8d-47395ab250a8 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:39.993184 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d38e5-975a-4675-ba8d-47395ab250a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:40.001911 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:43:40.011400 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 773/1562] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:43:39 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:43:40.014713 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-ea8d38e5-975a-4675-ba8d-47395ab250a8 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:40.014829 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe09ce4f-f7c3-42f6-8ad5-0dd54469d578 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:40.014930 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ea8d38e5-975a-4675-ba8d-47395ab250a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:40.076312 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe09ce4f-f7c3-42f6-8ad5-0dd54469d578 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:40.078063 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 790/1563] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:43:40.078961 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d38e5-975a-4675-ba8d-47395ab250a8 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:40.081121 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dffcadf-e6db-4038-a693-6885ef374c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:40.082076 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffcadf-e6db-4038-a693-6885ef374c08 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:40.082416 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffcadf-e6db-4038-a693-6885ef374c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:40.083239 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffcadf-e6db-4038-a693-6885ef374c08 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:40.084218 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dffcadf-e6db-4038-a693-6885ef374c08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:43:40.084526 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dffcadf-e6db-4038-a693-6885ef374c08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:40.086164 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dffcadf-e6db-4038-a693-6885ef374c08 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:40.088915 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d38e5-975a-4675-ba8d-47395ab250a8 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:40.093194 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d544b35-4097-4e88-b407-67067803149e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:40.093904 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d544b35-4097-4e88-b407-67067803149e admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:40.094190 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d544b35-4097-4e88-b407-67067803149e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:40.094485 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d544b35-4097-4e88-b407-67067803149e admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:40.095190 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d544b35-4097-4e88-b407-67067803149e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:40.097162 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d544b35-4097-4e88-b407-67067803149e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:40.098067 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 774/1564] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:43:40.106058 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dffcadf-e6db-4038-a693-6885ef374c08 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:40.117246 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dffcadf-e6db-4038-a693-6885ef374c08 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:40.118871 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 791/1565] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:43:40 2022] POST /identity/v3/users => generated 303 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:43:40.119672 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d544b35-4097-4e88-b407-67067803149e admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:40.122396 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c1ce47-f972-435c-a03a-49cf41cf39e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:40.123096 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1ce47-f972-435c-a03a-49cf41cf39e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:40.123380 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1ce47-f972-435c-a03a-49cf41cf39e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:40.123656 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1ce47-f972-435c-a03a-49cf41cf39e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:40.124387 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c1ce47-f972-435c-a03a-49cf41cf39e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:40.125998 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c1ce47-f972-435c-a03a-49cf41cf39e0 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:40.129837 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d544b35-4097-4e88-b407-67067803149e admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:40.134763 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f744f-e59a-443e-b18e-662f5837cb0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:40.135415 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f744f-e59a-443e-b18e-662f5837cb0e admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:40.135696 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f744f-e59a-443e-b18e-662f5837cb0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:40.135972 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f744f-e59a-443e-b18e-662f5837cb0e admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:40.136699 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f744f-e59a-443e-b18e-662f5837cb0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:43:40.137006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f744f-e59a-443e-b18e-662f5837cb0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:40.140938 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 775/1566] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:43:40.141080 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f744f-e59a-443e-b18e-662f5837cb0e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:40.141195 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c1ce47-f972-435c-a03a-49cf41cf39e0 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:40.148652 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c1ce47-f972-435c-a03a-49cf41cf39e0 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:40.151604 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 792/1567] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:43:40.152253 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f744f-e59a-443e-b18e-662f5837cb0e admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:40.159208 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e190a0-572d-4c93-99e6-fcaa9df0dff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:40.159898 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e190a0-572d-4c93-99e6-fcaa9df0dff5 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:40.160176 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e190a0-572d-4c93-99e6-fcaa9df0dff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:40.160477 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e190a0-572d-4c93-99e6-fcaa9df0dff5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:40.161284 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e190a0-572d-4c93-99e6-fcaa9df0dff5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:43:40.161590 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e190a0-572d-4c93-99e6-fcaa9df0dff5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:40.162352 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f744f-e59a-443e-b18e-662f5837cb0e admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:40.163338 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e190a0-572d-4c93-99e6-fcaa9df0dff5 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:40.167673 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e6063-a55a-4449-a11b-bbf78957b1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:40.168312 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e6063-a55a-4449-a11b-bbf78957b1cc admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:40.168596 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e6063-a55a-4449-a11b-bbf78957b1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:40.169041 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0e6063-a55a-4449-a11b-bbf78957b1cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:40.169759 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0e6063-a55a-4449-a11b-bbf78957b1cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:43:40.170568 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0e6063-a55a-4449-a11b-bbf78957b1cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:40.172583 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0e6063-a55a-4449-a11b-bbf78957b1cc admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:40.174760 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 776/1568] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:43:40.175656 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e190a0-572d-4c93-99e6-fcaa9df0dff5 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:40.192299 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 793/1569] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:43:40.192510 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e190a0-572d-4c93-99e6-fcaa9df0dff5 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:40.192615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e6063-a55a-4449-a11b-bbf78957b1cc admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:40.192721 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0b8f2-5fc5-400b-b69e-1ef3697e60d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:40.192721 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0b8f2-5fc5-400b-b69e-1ef3697e60d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:40.192721 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0b8f2-5fc5-400b-b69e-1ef3697e60d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:40.192721 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0b8f2-5fc5-400b-b69e-1ef3697e60d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:40.193099 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb0b8f2-5fc5-400b-b69e-1ef3697e60d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:40.193974 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb0b8f2-5fc5-400b-b69e-1ef3697e60d8 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:40.198053 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0e6063-a55a-4449-a11b-bbf78957b1cc admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:40.202656 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b2060-385b-4a7a-b0fa-0a8a1281d275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:40.203300 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b2060-385b-4a7a-b0fa-0a8a1281d275 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:40.203588 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b2060-385b-4a7a-b0fa-0a8a1281d275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:40.203862 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b2060-385b-4a7a-b0fa-0a8a1281d275 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:40.204577 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b2060-385b-4a7a-b0fa-0a8a1281d275 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:43:40.204957 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b2060-385b-4a7a-b0fa-0a8a1281d275 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:40.206554 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b2060-385b-4a7a-b0fa-0a8a1281d275 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:40.214244 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 777/1570] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:43:40 2022] POST /identity/v3/users => generated 293 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:43:40.218328 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0b8f2-5fc5-400b-b69e-1ef3697e60d8 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:40.223164 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 794/1571] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:43:40.224356 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b2060-385b-4a7a-b0fa-0a8a1281d275 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:40.228831 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0b8f2-5fc5-400b-b69e-1ef3697e60d8 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:40.233377 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27976c3b-a802-4290-a027-31330377f926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:40.234025 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27976c3b-a802-4290-a027-31330377f926 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:40.234305 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27976c3b-a802-4290-a027-31330377f926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:40.234414 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b2060-385b-4a7a-b0fa-0a8a1281d275 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:40.234609 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27976c3b-a802-4290-a027-31330377f926 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:40.235294 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27976c3b-a802-4290-a027-31330377f926 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:40.237375 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27976c3b-a802-4290-a027-31330377f926 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:40.239410 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6608c79-2089-484e-a671-d7faf2574971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:40.240090 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6608c79-2089-484e-a671-d7faf2574971 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:40.240376 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6608c79-2089-484e-a671-d7faf2574971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:40.240825 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6608c79-2089-484e-a671-d7faf2574971 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:40.241551 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6608c79-2089-484e-a671-d7faf2574971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:40.243159 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6608c79-2089-484e-a671-d7faf2574971 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:40.253038 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 795/1572] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:43:40.253827 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6608c79-2089-484e-a671-d7faf2574971 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:40.263944 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6608c79-2089-484e-a671-d7faf2574971 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:40.269388 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 778/1573] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:43:40 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:43:40.269388 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27976c3b-a802-4290-a027-31330377f926 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:40.321006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11109f43-7147-4488-811a-2282691dd31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:40.321906 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11109f43-7147-4488-811a-2282691dd31e admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:40.322191 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11109f43-7147-4488-811a-2282691dd31e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:40.322564 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11109f43-7147-4488-811a-2282691dd31e admin admin] PATH_INFO: `/v3/projects/9a9039acaf0340f4859da953e7b1e97f/users/e0f4a87a467643ae90d5de771ff01d50/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:40.329270 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27976c3b-a802-4290-a027-31330377f926 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:40.334803 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178915a1-b38a-4f3b-bebf-aaf62482d70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:40.335677 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178915a1-b38a-4f3b-bebf-aaf62482d70c admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:40.335906 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178915a1-b38a-4f3b-bebf-aaf62482d70c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:40.336200 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178915a1-b38a-4f3b-bebf-aaf62482d70c admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:40.336888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178915a1-b38a-4f3b-bebf-aaf62482d70c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:40.338831 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178915a1-b38a-4f3b-bebf-aaf62482d70c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:40.344346 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11109f43-7147-4488-811a-2282691dd31e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a9039acaf0340f4859da953e7b1e97f, user_id=e0f4a87a467643ae90d5de771ff01d50, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:40.345391 dv-cinder-850318-2-smb devstack@keystone.service[80332]: WARNING py.warnings [None req-11109f43-7147-4488-811a-2282691dd31e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 03:43:40.345391 dv-cinder-850318-2-smb devstack@keystone.service[80332]: warnings.warn(msg) Jul 21 03:43:40.345391 dv-cinder-850318-2-smb devstack@keystone.service[80332]: Jul 21 03:43:40.347383 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11109f43-7147-4488-811a-2282691dd31e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:40.362169 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 796/1574] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:43:40 2022] PUT /identity/v3/projects/9a9039acaf0340f4859da953e7b1e97f/users/e0f4a87a467643ae90d5de771ff01d50/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:43:40.363014 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11109f43-7147-4488-811a-2282691dd31e admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:40.365832 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 779/1575] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:43:40 2022] POST /identity/v3/projects => generated 405 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:43:40.366555 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178915a1-b38a-4f3b-bebf-aaf62482d70c admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:40.369297 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:43:40.380031 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:43:40.428395 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11109f43-7147-4488-811a-2282691dd31e admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:40.428846 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178915a1-b38a-4f3b-bebf-aaf62482d70c admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:40.433024 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74218dbf-eec1-4c6d-9633-e9e402d6fb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:40.433302 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e8c0b-b0c0-45bd-af1c-ae5e6590ff89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:40.433678 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74218dbf-eec1-4c6d-9633-e9e402d6fb41 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:40.433968 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74218dbf-eec1-4c6d-9633-e9e402d6fb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:40.434073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e8c0b-b0c0-45bd-af1c-ae5e6590ff89 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:40.434251 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74218dbf-eec1-4c6d-9633-e9e402d6fb41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:40.434407 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e8c0b-b0c0-45bd-af1c-ae5e6590ff89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:40.434556 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e8c0b-b0c0-45bd-af1c-ae5e6590ff89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:40.434968 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74218dbf-eec1-4c6d-9633-e9e402d6fb41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:40.435219 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e8c0b-b0c0-45bd-af1c-ae5e6590ff89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:40.436846 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74218dbf-eec1-4c6d-9633-e9e402d6fb41 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:40.437204 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e8c0b-b0c0-45bd-af1c-ae5e6590ff89 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:40.462261 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 797/1576] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:43:40 2022] POST /identity/v3/projects => generated 367 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:43:40.466005 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 780/1577] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:43:40 2022] POST /identity/v3/projects => generated 393 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:43:40.466154 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74218dbf-eec1-4c6d-9633-e9e402d6fb41 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:40.466264 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e8c0b-b0c0-45bd-af1c-ae5e6590ff89 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:40.524339 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e8c0b-b0c0-45bd-af1c-ae5e6590ff89 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:40.527555 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74218dbf-eec1-4c6d-9633-e9e402d6fb41 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:40.528878 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970bde6-4707-4926-a075-7417342c7884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:40.529527 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970bde6-4707-4926-a075-7417342c7884 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:40.529810 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970bde6-4707-4926-a075-7417342c7884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:40.530082 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970bde6-4707-4926-a075-7417342c7884 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:40.530796 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f970bde6-4707-4926-a075-7417342c7884 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:40.532503 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f41c69-31c0-42d6-b6e9-6464e214009f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:40.532939 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f970bde6-4707-4926-a075-7417342c7884 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:40.533168 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f41c69-31c0-42d6-b6e9-6464e214009f admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:40.533441 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f41c69-31c0-42d6-b6e9-6464e214009f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:40.533712 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f41c69-31c0-42d6-b6e9-6464e214009f admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:40.534428 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f41c69-31c0-42d6-b6e9-6464e214009f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:40.536090 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f41c69-31c0-42d6-b6e9-6464e214009f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:40.545933 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 798/1578] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:43:40.546763 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f41c69-31c0-42d6-b6e9-6464e214009f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:40.557212 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f41c69-31c0-42d6-b6e9-6464e214009f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:40.560854 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 781/1579] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:43:40 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:43:40.561686 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970bde6-4707-4926-a075-7417342c7884 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:40.564941 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a28d9-8544-4fb2-bc39-a8de24ee19d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:40.565601 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a28d9-8544-4fb2-bc39-a8de24ee19d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:40.565888 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a28d9-8544-4fb2-bc39-a8de24ee19d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:40.566172 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a28d9-8544-4fb2-bc39-a8de24ee19d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:40.567467 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a28d9-8544-4fb2-bc39-a8de24ee19d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:40.569053 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a28d9-8544-4fb2-bc39-a8de24ee19d6 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:40.579060 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 799/1580] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:43:40.580303 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b57f9e-62a7-4fdd-b112-d6fc605a991f None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:40.580539 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b57f9e-62a7-4fdd-b112-d6fc605a991f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:40.580818 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b57f9e-62a7-4fdd-b112-d6fc605a991f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:40.597562 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-47b57f9e-62a7-4fdd-b112-d6fc605a991f None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:40.598844 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-47b57f9e-62a7-4fdd-b112-d6fc605a991f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:40.626817 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970bde6-4707-4926-a075-7417342c7884 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:40.631944 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a566d-e335-445b-9596-e6fe84c7d85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:40.632618 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a566d-e335-445b-9596-e6fe84c7d85b admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:40.632904 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a566d-e335-445b-9596-e6fe84c7d85b admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:40.633181 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a566d-e335-445b-9596-e6fe84c7d85b admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:40.633880 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a566d-e335-445b-9596-e6fe84c7d85b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:40.635828 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a566d-e335-445b-9596-e6fe84c7d85b admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:40.658307 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 782/1581] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:43:40 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:43:40.658644 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 800/1582] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:43:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:43:40.659471 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b57f9e-62a7-4fdd-b112-d6fc605a991f None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:40.662493 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a566d-e335-445b-9596-e6fe84c7d85b admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:40.668747 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b57f9e-62a7-4fdd-b112-d6fc605a991f None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:40.671932 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a566d-e335-445b-9596-e6fe84c7d85b admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:40.673264 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3524801-1c2c-4fed-9bb9-3fe08d639428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:40.673972 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3524801-1c2c-4fed-9bb9-3fe08d639428 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:40.674261 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3524801-1c2c-4fed-9bb9-3fe08d639428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:40.674582 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3524801-1c2c-4fed-9bb9-3fe08d639428 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:40.675276 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3524801-1c2c-4fed-9bb9-3fe08d639428 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:40.677160 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0eb1a-3849-4aeb-9614-65ac7b7a8d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:40.677728 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3524801-1c2c-4fed-9bb9-3fe08d639428 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:40.677850 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0eb1a-3849-4aeb-9614-65ac7b7a8d54 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:40.678087 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0eb1a-3849-4aeb-9614-65ac7b7a8d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:40.678364 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e0eb1a-3849-4aeb-9614-65ac7b7a8d54 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:40.679084 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e0eb1a-3849-4aeb-9614-65ac7b7a8d54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:40.680981 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e0eb1a-3849-4aeb-9614-65ac7b7a8d54 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:40.690661 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:43:40.693790 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:43:40.700953 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 801/1583] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:43:40 2022] POST /identity/v3/users => generated 284 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:43:40.702624 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3524801-1c2c-4fed-9bb9-3fe08d639428 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:40.706946 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 783/1584] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:43:40 2022] POST /identity/v3/users => generated 303 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:43:40.708680 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0eb1a-3849-4aeb-9614-65ac7b7a8d54 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:40.715282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3524801-1c2c-4fed-9bb9-3fe08d639428 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:40.720380 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e0eb1a-3849-4aeb-9614-65ac7b7a8d54 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:40.721303 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97792fcd-abbc-4bb1-9b86-068d3294fe88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:40.722005 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97792fcd-abbc-4bb1-9b86-068d3294fe88 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:40.722292 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97792fcd-abbc-4bb1-9b86-068d3294fe88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:40.722614 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97792fcd-abbc-4bb1-9b86-068d3294fe88 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:40.723987 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97792fcd-abbc-4bb1-9b86-068d3294fe88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:40.725593 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbcd37b-b77d-4735-90b8-c1f1de7ca4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:40.725911 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97792fcd-abbc-4bb1-9b86-068d3294fe88 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:40.726241 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcd37b-b77d-4735-90b8-c1f1de7ca4b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:40.726560 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcd37b-b77d-4735-90b8-c1f1de7ca4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:40.726836 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbcd37b-b77d-4735-90b8-c1f1de7ca4b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:40.727559 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbcd37b-b77d-4735-90b8-c1f1de7ca4b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:40.729140 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbcd37b-b77d-4735-90b8-c1f1de7ca4b3 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:40.739455 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 784/1585] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:43:40.740156 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbcd37b-b77d-4735-90b8-c1f1de7ca4b3 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:40.748313 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 802/1586] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:43:40 2022] POST /identity/v3/users => generated 297 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:43:40.749313 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97792fcd-abbc-4bb1-9b86-068d3294fe88 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:40.750184 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbcd37b-b77d-4735-90b8-c1f1de7ca4b3 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:40.756385 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e6c9b-5516-4237-a37f-38af1138c2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:40.757043 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e6c9b-5516-4237-a37f-38af1138c2e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:40.757340 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e6c9b-5516-4237-a37f-38af1138c2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:40.757625 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e6c9b-5516-4237-a37f-38af1138c2e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:40.758342 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36e6c9b-5516-4237-a37f-38af1138c2e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:40.759298 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97792fcd-abbc-4bb1-9b86-068d3294fe88 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:40.760299 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36e6c9b-5516-4237-a37f-38af1138c2e7 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:40.763782 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2da81-662f-4516-b160-88ef63469db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:40.764637 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2da81-662f-4516-b160-88ef63469db3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:40.764918 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2da81-662f-4516-b160-88ef63469db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:40.765196 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c2da81-662f-4516-b160-88ef63469db3 admin admin] PATH_INFO: `/v3/projects/ced45f70652d421fb0c15d020272524c/users/0a3abacc4cce483f8b0d5fc00b20f7f1/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:40.781049 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 785/1587] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:43:40 2022] POST /identity/v3/users => generated 289 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:43:40.781804 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2da81-662f-4516-b160-88ef63469db3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ced45f70652d421fb0c15d020272524c, user_id=0a3abacc4cce483f8b0d5fc00b20f7f1, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:40.783340 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e6c9b-5516-4237-a37f-38af1138c2e7 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:40.784661 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c2da81-662f-4516-b160-88ef63469db3 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:40.794953 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e6c9b-5516-4237-a37f-38af1138c2e7 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:40.798768 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 803/1588] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:43:40 2022] PUT /identity/v3/projects/ced45f70652d421fb0c15d020272524c/users/0a3abacc4cce483f8b0d5fc00b20f7f1/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:43:40.808035 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2da81-662f-4516-b160-88ef63469db3 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:40.861265 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a57bd30-e002-4a7a-a0a1-ce99197683f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:40.861528 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c2da81-662f-4516-b160-88ef63469db3 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:40.861948 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57bd30-e002-4a7a-a0a1-ce99197683f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:40.862232 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57bd30-e002-4a7a-a0a1-ce99197683f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:40.862539 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57bd30-e002-4a7a-a0a1-ce99197683f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:40.863271 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a57bd30-e002-4a7a-a0a1-ce99197683f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:40.865529 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a57bd30-e002-4a7a-a0a1-ce99197683f1 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:40.865807 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe258b8-c513-4554-afcb-fea48f16d258 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:40.866469 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe258b8-c513-4554-afcb-fea48f16d258 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:40.866838 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe258b8-c513-4554-afcb-fea48f16d258 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:40.867119 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe258b8-c513-4554-afcb-fea48f16d258 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:40.875619 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 786/1589] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:43:40.876532 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a57bd30-e002-4a7a-a0a1-ce99197683f1 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:40.876645 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe258b8-c513-4554-afcb-fea48f16d258 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:40.877979 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe258b8-c513-4554-afcb-fea48f16d258 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:40.885727 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a57bd30-e002-4a7a-a0a1-ce99197683f1 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:40.887938 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 804/1590] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:43:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:43:40.888822 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe258b8-c513-4554-afcb-fea48f16d258 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:40.890307 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3c152-30ae-484d-aaef-4046d75a7c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:40.890985 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3c152-30ae-484d-aaef-4046d75a7c9b admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:40.891275 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3c152-30ae-484d-aaef-4046d75a7c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:40.891549 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f3c152-30ae-484d-aaef-4046d75a7c9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:40.892272 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f3c152-30ae-484d-aaef-4046d75a7c9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:40.893863 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f3c152-30ae-484d-aaef-4046d75a7c9b admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:40.898040 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe258b8-c513-4554-afcb-fea48f16d258 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:40.902674 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a244a62-f7a9-4e70-b399-9bd9ac158e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:40.903495 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a244a62-f7a9-4e70-b399-9bd9ac158e56 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:40.903621 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a244a62-f7a9-4e70-b399-9bd9ac158e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:40.903989 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a244a62-f7a9-4e70-b399-9bd9ac158e56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:40.907513 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 787/1591] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:43:40.907666 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a244a62-f7a9-4e70-b399-9bd9ac158e56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:40.907764 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3c152-30ae-484d-aaef-4046d75a7c9b admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:40.907854 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a244a62-f7a9-4e70-b399-9bd9ac158e56 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:40.918906 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 805/1592] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:43:40.919430 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f3c152-30ae-484d-aaef-4046d75a7c9b admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:40.919769 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a244a62-f7a9-4e70-b399-9bd9ac158e56 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:40.927111 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00042f09-2a6d-4dc9-91e5-35ad484c560d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:40.928667 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00042f09-2a6d-4dc9-91e5-35ad484c560d admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:40.928956 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00042f09-2a6d-4dc9-91e5-35ad484c560d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:40.929235 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00042f09-2a6d-4dc9-91e5-35ad484c560d admin admin] PATH_INFO: `/v3/projects/f02699f74178467eb83c7ca2d4983e11/users/40f25c01cf9f40d99bccb31dbc7ea5bc/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:40.931948 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a244a62-f7a9-4e70-b399-9bd9ac158e56 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:40.938068 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c028971-23a2-48c9-9d5d-9ed23a446ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:40.938872 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c028971-23a2-48c9-9d5d-9ed23a446ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:40.939241 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c028971-23a2-48c9-9d5d-9ed23a446ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:40.939523 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c028971-23a2-48c9-9d5d-9ed23a446ab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:40.940236 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c028971-23a2-48c9-9d5d-9ed23a446ab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:40.941863 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c028971-23a2-48c9-9d5d-9ed23a446ab0 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:40.952611 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 806/1593] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:43:40.953124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c028971-23a2-48c9-9d5d-9ed23a446ab0 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:40.958576 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00042f09-2a6d-4dc9-91e5-35ad484c560d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f02699f74178467eb83c7ca2d4983e11, user_id=40f25c01cf9f40d99bccb31dbc7ea5bc, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:40.964061 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00042f09-2a6d-4dc9-91e5-35ad484c560d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:40.966298 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c028971-23a2-48c9-9d5d-9ed23a446ab0 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:40.971712 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de6eb14-0d14-4466-adc7-80b581fecd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:40.972726 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6eb14-0d14-4466-adc7-80b581fecd25 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:40.972726 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6eb14-0d14-4466-adc7-80b581fecd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:40.973661 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6eb14-0d14-4466-adc7-80b581fecd25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:40.974448 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de6eb14-0d14-4466-adc7-80b581fecd25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:40.976218 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de6eb14-0d14-4466-adc7-80b581fecd25 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:40.981013 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 788/1594] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:43:40 2022] PUT /identity/v3/projects/f02699f74178467eb83c7ca2d4983e11/users/40f25c01cf9f40d99bccb31dbc7ea5bc/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:43:40.993180 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5db1e7-6fa2-4eb3-9509-1a1ade6a5775 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:40.993180 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5db1e7-6fa2-4eb3-9509-1a1ade6a5775 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:40.993180 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5db1e7-6fa2-4eb3-9509-1a1ade6a5775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:40.993542 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 807/1595] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:43:40.993542 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de6eb14-0d14-4466-adc7-80b581fecd25 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:41.004642 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de6eb14-0d14-4466-adc7-80b581fecd25 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:41.023308 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-2c5db1e7-6fa2-4eb3-9509-1a1ade6a5775 None None] MFA Rules not processed for user `0a3abacc4cce483f8b0d5fc00b20f7f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:41.024693 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2c5db1e7-6fa2-4eb3-9509-1a1ade6a5775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:41.076779 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a50f12-cb83-4590-afb8-e67dd8df760e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:41.077672 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a50f12-cb83-4590-afb8-e67dd8df760e admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:41.078037 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a50f12-cb83-4590-afb8-e67dd8df760e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:41.078228 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a50f12-cb83-4590-afb8-e67dd8df760e admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:41.079024 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a50f12-cb83-4590-afb8-e67dd8df760e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:41.080609 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a50f12-cb83-4590-afb8-e67dd8df760e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:41.095855 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 808/1596] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:43:40 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:43:41.095855 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a50f12-cb83-4590-afb8-e67dd8df760e admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:41.103953 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 789/1597] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:43:40 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:43:41.104898 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5db1e7-6fa2-4eb3-9509-1a1ade6a5775 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:41.107224 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a50f12-cb83-4590-afb8-e67dd8df760e admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:41.112322 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e960a7ba-374e-418a-a3c3-2607c087dcec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:41.112928 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960a7ba-374e-418a-a3c3-2607c087dcec admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:41.113216 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960a7ba-374e-418a-a3c3-2607c087dcec admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:41.113516 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960a7ba-374e-418a-a3c3-2607c087dcec admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:41.114855 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e960a7ba-374e-418a-a3c3-2607c087dcec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:41.116447 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e960a7ba-374e-418a-a3c3-2607c087dcec admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:41.117018 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5db1e7-6fa2-4eb3-9509-1a1ade6a5775 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:41.121909 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873bcfc-bbdd-4252-9d12-581e9b201215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:41.122635 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873bcfc-bbdd-4252-9d12-581e9b201215 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:41.122916 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873bcfc-bbdd-4252-9d12-581e9b201215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:41.123188 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873bcfc-bbdd-4252-9d12-581e9b201215 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:41.124036 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5873bcfc-bbdd-4252-9d12-581e9b201215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:41.125524 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5873bcfc-bbdd-4252-9d12-581e9b201215 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:41.127759 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 809/1598] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:43:41.128542 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e960a7ba-374e-418a-a3c3-2607c087dcec admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:41.137673 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 790/1599] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:43:41.138906 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873bcfc-bbdd-4252-9d12-581e9b201215 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:41.139545 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e960a7ba-374e-418a-a3c3-2607c087dcec admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:41.145846 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b391808f-82a4-4cde-94ab-02a09d381368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:41.146543 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391808f-82a4-4cde-94ab-02a09d381368 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:41.146835 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391808f-82a4-4cde-94ab-02a09d381368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:41.147116 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391808f-82a4-4cde-94ab-02a09d381368 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:41.147971 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b391808f-82a4-4cde-94ab-02a09d381368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:41.149615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b391808f-82a4-4cde-94ab-02a09d381368 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:41.149823 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873bcfc-bbdd-4252-9d12-581e9b201215 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:41.154507 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff33ad5-4d59-41bd-ac73-b8191d3cb4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:41.155173 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff33ad5-4d59-41bd-ac73-b8191d3cb4e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:41.155288 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:43:41.155453 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff33ad5-4d59-41bd-ac73-b8191d3cb4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:41.155733 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff33ad5-4d59-41bd-ac73-b8191d3cb4e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:41.156701 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff33ad5-4d59-41bd-ac73-b8191d3cb4e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:41.158291 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff33ad5-4d59-41bd-ac73-b8191d3cb4e7 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:41.160324 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:43:41.161726 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 810/1600] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:43:41.163106 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cb93f-1651-4012-967b-f671647bf728 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:41.163972 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cb93f-1651-4012-967b-f671647bf728 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:41.164177 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cb93f-1651-4012-967b-f671647bf728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:41.175819 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 791/1601] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:43:41.177020 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff33ad5-4d59-41bd-ac73-b8191d3cb4e7 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:41.189725 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff33ad5-4d59-41bd-ac73-b8191d3cb4e7 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:41.194886 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c220078a-c220-4e70-b10e-364da70203cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:41.195059 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-cc0cb93f-1651-4012-967b-f671647bf728 None None] MFA Rules not processed for user `40f25c01cf9f40d99bccb31dbc7ea5bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:41.196490 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-cc0cb93f-1651-4012-967b-f671647bf728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:41.196649 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220078a-c220-4e70-b10e-364da70203cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:41.197086 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220078a-c220-4e70-b10e-364da70203cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:41.197513 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220078a-c220-4e70-b10e-364da70203cf admin admin] PATH_INFO: `/v3/projects/2ec8416eb9644c858b0bf3556ad0dfd2/users/52f492a1c5f5474d86a6ac8f0348321b/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:41.216574 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c220078a-c220-4e70-b10e-364da70203cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ec8416eb9644c858b0bf3556ad0dfd2, user_id=52f492a1c5f5474d86a6ac8f0348321b, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:41.222158 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c220078a-c220-4e70-b10e-364da70203cf admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:41.241825 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 792/1602] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:43:41 2022] PUT /identity/v3/projects/2ec8416eb9644c858b0bf3556ad0dfd2/users/52f492a1c5f5474d86a6ac8f0348321b/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:43:41.242548 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c220078a-c220-4e70-b10e-364da70203cf admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:41.306158 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 811/1603] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:43:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:43:41.307428 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0cb93f-1651-4012-967b-f671647bf728 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:41.323784 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c220078a-c220-4e70-b10e-364da70203cf admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:41.326814 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0cb93f-1651-4012-967b-f671647bf728 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:41.329243 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298defd6-b7d9-45d5-b86d-e8167cc73713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:41.329977 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298defd6-b7d9-45d5-b86d-e8167cc73713 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:41.330652 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298defd6-b7d9-45d5-b86d-e8167cc73713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:41.330652 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298defd6-b7d9-45d5-b86d-e8167cc73713 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:41.331238 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298defd6-b7d9-45d5-b86d-e8167cc73713 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:41.334174 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298defd6-b7d9-45d5-b86d-e8167cc73713 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:41.334800 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f22442-a75e-4276-9aef-394924fbdc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:41.336134 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f22442-a75e-4276-9aef-394924fbdc2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:41.336973 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f22442-a75e-4276-9aef-394924fbdc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:41.337579 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f22442-a75e-4276-9aef-394924fbdc2e admin admin] PATH_INFO: `/v3/projects/a2312da8ff744f4696155fb35dfaa624/users/f67a24a3511e449e9d1264b7f038dec7/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:41.363132 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f22442-a75e-4276-9aef-394924fbdc2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2312da8ff744f4696155fb35dfaa624, user_id=f67a24a3511e449e9d1264b7f038dec7, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:41.366665 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f22442-a75e-4276-9aef-394924fbdc2e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:41.373734 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 793/1604] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:43:41 2022] POST /identity/v3/projects => generated 405 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:43:41.374848 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298defd6-b7d9-45d5-b86d-e8167cc73713 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:41.382367 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 812/1605] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:43:41 2022] PUT /identity/v3/projects/a2312da8ff744f4696155fb35dfaa624/users/f67a24a3511e449e9d1264b7f038dec7/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:43:41.392314 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f22442-a75e-4276-9aef-394924fbdc2e admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:41.447124 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298defd6-b7d9-45d5-b86d-e8167cc73713 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:41.461144 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f22442-a75e-4276-9aef-394924fbdc2e admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:41.466045 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56201ed-8653-48aa-929b-48524147c95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:41.467049 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56201ed-8653-48aa-929b-48524147c95b admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:41.467401 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56201ed-8653-48aa-929b-48524147c95b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:41.467746 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56201ed-8653-48aa-929b-48524147c95b admin admin] PATH_INFO: `/v3/projects/04cb7afd9f9d4475b155bc5aa4292812/users/8d4f1b27da1540339cb16efcb079135f/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:41.485686 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56201ed-8653-48aa-929b-48524147c95b admin admin] RBAC: Authorizing `identity:create_grant(project_id=04cb7afd9f9d4475b155bc5aa4292812, user_id=8d4f1b27da1540339cb16efcb079135f, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:41.488412 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56201ed-8653-48aa-929b-48524147c95b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:41.502908 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 813/1606] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:43:41 2022] PUT /identity/v3/projects/04cb7afd9f9d4475b155bc5aa4292812/users/8d4f1b27da1540339cb16efcb079135f/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:43:41.503784 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56201ed-8653-48aa-929b-48524147c95b admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:41.512652 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9efef0-6508-4601-9ef2-e3e30b42e50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:41.513720 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9efef0-6508-4601-9ef2-e3e30b42e50f admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:41.514183 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9efef0-6508-4601-9ef2-e3e30b42e50f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:41.514355 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9efef0-6508-4601-9ef2-e3e30b42e50f admin admin] PATH_INFO: `/v3/projects/ebf27116f2c941ab9403e09b895c30a0/users/e8789af4d36544a3a8037e0dba0d51ea/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:41.524409 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:43:41.545259 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9efef0-6508-4601-9ef2-e3e30b42e50f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebf27116f2c941ab9403e09b895c30a0, user_id=e8789af4d36544a3a8037e0dba0d51ea, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:41.548103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9efef0-6508-4601-9ef2-e3e30b42e50f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:41.564609 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:43:41.565073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 794/1607] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:43:41 2022] PUT /identity/v3/projects/ebf27116f2c941ab9403e09b895c30a0/users/e8789af4d36544a3a8037e0dba0d51ea/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:43:41.567240 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990697a-6325-4a34-943f-03d0ba358103 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:41.567651 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990697a-6325-4a34-943f-03d0ba358103 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:41.568074 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990697a-6325-4a34-943f-03d0ba358103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:41.582987 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56201ed-8653-48aa-929b-48524147c95b admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:41.591140 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-a990697a-6325-4a34-943f-03d0ba358103 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:41.593412 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a990697a-6325-4a34-943f-03d0ba358103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:41.649158 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ec0de-210f-4efd-a690-749fc899423d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:41.650413 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ec0de-210f-4efd-a690-749fc899423d admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:41.650791 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ec0de-210f-4efd-a690-749fc899423d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:41.651158 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ec0de-210f-4efd-a690-749fc899423d admin admin] PATH_INFO: `/v3/projects/ad4573721ab64d3fafd600f9ef4f966a/users/9f13db57fa094debba1664160b6c4b46/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:41.672046 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ec0de-210f-4efd-a690-749fc899423d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad4573721ab64d3fafd600f9ef4f966a, user_id=9f13db57fa094debba1664160b6c4b46, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:41.675121 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ec0de-210f-4efd-a690-749fc899423d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:41.682620 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 795/1608] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:43:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:43:41.684066 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0122dc30-a253-476a-bf4a-a048f0039a97 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:41.684363 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0122dc30-a253-476a-bf4a-a048f0039a97 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:41.684650 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0122dc30-a253-476a-bf4a-a048f0039a97 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:41.686001 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 796/1609] 10.222.0.20 () {54 vars in 962 bytes} [Thu Jul 21 03:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:43:41.686718 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0122dc30-a253-476a-bf4a-a048f0039a97 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:41.706970 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0122dc30-a253-476a-bf4a-a048f0039a97 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:41.715202 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 814/1610] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:43:41 2022] PUT /identity/v3/projects/ad4573721ab64d3fafd600f9ef4f966a/users/9f13db57fa094debba1664160b6c4b46/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:43:41.716658 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fee21-7c2a-40dd-98dc-0d8d1a67391a None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:41.717022 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fee21-7c2a-40dd-98dc-0d8d1a67391a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:41.717493 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fee21-7c2a-40dd-98dc-0d8d1a67391a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:41.748721 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d20fee21-7c2a-40dd-98dc-0d8d1a67391a None None] MFA Rules not processed for user `f67a24a3511e449e9d1264b7f038dec7`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:41.751180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d20fee21-7c2a-40dd-98dc-0d8d1a67391a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:41.787001 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f1f1f0-d47a-4ec6-aaee-0de2cd291bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:41.788090 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1f1f0-d47a-4ec6-aaee-0de2cd291bce admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:41.788947 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1f1f0-d47a-4ec6-aaee-0de2cd291bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:41.789428 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1f1f0-d47a-4ec6-aaee-0de2cd291bce admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:41.790192 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f1f1f0-d47a-4ec6-aaee-0de2cd291bce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:41.793933 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f1f1f0-d47a-4ec6-aaee-0de2cd291bce admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:41.822715 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 797/1611] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:43:41 2022] POST /identity/v3/users => generated 309 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:43:41.824534 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5990b2c-1861-46bb-a2eb-73f5c38cfa21 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:41.824936 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5990b2c-1861-46bb-a2eb-73f5c38cfa21 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:41.825289 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5990b2c-1861-46bb-a2eb-73f5c38cfa21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:41.842425 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 815/1612] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:43:41 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:43:41.844186 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dea73-8d62-46c6-882e-88a7c219d06f None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:41.844618 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dea73-8d62-46c6-882e-88a7c219d06f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:41.845022 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dea73-8d62-46c6-882e-88a7c219d06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:41.850853 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c5990b2c-1861-46bb-a2eb-73f5c38cfa21 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:41.852077 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c5990b2c-1861-46bb-a2eb-73f5c38cfa21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:41.860183 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 798/1613] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:43:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:43:41.861615 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e12a7b-de70-4653-9f82-0efdff5d9f06 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:41.869973 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e12a7b-de70-4653-9f82-0efdff5d9f06 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:41.870568 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e12a7b-de70-4653-9f82-0efdff5d9f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:41.886164 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-293dea73-8d62-46c6-882e-88a7c219d06f None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:41.887716 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-293dea73-8d62-46c6-882e-88a7c219d06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:41.897027 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 816/1614] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:43:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:43:41.898080 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293dea73-8d62-46c6-882e-88a7c219d06f None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:41.899661 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-293dea73-8d62-46c6-882e-88a7c219d06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:41.918057 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c5e12a7b-de70-4653-9f82-0efdff5d9f06 None None] MFA Rules not processed for user `cefbe2d0c739428ab0d4dfeaed6c37ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:41.919435 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c5e12a7b-de70-4653-9f82-0efdff5d9f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:41.966790 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293dea73-8d62-46c6-882e-88a7c219d06f None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:41.971921 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0781d04-4948-4cef-9eb4-414d8d85a321 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:41.973695 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0781d04-4948-4cef-9eb4-414d8d85a321 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:41.974154 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0781d04-4948-4cef-9eb4-414d8d85a321 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:41.974787 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0781d04-4948-4cef-9eb4-414d8d85a321 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:41.987349 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0781d04-4948-4cef-9eb4-414d8d85a321 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:41.989427 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0781d04-4948-4cef-9eb4-414d8d85a321 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:41.995590 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:43:42.014194 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 817/1615] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:43:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:43:42.015725 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08c82c-1f7c-4f91-ad7c-83c4a0400821 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:42.016026 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08c82c-1f7c-4f91-ad7c-83c4a0400821 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:42.016312 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f08c82c-1f7c-4f91-ad7c-83c4a0400821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:42.018753 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 799/1616] 10.222.0.20 () {58 vars in 1059 bytes} [Thu Jul 21 03:43:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:43:42.020670 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e12a7b-de70-4653-9f82-0efdff5d9f06 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:42.035086 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e12a7b-de70-4653-9f82-0efdff5d9f06 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:42.041304 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:43:42.044719 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd00ad-1351-4927-91e6-491d430b84f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:42.045941 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd00ad-1351-4927-91e6-491d430b84f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:42.046620 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd00ad-1351-4927-91e6-491d430b84f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:42.047077 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd00ad-1351-4927-91e6-491d430b84f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:42.048781 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd00ad-1351-4927-91e6-491d430b84f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:42.052742 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd00ad-1351-4927-91e6-491d430b84f2 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:42.057489 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-6f08c82c-1f7c-4f91-ad7c-83c4a0400821 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:42.059206 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6f08c82c-1f7c-4f91-ad7c-83c4a0400821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:42.068582 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 800/1617] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:43:42.069595 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd00ad-1351-4927-91e6-491d430b84f2 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:42.070100 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 818/1618] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:43:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:43:42.071195 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f08c82c-1f7c-4f91-ad7c-83c4a0400821 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:42.084640 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f08c82c-1f7c-4f91-ad7c-83c4a0400821 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:42.089477 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd00ad-1351-4927-91e6-491d430b84f2 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:42.090058 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493f4bc-fb81-4ecc-a34c-fee8d4d61406 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:42.090925 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493f4bc-fb81-4ecc-a34c-fee8d4d61406 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:42.091332 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493f4bc-fb81-4ecc-a34c-fee8d4d61406 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:42.091846 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493f4bc-fb81-4ecc-a34c-fee8d4d61406 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:42.096006 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717fc3d0-d382-4d83-867d-2c37ff425770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:42.097225 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717fc3d0-d382-4d83-867d-2c37ff425770 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:42.098517 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717fc3d0-d382-4d83-867d-2c37ff425770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:42.099487 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717fc3d0-d382-4d83-867d-2c37ff425770 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:42.100355 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717fc3d0-d382-4d83-867d-2c37ff425770 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:42.102619 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717fc3d0-d382-4d83-867d-2c37ff425770 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:42.114516 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1493f4bc-fb81-4ecc-a34c-fee8d4d61406 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:42.116140 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1493f4bc-fb81-4ecc-a34c-fee8d4d61406 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:42.139173 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 801/1619] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:43:42 2022] POST /identity/v3/projects => generated 367 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:43:42.139361 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 819/1620] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:43:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:43:42.140042 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493f4bc-fb81-4ecc-a34c-fee8d4d61406 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:42.140646 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717fc3d0-d382-4d83-867d-2c37ff425770 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:42.154805 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493f4bc-fb81-4ecc-a34c-fee8d4d61406 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:42.255167 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717fc3d0-d382-4d83-867d-2c37ff425770 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:42.264417 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19809ad5-4a4e-4804-afc8-1106f6fb3801 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:42.266605 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19809ad5-4a4e-4804-afc8-1106f6fb3801 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:42.267024 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19809ad5-4a4e-4804-afc8-1106f6fb3801 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:42.267432 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19809ad5-4a4e-4804-afc8-1106f6fb3801 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:42.279407 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b2725d-0b13-4e17-bff3-b52bfdc061e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:42.280083 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2725d-0b13-4e17-bff3-b52bfdc061e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:42.280371 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2725d-0b13-4e17-bff3-b52bfdc061e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:42.280651 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2725d-0b13-4e17-bff3-b52bfdc061e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:42.352960 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19809ad5-4a4e-4804-afc8-1106f6fb3801 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:42.355091 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19809ad5-4a4e-4804-afc8-1106f6fb3801 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:42.386408 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 802/1621] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:43:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:43:42.390629 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19809ad5-4a4e-4804-afc8-1106f6fb3801 service nova] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:42.432100 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b2725d-0b13-4e17-bff3-b52bfdc061e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:42.434165 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b2725d-0b13-4e17-bff3-b52bfdc061e4 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:42.459379 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 820/1622] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:43:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:43:42.462154 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b2725d-0b13-4e17-bff3-b52bfdc061e4 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:42.481335 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b2725d-0b13-4e17-bff3-b52bfdc061e4 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:42.483960 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:43:42.493707 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5dc8f3-1984-48c1-bf44-b646dfb88fdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:42.494738 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5dc8f3-1984-48c1-bf44-b646dfb88fdc service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:42.497692 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5dc8f3-1984-48c1-bf44-b646dfb88fdc service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:42.498163 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19809ad5-4a4e-4804-afc8-1106f6fb3801 service nova] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:42.498877 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5dc8f3-1984-48c1-bf44-b646dfb88fdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:42.504645 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab42e1a-28cc-4520-99d9-17b27d273903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:42.505898 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab42e1a-28cc-4520-99d9-17b27d273903 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:42.506293 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab42e1a-28cc-4520-99d9-17b27d273903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:42.506725 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab42e1a-28cc-4520-99d9-17b27d273903 admin admin] PATH_INFO: `/v3/projects/c4b5f9e8100946879bbf678bd939db46/users/79b13365c2fe4def8b1acc79e1354213/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:42.521669 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5dc8f3-1984-48c1-bf44-b646dfb88fdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:42.523983 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5dc8f3-1984-48c1-bf44-b646dfb88fdc service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:42.526530 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab42e1a-28cc-4520-99d9-17b27d273903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4b5f9e8100946879bbf678bd939db46, user_id=79b13365c2fe4def8b1acc79e1354213, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:42.530272 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab42e1a-28cc-4520-99d9-17b27d273903 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:42.547844 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 803/1623] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:43:42 2022] PUT /identity/v3/projects/c4b5f9e8100946879bbf678bd939db46/users/79b13365c2fe4def8b1acc79e1354213/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:43:42.549028 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab42e1a-28cc-4520-99d9-17b27d273903 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:42.549936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 821/1624] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:43:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:43:42.555164 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5dc8f3-1984-48c1-bf44-b646dfb88fdc service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:42.576096 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5dc8f3-1984-48c1-bf44-b646dfb88fdc service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:42.701193 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab42e1a-28cc-4520-99d9-17b27d273903 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:42.715521 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f3487e-3f2f-4b8f-a9b2-293fb4291202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:42.715521 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f3487e-3f2f-4b8f-a9b2-293fb4291202 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:42.715521 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f3487e-3f2f-4b8f-a9b2-293fb4291202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:42.715521 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f3487e-3f2f-4b8f-a9b2-293fb4291202 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:42.715968 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f3487e-3f2f-4b8f-a9b2-293fb4291202 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:42.717140 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a5f41-63da-4d89-a2b9-4412cf97a832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:42.718167 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a5f41-63da-4d89-a2b9-4412cf97a832 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:42.718260 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a5f41-63da-4d89-a2b9-4412cf97a832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:42.718526 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a5f41-63da-4d89-a2b9-4412cf97a832 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:42.719278 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a5f41-63da-4d89-a2b9-4412cf97a832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:42.721073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f3487e-3f2f-4b8f-a9b2-293fb4291202 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:42.724262 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a5f41-63da-4d89-a2b9-4412cf97a832 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:42.742991 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 822/1625] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:43:42.745514 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a5f41-63da-4d89-a2b9-4412cf97a832 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:42.762238 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a5f41-63da-4d89-a2b9-4412cf97a832 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:42.770071 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90c7b6f-1fd8-4a14-81d2-69ade63d6ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:42.771335 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c7b6f-1fd8-4a14-81d2-69ade63d6ce0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:42.771707 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c7b6f-1fd8-4a14-81d2-69ade63d6ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:42.772129 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c7b6f-1fd8-4a14-81d2-69ade63d6ce0 admin admin] PATH_INFO: `/v3/projects/c4b5f9e8100946879bbf678bd939db46/users/79b13365c2fe4def8b1acc79e1354213/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:42.775677 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c7b6f-1fd8-4a14-81d2-69ade63d6ce0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4b5f9e8100946879bbf678bd939db46, user_id=79b13365c2fe4def8b1acc79e1354213, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:42.779823 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90c7b6f-1fd8-4a14-81d2-69ade63d6ce0 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:42.783316 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 804/1626] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:43:42 2022] POST /identity/v3/users => generated 290 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:43:42.786027 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f11c8-badc-4c47-a625-d4bc4de20726 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:42.787617 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f11c8-badc-4c47-a625-d4bc4de20726 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:42.788443 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f11c8-badc-4c47-a625-d4bc4de20726 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:42.790594 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 805/1627] 10.222.0.20 () {54 vars in 912 bytes} [Thu Jul 21 03:43:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:43:42.792066 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f11c8-badc-4c47-a625-d4bc4de20726 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:42.814014 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 823/1628] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:43:42 2022] PUT /identity/v3/projects/c4b5f9e8100946879bbf678bd939db46/users/79b13365c2fe4def8b1acc79e1354213/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:43:42.815784 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa46565-02e3-4951-92f2-af49e5b8f112 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:42.816075 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa46565-02e3-4951-92f2-af49e5b8f112 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:42.816356 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa46565-02e3-4951-92f2-af49e5b8f112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:42.827159 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:43:42.847706 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-9fa46565-02e3-4951-92f2-af49e5b8f112 None None] MFA Rules not processed for user `cefbe2d0c739428ab0d4dfeaed6c37ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:42.850527 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9fa46565-02e3-4951-92f2-af49e5b8f112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:42.925638 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f11c8-badc-4c47-a625-d4bc4de20726 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:42.931391 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2420efb7-1c2b-4ff0-a1ea-639f36c5f115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:42.932085 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420efb7-1c2b-4ff0-a1ea-639f36c5f115 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:42.932367 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420efb7-1c2b-4ff0-a1ea-639f36c5f115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:42.932652 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420efb7-1c2b-4ff0-a1ea-639f36c5f115 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:42.933407 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2420efb7-1c2b-4ff0-a1ea-639f36c5f115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:42.935098 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2420efb7-1c2b-4ff0-a1ea-639f36c5f115 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:42.952373 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 806/1629] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:43:42.954864 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c68ef-30ac-46d6-b57f-d84f157c4d14 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:42.955158 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c68ef-30ac-46d6-b57f-d84f157c4d14 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:42.955441 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0c68ef-30ac-46d6-b57f-d84f157c4d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:42.978977 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 824/1630] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jul 21 03:43:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:43:42.980887 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa46565-02e3-4951-92f2-af49e5b8f112 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:43.002857 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-0d0c68ef-30ac-46d6-b57f-d84f157c4d14 None None] MFA Rules not processed for user `79b13365c2fe4def8b1acc79e1354213`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:43.004801 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0d0c68ef-30ac-46d6-b57f-d84f157c4d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:43.010493 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa46565-02e3-4951-92f2-af49e5b8f112 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:43.024145 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f121f96-9872-4c3d-9823-d35323e179b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:43.025938 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f121f96-9872-4c3d-9823-d35323e179b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:43.101691 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f121f96-9872-4c3d-9823-d35323e179b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:43.101691 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f121f96-9872-4c3d-9823-d35323e179b1 admin admin] PATH_INFO: `/v3/projects/6fdb19e2a04b4e6992dcf30e5894adc5/users/d77cccfd49104eb8bd5b42726c76b8d1/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:43.101691 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f121f96-9872-4c3d-9823-d35323e179b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fdb19e2a04b4e6992dcf30e5894adc5, user_id=d77cccfd49104eb8bd5b42726c76b8d1, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:43.102520 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:43:43.102922 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f121f96-9872-4c3d-9823-d35323e179b1 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:43.119532 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 825/1631] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:43:42 2022] PUT /identity/v3/projects/6fdb19e2a04b4e6992dcf30e5894adc5/users/d77cccfd49104eb8bd5b42726c76b8d1/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:43:43.121327 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f121f96-9872-4c3d-9823-d35323e179b1 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:43.160395 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 807/1632] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:43:42 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:43:43.165350 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c68ef-30ac-46d6-b57f-d84f157c4d14 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:43.183072 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0c68ef-30ac-46d6-b57f-d84f157c4d14 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:43.213305 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f121f96-9872-4c3d-9823-d35323e179b1 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:43.217353 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c147458-840a-4c00-ad77-63d956296398 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:43.218069 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c147458-840a-4c00-ad77-63d956296398 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:43.218352 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c147458-840a-4c00-ad77-63d956296398 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:43.218662 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c147458-840a-4c00-ad77-63d956296398 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:43.336881 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f14c5-eed2-4b0e-bf85-63d585215ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:43.338507 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f14c5-eed2-4b0e-bf85-63d585215ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:43.338878 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f14c5-eed2-4b0e-bf85-63d585215ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:43.339500 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f14c5-eed2-4b0e-bf85-63d585215ba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:43.340301 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f14c5-eed2-4b0e-bf85-63d585215ba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:43.342097 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c147458-840a-4c00-ad77-63d956296398 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:43.342789 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f14c5-eed2-4b0e-bf85-63d585215ba7 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:43.345330 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c147458-840a-4c00-ad77-63d956296398 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:43.361975 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 808/1633] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:43:43 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:43:43.363021 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f14c5-eed2-4b0e-bf85-63d585215ba7 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:43.373026 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 826/1634] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:43:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:43:43.374547 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c147458-840a-4c00-ad77-63d956296398 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:43.390232 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f14c5-eed2-4b0e-bf85-63d585215ba7 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:43.399707 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c147458-840a-4c00-ad77-63d956296398 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:43.401997 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc8583-ffb4-4b1f-84f4-525359af984e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:43.402810 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc8583-ffb4-4b1f-84f4-525359af984e service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:43.403103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc8583-ffb4-4b1f-84f4-525359af984e service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:43.403384 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc8583-ffb4-4b1f-84f4-525359af984e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:43.413465 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7fe5a-ed91-4090-b832-d5510ffeaa71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:43.415961 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7fe5a-ed91-4090-b832-d5510ffeaa71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:43.416253 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7fe5a-ed91-4090-b832-d5510ffeaa71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:43.416538 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7fe5a-ed91-4090-b832-d5510ffeaa71 admin admin] PATH_INFO: `/v3/projects/6fdb19e2a04b4e6992dcf30e5894adc5/users/d77cccfd49104eb8bd5b42726c76b8d1/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:43.423367 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7fe5a-ed91-4090-b832-d5510ffeaa71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fdb19e2a04b4e6992dcf30e5894adc5, user_id=d77cccfd49104eb8bd5b42726c76b8d1, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:43.430256 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7fe5a-ed91-4090-b832-d5510ffeaa71 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:43.448416 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:43:43.459521 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 827/1635] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:43:43 2022] PUT /identity/v3/projects/6fdb19e2a04b4e6992dcf30e5894adc5/users/d77cccfd49104eb8bd5b42726c76b8d1/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:43:43.469693 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c9493-cb19-44ba-bc97-46686660cff9 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:43.469987 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c9493-cb19-44ba-bc97-46686660cff9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:43.470266 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c9493-cb19-44ba-bc97-46686660cff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:43.535074 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-c24c9493-cb19-44ba-bc97-46686660cff9 None None] MFA Rules not processed for user `d77cccfd49104eb8bd5b42726c76b8d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:43.538098 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c24c9493-cb19-44ba-bc97-46686660cff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:43.546915 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc8583-ffb4-4b1f-84f4-525359af984e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:43.548455 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cc8583-ffb4-4b1f-84f4-525359af984e service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:43.563557 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 809/1636] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:43:43 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:43:43.697235 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 828/1637] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:43:43 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:43:43.732657 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc8583-ffb4-4b1f-84f4-525359af984e service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:43.744866 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc8583-ffb4-4b1f-84f4-525359af984e service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:43.884533 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cbfea-ed0d-4272-8e54-b70f0b046e56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:43.885300 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cbfea-ed0d-4272-8e54-b70f0b046e56 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:43.885655 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cbfea-ed0d-4272-8e54-b70f0b046e56 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:43.886237 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cbfea-ed0d-4272-8e54-b70f0b046e56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:43.901950 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557cbfea-ed0d-4272-8e54-b70f0b046e56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:43.904441 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557cbfea-ed0d-4272-8e54-b70f0b046e56 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:43.950408 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 810/1638] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:43:43 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:43:44.079420 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c9493-cb19-44ba-bc97-46686660cff9 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:44.091245 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c9493-cb19-44ba-bc97-46686660cff9 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:44.106311 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7f8d2-0de8-4b79-a288-865b142a4cb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:44.108440 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7f8d2-0de8-4b79-a288-865b142a4cb9 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:44.109434 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7f8d2-0de8-4b79-a288-865b142a4cb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:44.109854 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7f8d2-0de8-4b79-a288-865b142a4cb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:44.223988 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa7f8d2-0de8-4b79-a288-865b142a4cb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:44.225302 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa7f8d2-0de8-4b79-a288-865b142a4cb9 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:44.248920 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 829/1639] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:43:44 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:43:44.388915 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cbfea-ed0d-4272-8e54-b70f0b046e56 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:44.444709 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:43:44.556164 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cbfea-ed0d-4272-8e54-b70f0b046e56 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:44.569426 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f51b9d-8740-40ac-8a4e-1603b44744b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:44.570993 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f51b9d-8740-40ac-8a4e-1603b44744b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:44.571491 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f51b9d-8740-40ac-8a4e-1603b44744b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:44.571996 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f51b9d-8740-40ac-8a4e-1603b44744b6 admin admin] PATH_INFO: `/v3/users/0a3abacc4cce483f8b0d5fc00b20f7f1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:44.573578 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f51b9d-8740-40ac-8a4e-1603b44744b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a3abacc4cce483f8b0d5fc00b20f7f1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:44.575904 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f51b9d-8740-40ac-8a4e-1603b44744b6 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:44.685472 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-86f51b9d-8740-40ac-8a4e-1603b44744b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a3abacc4cce483f8b0d5fc00b20f7f1'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:44.686268 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-86f51b9d-8740-40ac-8a4e-1603b44744b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a3abacc4cce483f8b0d5fc00b20f7f1'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:44.686987 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-86f51b9d-8740-40ac-8a4e-1603b44744b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a3abacc4cce483f8b0d5fc00b20f7f1'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:44.715188 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-86f51b9d-8740-40ac-8a4e-1603b44744b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a3abacc4cce483f8b0d5fc00b20f7f1'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:44.735592 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-86f51b9d-8740-40ac-8a4e-1603b44744b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a3abacc4cce483f8b0d5fc00b20f7f1'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:44.776979 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 811/1640] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:43:44 2022] DELETE /identity/v3/users/0a3abacc4cce483f8b0d5fc00b20f7f1 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:43:44.781256 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baffa72-3eea-4962-8268-b74d1837108b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:44.782186 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baffa72-3eea-4962-8268-b74d1837108b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:44.782186 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baffa72-3eea-4962-8268-b74d1837108b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:44.824304 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-6baffa72-3eea-4962-8268-b74d1837108b None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:44.826429 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6baffa72-3eea-4962-8268-b74d1837108b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:45.020649 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 830/1641] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:43:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:43:45.033756 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f51b9d-8740-40ac-8a4e-1603b44744b6 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:45.035754 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-86f51b9d-8740-40ac-8a4e-1603b44744b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:45.193250 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdd17d-e03f-4318-9a2b-02886829b162 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:45.193543 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdd17d-e03f-4318-9a2b-02886829b162 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:45.193831 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdd17d-e03f-4318-9a2b-02886829b162 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:45.195779 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 831/1642] 10.222.0.20 () {54 vars in 962 bytes} [Thu Jul 21 03:43:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 03:43:45.212539 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f51b9d-8740-40ac-8a4e-1603b44744b6 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:45.225270 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6f37c-7a24-45d4-bc64-fa624c95bc7c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:45.225597 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6f37c-7a24-45d4-bc64-fa624c95bc7c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:45.226030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6f37c-7a24-45d4-bc64-fa624c95bc7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:45.231725 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b0efd1-5820-4e96-9041-4b57a87a3d2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:45.232712 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0efd1-5820-4e96-9041-4b57a87a3d2c service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:45.232712 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0efd1-5820-4e96-9041-4b57a87a3d2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:45.233028 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b0efd1-5820-4e96-9041-4b57a87a3d2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:45.286679 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-abc6f37c-7a24-45d4-bc64-fa624c95bc7c None None] MFA Rules not processed for user `cefbe2d0c739428ab0d4dfeaed6c37ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:45.293605 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-abc6f37c-7a24-45d4-bc64-fa624c95bc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:45.295350 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b0efd1-5820-4e96-9041-4b57a87a3d2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:45.300969 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b0efd1-5820-4e96-9041-4b57a87a3d2c service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:45.346222 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 812/1643] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:43:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:43:45.357916 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:43:45.468351 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac63f23-2d64-484e-a44c-42e5723c8cad None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:45.469840 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac63f23-2d64-484e-a44c-42e5723c8cad None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:45.470302 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac63f23-2d64-484e-a44c-42e5723c8cad None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:45.473485 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 813/1644] 10.222.0.20 () {54 vars in 912 bytes} [Thu Jul 21 03:43:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:43:45.482545 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40f2fc-2cef-4170-a07f-d196d0562772 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:45.483167 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40f2fc-2cef-4170-a07f-d196d0562772 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:45.483867 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac40f2fc-2cef-4170-a07f-d196d0562772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:45.484006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 832/1645] 10.222.0.20 () {58 vars in 1059 bytes} [Thu Jul 21 03:43:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:43:45.523578 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ac40f2fc-2cef-4170-a07f-d196d0562772 None None] MFA Rules not processed for user `cefbe2d0c739428ab0d4dfeaed6c37ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:45.525219 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ac40f2fc-2cef-4170-a07f-d196d0562772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:45.555200 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 814/1646] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jul 21 03:43:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:43:45.560983 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6f37c-7a24-45d4-bc64-fa624c95bc7c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:45.563388 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-abc6f37c-7a24-45d4-bc64-fa624c95bc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:45.762045 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6f37c-7a24-45d4-bc64-fa624c95bc7c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:45.766915 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033125a-b3a4-4211-8588-6cd38f08614e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:45.767829 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033125a-b3a4-4211-8588-6cd38f08614e service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:45.768078 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033125a-b3a4-4211-8588-6cd38f08614e service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:45.768642 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033125a-b3a4-4211-8588-6cd38f08614e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:45.787348 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1033125a-b3a4-4211-8588-6cd38f08614e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:45.793783 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1033125a-b3a4-4211-8588-6cd38f08614e service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:45.797767 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814064c-da77-4270-bedc-9c4442b6b84e None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:45.798152 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814064c-da77-4270-bedc-9c4442b6b84e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:45.798681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814064c-da77-4270-bedc-9c4442b6b84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:45.833315 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 833/1647] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:43:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:43:45.842501 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-7814064c-da77-4270-bedc-9c4442b6b84e None None] MFA Rules not processed for user `e8789af4d36544a3a8037e0dba0d51ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:45.843645 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7814064c-da77-4270-bedc-9c4442b6b84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:45.900354 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:43:46.022508 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 815/1648] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:43:45 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:43:46.024100 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033125a-b3a4-4211-8588-6cd38f08614e service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:46.025691 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1033125a-b3a4-4211-8588-6cd38f08614e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:46.057150 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033125a-b3a4-4211-8588-6cd38f08614e service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:46.070443 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a227bd6-aed0-4c72-89da-4f5eecea2890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:46.072510 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a227bd6-aed0-4c72-89da-4f5eecea2890 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:46.072800 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a227bd6-aed0-4c72-89da-4f5eecea2890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:46.073075 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a227bd6-aed0-4c72-89da-4f5eecea2890 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:46.073780 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a227bd6-aed0-4c72-89da-4f5eecea2890 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:46.083600 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a227bd6-aed0-4c72-89da-4f5eecea2890 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:46.147673 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 834/1649] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:43:46 2022] POST /identity/v3/projects => generated 405 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:43:46.150882 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814064c-da77-4270-bedc-9c4442b6b84e None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:46.169339 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814064c-da77-4270-bedc-9c4442b6b84e None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:46.295960 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec53e3b-4b82-40e4-9916-a02cc7779131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:46.297140 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec53e3b-4b82-40e4-9916-a02cc7779131 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:46.297576 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec53e3b-4b82-40e4-9916-a02cc7779131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:46.297865 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec53e3b-4b82-40e4-9916-a02cc7779131 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:46.298614 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec53e3b-4b82-40e4-9916-a02cc7779131 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:46.306151 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec53e3b-4b82-40e4-9916-a02cc7779131 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:46.350018 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 816/1650] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:43:46 2022] POST /identity/v3/users => generated 309 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:43:46.354296 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a227bd6-aed0-4c72-89da-4f5eecea2890 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:46.371398 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a227bd6-aed0-4c72-89da-4f5eecea2890 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:46.390209 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e86aee-c790-4460-9d38-bdc51692248f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:46.392600 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e86aee-c790-4460-9d38-bdc51692248f admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:46.394500 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e86aee-c790-4460-9d38-bdc51692248f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:46.394500 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e86aee-c790-4460-9d38-bdc51692248f admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:46.407237 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e86aee-c790-4460-9d38-bdc51692248f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:46.417496 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e86aee-c790-4460-9d38-bdc51692248f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:46.464638 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 835/1651] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:43:46.465014 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec53e3b-4b82-40e4-9916-a02cc7779131 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:46.500904 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec53e3b-4b82-40e4-9916-a02cc7779131 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:46.540157 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a499d07-c4c2-4fa5-b9cc-d7811158c540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:46.541121 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a499d07-c4c2-4fa5-b9cc-d7811158c540 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:46.541411 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a499d07-c4c2-4fa5-b9cc-d7811158c540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:46.541694 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a499d07-c4c2-4fa5-b9cc-d7811158c540 admin admin] PATH_INFO: `/v3/projects/fb915d798de3451387a2721c0a220be7/users/3072d072c50d4df6a7d02ea74c1862f9/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:46.586267 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e86aee-c790-4460-9d38-bdc51692248f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:46.586267 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-71e86aee-c790-4460-9d38-bdc51692248f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:46.621436 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e86aee-c790-4460-9d38-bdc51692248f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:46.627702 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a499d07-c4c2-4fa5-b9cc-d7811158c540 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb915d798de3451387a2721c0a220be7, user_id=3072d072c50d4df6a7d02ea74c1862f9, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:46.636250 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a499d07-c4c2-4fa5-b9cc-d7811158c540 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:46.655009 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fb196-6c55-4406-b4fd-39f78aadf228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:46.655900 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fb196-6c55-4406-b4fd-39f78aadf228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:46.656252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fb196-6c55-4406-b4fd-39f78aadf228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:46.656817 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8fb196-6c55-4406-b4fd-39f78aadf228 admin admin] PATH_INFO: `/v3/projects/ced45f70652d421fb0c15d020272524c` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:46.665664 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8fb196-6c55-4406-b4fd-39f78aadf228 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ced45f70652d421fb0c15d020272524c)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:46.665664 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8fb196-6c55-4406-b4fd-39f78aadf228 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:46.694406 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 817/1652] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:43:46 2022] PUT /identity/v3/projects/fb915d798de3451387a2721c0a220be7/users/3072d072c50d4df6a7d02ea74c1862f9/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:43:46.703923 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a499d07-c4c2-4fa5-b9cc-d7811158c540 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:46.877610 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3b8fb196-6c55-4406-b4fd-39f78aadf228 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ced45f70652d421fb0c15d020272524c', 'request_id': 'req-3b8fb196-6c55-4406-b4fd-39f78aadf228'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:46.889394 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3b8fb196-6c55-4406-b4fd-39f78aadf228 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ced45f70652d421fb0c15d020272524c', 'request_id': 'req-3b8fb196-6c55-4406-b4fd-39f78aadf228'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:46.914985 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3b8fb196-6c55-4406-b4fd-39f78aadf228 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ced45f70652d421fb0c15d020272524c', 'request_id': 'req-3b8fb196-6c55-4406-b4fd-39f78aadf228'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:46.936323 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3b8fb196-6c55-4406-b4fd-39f78aadf228 admin admin] The token cache is being invalidate because project ced45f70652d421fb0c15d020272524c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:43:46.936635 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3b8fb196-6c55-4406-b4fd-39f78aadf228 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:46.937340 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3b8fb196-6c55-4406-b4fd-39f78aadf228 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:46.939445 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a499d07-c4c2-4fa5-b9cc-d7811158c540 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:46.942809 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 836/1653] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:43:46 2022] DELETE /identity/v3/projects/ced45f70652d421fb0c15d020272524c => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:43:46.946553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fb196-6c55-4406-b4fd-39f78aadf228 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:46.948788 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3b8fb196-6c55-4406-b4fd-39f78aadf228 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:46.980718 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:43:47.038929 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:43:47.104314 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7232c9-1509-4b1b-aa5d-814d12fc2f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:47.105010 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7232c9-1509-4b1b-aa5d-814d12fc2f3c admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:47.105298 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7232c9-1509-4b1b-aa5d-814d12fc2f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:47.105573 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7232c9-1509-4b1b-aa5d-814d12fc2f3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:47.106582 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7232c9-1509-4b1b-aa5d-814d12fc2f3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:47.108680 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7232c9-1509-4b1b-aa5d-814d12fc2f3c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:47.139893 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 818/1654] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 438 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:43:47.140787 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7232c9-1509-4b1b-aa5d-814d12fc2f3c admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:47.148533 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8fb196-6c55-4406-b4fd-39f78aadf228 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:47.151376 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-af7232c9-1509-4b1b-aa5d-814d12fc2f3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:47.162526 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14ee74-3997-436a-9561-19789f0b83ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:47.164491 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14ee74-3997-436a-9561-19789f0b83ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:47.164982 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14ee74-3997-436a-9561-19789f0b83ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:47.165411 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b14ee74-3997-436a-9561-19789f0b83ab admin admin] PATH_INFO: `/v3/users/79b13365c2fe4def8b1acc79e1354213` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:47.169423 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b14ee74-3997-436a-9561-19789f0b83ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=79b13365c2fe4def8b1acc79e1354213)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:47.173663 dv-cinder-850318-2-smb devstack@keystone.service[80332]: WARNING py.warnings [None req-4b14ee74-3997-436a-9561-19789f0b83ab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 03:43:47.173663 dv-cinder-850318-2-smb devstack@keystone.service[80332]: warnings.warn(msg) Jul 21 03:43:47.173663 dv-cinder-850318-2-smb devstack@keystone.service[80332]: Jul 21 03:43:47.175517 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b14ee74-3997-436a-9561-19789f0b83ab admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:47.184036 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7232c9-1509-4b1b-aa5d-814d12fc2f3c admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:47.196366 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf52f00-c96d-4c57-aa71-e5b16db03e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:47.201716 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf52f00-c96d-4c57-aa71-e5b16db03e1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:47.202143 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf52f00-c96d-4c57-aa71-e5b16db03e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:47.203388 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf52f00-c96d-4c57-aa71-e5b16db03e1c admin admin] PATH_INFO: `/v3/projects/fb915d798de3451387a2721c0a220be7/users/3072d072c50d4df6a7d02ea74c1862f9/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:47.208440 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf52f00-c96d-4c57-aa71-e5b16db03e1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb915d798de3451387a2721c0a220be7, user_id=3072d072c50d4df6a7d02ea74c1862f9, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:47.217929 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf52f00-c96d-4c57-aa71-e5b16db03e1c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:47.258119 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 819/1655] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:43:47 2022] PUT /identity/v3/projects/fb915d798de3451387a2721c0a220be7/users/3072d072c50d4df6a7d02ea74c1862f9/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:43:47.365230 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4b14ee74-3997-436a-9561-19789f0b83ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79b13365c2fe4def8b1acc79e1354213'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:47.366903 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4b14ee74-3997-436a-9561-19789f0b83ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79b13365c2fe4def8b1acc79e1354213'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:47.369473 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4b14ee74-3997-436a-9561-19789f0b83ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79b13365c2fe4def8b1acc79e1354213'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:47.409792 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4b14ee74-3997-436a-9561-19789f0b83ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79b13365c2fe4def8b1acc79e1354213'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:47.434271 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4b14ee74-3997-436a-9561-19789f0b83ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79b13365c2fe4def8b1acc79e1354213'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:47.530676 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 837/1656] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:43:46 2022] DELETE /identity/v3/users/79b13365c2fe4def8b1acc79e1354213 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:43:49.359804 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf52f00-c96d-4c57-aa71-e5b16db03e1c admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:49.361634 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ebf52f00-c96d-4c57-aa71-e5b16db03e1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:49.645553 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf52f00-c96d-4c57-aa71-e5b16db03e1c admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:49.880930 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f3392-400f-4edc-b098-24b3afcf8944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:49.881960 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f3392-400f-4edc-b098-24b3afcf8944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:49.882397 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f3392-400f-4edc-b098-24b3afcf8944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:49.882750 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f3392-400f-4edc-b098-24b3afcf8944 admin admin] PATH_INFO: `/v3/projects/c4b5f9e8100946879bbf678bd939db46` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:49.886527 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659f3392-400f-4edc-b098-24b3afcf8944 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4b5f9e8100946879bbf678bd939db46)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:49.887605 dv-cinder-850318-2-smb devstack@keystone.service[80331]: WARNING py.warnings [None req-659f3392-400f-4edc-b098-24b3afcf8944 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 03:43:49.887605 dv-cinder-850318-2-smb devstack@keystone.service[80331]: warnings.warn(msg) Jul 21 03:43:49.887605 dv-cinder-850318-2-smb devstack@keystone.service[80331]: Jul 21 03:43:49.888846 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659f3392-400f-4edc-b098-24b3afcf8944 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:50.067344 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-659f3392-400f-4edc-b098-24b3afcf8944 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4b5f9e8100946879bbf678bd939db46', 'request_id': 'req-659f3392-400f-4edc-b098-24b3afcf8944'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:50.108677 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14ee74-3997-436a-9561-19789f0b83ab admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:50.118717 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4b14ee74-3997-436a-9561-19789f0b83ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:50.127700 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-659f3392-400f-4edc-b098-24b3afcf8944 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4b5f9e8100946879bbf678bd939db46', 'request_id': 'req-659f3392-400f-4edc-b098-24b3afcf8944'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:50.149636 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b14ee74-3997-436a-9561-19789f0b83ab admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:50.152249 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-659f3392-400f-4edc-b098-24b3afcf8944 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4b5f9e8100946879bbf678bd939db46', 'request_id': 'req-659f3392-400f-4edc-b098-24b3afcf8944'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:50.163272 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:43:50.179642 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-659f3392-400f-4edc-b098-24b3afcf8944 admin admin] The token cache is being invalidate because project c4b5f9e8100946879bbf678bd939db46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:43:50.180711 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-659f3392-400f-4edc-b098-24b3afcf8944 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:50.182867 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-659f3392-400f-4edc-b098-24b3afcf8944 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:50.185476 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 820/1657] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:43:49 2022] DELETE /identity/v3/projects/c4b5f9e8100946879bbf678bd939db46 => generated 0 bytes in 826 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:43:50.190957 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f729ea-ddfe-4c74-b402-d578c524753f None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:50.191418 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f729ea-ddfe-4c74-b402-d578c524753f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:50.194388 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f729ea-ddfe-4c74-b402-d578c524753f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:50.230111 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-22f729ea-ddfe-4c74-b402-d578c524753f None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:50.233848 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-22f729ea-ddfe-4c74-b402-d578c524753f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:50.276343 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c086c-d70a-43ca-aa6a-6092102e7c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:50.280101 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c086c-d70a-43ca-aa6a-6092102e7c64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:50.280795 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c086c-d70a-43ca-aa6a-6092102e7c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:50.281297 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c086c-d70a-43ca-aa6a-6092102e7c64 admin admin] PATH_INFO: `/v3/users/f67a24a3511e449e9d1264b7f038dec7` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:50.286066 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c086c-d70a-43ca-aa6a-6092102e7c64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f67a24a3511e449e9d1264b7f038dec7)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:50.292250 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c086c-d70a-43ca-aa6a-6092102e7c64 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:50.345937 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 821/1658] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:43:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:43:50.349009 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afd053-d894-421a-a6d7-93ffc8c62e79 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:50.352626 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afd053-d894-421a-a6d7-93ffc8c62e79 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:50.355032 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afd053-d894-421a-a6d7-93ffc8c62e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:50.379870 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:43:50.409392 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a40c086c-d70a-43ca-aa6a-6092102e7c64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f67a24a3511e449e9d1264b7f038dec7'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:50.410708 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a40c086c-d70a-43ca-aa6a-6092102e7c64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f67a24a3511e449e9d1264b7f038dec7'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:50.410858 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a40c086c-d70a-43ca-aa6a-6092102e7c64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f67a24a3511e449e9d1264b7f038dec7'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:50.415963 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-19afd053-d894-421a-a6d7-93ffc8c62e79 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:50.418776 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-19afd053-d894-421a-a6d7-93ffc8c62e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:50.434967 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a40c086c-d70a-43ca-aa6a-6092102e7c64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f67a24a3511e449e9d1264b7f038dec7'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:50.443867 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 822/1659] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:43:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:43:50.446653 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a40c086c-d70a-43ca-aa6a-6092102e7c64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f67a24a3511e449e9d1264b7f038dec7'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:50.448625 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afd053-d894-421a-a6d7-93ffc8c62e79 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:50.469958 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afd053-d894-421a-a6d7-93ffc8c62e79 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:50.475891 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14eee36-b754-46a0-b274-702f756d1032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:50.476739 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14eee36-b754-46a0-b274-702f756d1032 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:50.477027 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14eee36-b754-46a0-b274-702f756d1032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:50.477302 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14eee36-b754-46a0-b274-702f756d1032 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:50.478047 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14eee36-b754-46a0-b274-702f756d1032 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:43:50.478355 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14eee36-b754-46a0-b274-702f756d1032 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:50.481785 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14eee36-b754-46a0-b274-702f756d1032 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:50.486715 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 838/1660] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:43:50 2022] DELETE /identity/v3/users/f67a24a3511e449e9d1264b7f038dec7 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:43:50.491422 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b692ef-fa11-4637-a136-49ef06a90ae7 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:50.491907 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b692ef-fa11-4637-a136-49ef06a90ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:50.492338 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b692ef-fa11-4637-a136-49ef06a90ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:50.497623 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 823/1661] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:43:50.505455 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14eee36-b754-46a0-b274-702f756d1032 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:50.520056 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14eee36-b754-46a0-b274-702f756d1032 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:50.533025 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-93b692ef-fa11-4637-a136-49ef06a90ae7 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:50.534299 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-93b692ef-fa11-4637-a136-49ef06a90ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:50.626901 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563a4e9-3e7a-47f3-9644-03c35f594d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:50.628006 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563a4e9-3e7a-47f3-9644-03c35f594d42 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:50.628435 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563a4e9-3e7a-47f3-9644-03c35f594d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:50.628718 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563a4e9-3e7a-47f3-9644-03c35f594d42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:50.631466 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6563a4e9-3e7a-47f3-9644-03c35f594d42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:50.636699 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6563a4e9-3e7a-47f3-9644-03c35f594d42 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:50.715558 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 824/1662] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:43:50 2022] POST /identity/v3/projects => generated 381 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:43:50.716701 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563a4e9-3e7a-47f3-9644-03c35f594d42 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:50.721284 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 839/1663] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:43:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:43:50.819092 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b692ef-fa11-4637-a136-49ef06a90ae7 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:50.826790 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-93b692ef-fa11-4637-a136-49ef06a90ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:50.912487 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563a4e9-3e7a-47f3-9644-03c35f594d42 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:50.931108 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927943fb-8689-409d-b876-c1c15a95cf84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:50.933558 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927943fb-8689-409d-b876-c1c15a95cf84 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:50.933558 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927943fb-8689-409d-b876-c1c15a95cf84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:50.947657 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927943fb-8689-409d-b876-c1c15a95cf84 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:50.951796 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927943fb-8689-409d-b876-c1c15a95cf84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:50.953848 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927943fb-8689-409d-b876-c1c15a95cf84 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:50.992573 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:43:51.054917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 825/1664] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:43:50 2022] POST /identity/v3/users => generated 291 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:43:51.058607 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927943fb-8689-409d-b876-c1c15a95cf84 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:51.098777 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927943fb-8689-409d-b876-c1c15a95cf84 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:51.103717 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b692ef-fa11-4637-a136-49ef06a90ae7 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:51.109865 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60710476-9ec3-47ad-bd45-13e7bd3a8fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:51.110591 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60710476-9ec3-47ad-bd45-13e7bd3a8fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:51.110882 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60710476-9ec3-47ad-bd45-13e7bd3a8fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:51.111161 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60710476-9ec3-47ad-bd45-13e7bd3a8fe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:51.111914 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60710476-9ec3-47ad-bd45-13e7bd3a8fe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:51.151276 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60710476-9ec3-47ad-bd45-13e7bd3a8fe6 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:51.201003 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 826/1665] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:43:51.201003 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60710476-9ec3-47ad-bd45-13e7bd3a8fe6 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:51.242491 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60710476-9ec3-47ad-bd45-13e7bd3a8fe6 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:51.264236 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a2a1b-1f15-4c75-973a-5132e15de7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:51.264933 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a2a1b-1f15-4c75-973a-5132e15de7f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:51.265219 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a2a1b-1f15-4c75-973a-5132e15de7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:51.265496 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a2a1b-1f15-4c75-973a-5132e15de7f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:51.266241 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a2a1b-1f15-4c75-973a-5132e15de7f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:51.267932 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a2a1b-1f15-4c75-973a-5132e15de7f6 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:51.286818 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 827/1666] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:43:51.287709 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a2a1b-1f15-4c75-973a-5132e15de7f6 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:51.289709 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-df9a2a1b-1f15-4c75-973a-5132e15de7f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:51.305855 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a2a1b-1f15-4c75-973a-5132e15de7f6 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:51.314528 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699bc2e-9971-4763-ad1f-0c1fe3aee24b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:51.315068 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699bc2e-9971-4763-ad1f-0c1fe3aee24b service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:51.315352 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699bc2e-9971-4763-ad1f-0c1fe3aee24b service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:51.315636 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8699bc2e-9971-4763-ad1f-0c1fe3aee24b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:51.327687 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14939ba2-b1d9-480c-9c69-83b91126d410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:51.328834 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14939ba2-b1d9-480c-9c69-83b91126d410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:51.332745 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14939ba2-b1d9-480c-9c69-83b91126d410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:51.333038 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14939ba2-b1d9-480c-9c69-83b91126d410 admin admin] PATH_INFO: `/v3/users/40f25c01cf9f40d99bccb31dbc7ea5bc` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:51.336695 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8699bc2e-9971-4763-ad1f-0c1fe3aee24b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:51.338356 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8699bc2e-9971-4763-ad1f-0c1fe3aee24b service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:51.343371 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14939ba2-b1d9-480c-9c69-83b91126d410 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40f25c01cf9f40d99bccb31dbc7ea5bc)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:51.352577 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14939ba2-b1d9-480c-9c69-83b91126d410 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:51.354197 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 840/1667] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:43:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 03:43:51.356171 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699bc2e-9971-4763-ad1f-0c1fe3aee24b service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:51.369137 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8699bc2e-9971-4763-ad1f-0c1fe3aee24b service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:51.392661 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba27b8-0c01-4de2-800d-90b6ada60143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:51.393907 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba27b8-0c01-4de2-800d-90b6ada60143 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:51.394347 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba27b8-0c01-4de2-800d-90b6ada60143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:51.395005 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba27b8-0c01-4de2-800d-90b6ada60143 admin admin] PATH_INFO: `/v3/projects/32fad15a4404418da143654da624421b/users/b2439d27586b4ee2b7be2169c7339779/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:51.399159 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:43:51.424355 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba27b8-0c01-4de2-800d-90b6ada60143 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32fad15a4404418da143654da624421b, user_id=b2439d27586b4ee2b7be2169c7339779, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:51.439976 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba27b8-0c01-4de2-800d-90b6ada60143 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:51.451696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-14939ba2-b1d9-480c-9c69-83b91126d410 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40f25c01cf9f40d99bccb31dbc7ea5bc'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:51.453299 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-14939ba2-b1d9-480c-9c69-83b91126d410 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40f25c01cf9f40d99bccb31dbc7ea5bc'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:51.454264 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-14939ba2-b1d9-480c-9c69-83b91126d410 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40f25c01cf9f40d99bccb31dbc7ea5bc'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:51.470182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 841/1668] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:43:51 2022] PUT /identity/v3/projects/32fad15a4404418da143654da624421b/users/b2439d27586b4ee2b7be2169c7339779/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:43:51.475337 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-14939ba2-b1d9-480c-9c69-83b91126d410 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40f25c01cf9f40d99bccb31dbc7ea5bc'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:51.482411 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012c458-505b-4452-8862-da1c04919a9a None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:51.483013 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012c458-505b-4452-8862-da1c04919a9a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:51.483433 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b012c458-505b-4452-8862-da1c04919a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:51.501719 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-14939ba2-b1d9-480c-9c69-83b91126d410 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40f25c01cf9f40d99bccb31dbc7ea5bc'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:51.543332 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 828/1669] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:43:51 2022] DELETE /identity/v3/users/40f25c01cf9f40d99bccb31dbc7ea5bc => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:43:51.545068 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde0faa-6015-4b3d-bb34-cfc8bc74ce56 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:51.545508 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde0faa-6015-4b3d-bb34-cfc8bc74ce56 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:51.545844 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde0faa-6015-4b3d-bb34-cfc8bc74ce56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:51.548452 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b012c458-505b-4452-8862-da1c04919a9a None None] MFA Rules not processed for user `b2439d27586b4ee2b7be2169c7339779`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:51.549702 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b012c458-505b-4452-8862-da1c04919a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:51.589136 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-0dde0faa-6015-4b3d-bb34-cfc8bc74ce56 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:51.593282 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0dde0faa-6015-4b3d-bb34-cfc8bc74ce56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:51.730739 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 842/1670] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:43:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:43:51.735015 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012c458-505b-4452-8862-da1c04919a9a None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:51.737733 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b012c458-505b-4452-8862-da1c04919a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:51.767553 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 829/1671] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:43:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:43:51.845893 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b012c458-505b-4452-8862-da1c04919a9a None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:51.853638 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81453d-8cd4-4ccd-9ee9-f88dc434c79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:51.854563 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81453d-8cd4-4ccd-9ee9-f88dc434c79c admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:51.854929 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81453d-8cd4-4ccd-9ee9-f88dc434c79c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:51.855437 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81453d-8cd4-4ccd-9ee9-f88dc434c79c admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:51.856416 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f81453d-8cd4-4ccd-9ee9-f88dc434c79c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:51.858560 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f81453d-8cd4-4ccd-9ee9-f88dc434c79c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:51.899483 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 843/1672] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:43:51 2022] POST /identity/v3/projects => generated 381 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:43:51.900921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde0faa-6015-4b3d-bb34-cfc8bc74ce56 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:51.912588 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde0faa-6015-4b3d-bb34-cfc8bc74ce56 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:51.935849 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81453d-8cd4-4ccd-9ee9-f88dc434c79c admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:51.938005 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7f81453d-8cd4-4ccd-9ee9-f88dc434c79c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:51.994247 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:43:52.032787 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197254a-d096-419c-833e-570ab6e4f3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:52.033684 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197254a-d096-419c-833e-570ab6e4f3f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:52.034282 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197254a-d096-419c-833e-570ab6e4f3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:52.034755 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197254a-d096-419c-833e-570ab6e4f3f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:52.035722 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c197254a-d096-419c-833e-570ab6e4f3f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:52.038180 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c197254a-d096-419c-833e-570ab6e4f3f0 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:52.070515 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 830/1673] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:43:51 2022] POST /identity/v3/users => generated 297 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:43:52.072044 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81453d-8cd4-4ccd-9ee9-f88dc434c79c admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:52.073117 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197254a-d096-419c-833e-570ab6e4f3f0 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:52.085689 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8355394-4ec4-46ba-83ea-63766c38499e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:52.086764 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8355394-4ec4-46ba-83ea-63766c38499e service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:52.087225 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8355394-4ec4-46ba-83ea-63766c38499e service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:52.088512 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8355394-4ec4-46ba-83ea-63766c38499e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:52.091849 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197254a-d096-419c-833e-570ab6e4f3f0 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:52.107012 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18efcd8d-e642-47f4-ba76-3cb152fa4bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:52.108246 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18efcd8d-e642-47f4-ba76-3cb152fa4bda admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:52.108546 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18efcd8d-e642-47f4-ba76-3cb152fa4bda admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:52.108837 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18efcd8d-e642-47f4-ba76-3cb152fa4bda admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:52.109630 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18efcd8d-e642-47f4-ba76-3cb152fa4bda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:52.111245 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8355394-4ec4-46ba-83ea-63766c38499e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:52.113569 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18efcd8d-e642-47f4-ba76-3cb152fa4bda admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:52.114921 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8355394-4ec4-46ba-83ea-63766c38499e service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:52.123284 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:43:52.138115 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 844/1674] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:43:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 03:43:52.138537 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 831/1675] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:43:52.140086 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8355394-4ec4-46ba-83ea-63766c38499e service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:52.151581 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8355394-4ec4-46ba-83ea-63766c38499e service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:52.174887 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a6f530-654b-4012-9f4f-5965b7425347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:52.176829 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6f530-654b-4012-9f4f-5965b7425347 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:52.177473 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6f530-654b-4012-9f4f-5965b7425347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:52.177942 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a6f530-654b-4012-9f4f-5965b7425347 admin admin] PATH_INFO: `/v3/projects/baec9c3d8d4b4269a8030939fb32b1f8/users/2b5f63bdbf36446282f04ce69efc9279/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:52.197431 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a6f530-654b-4012-9f4f-5965b7425347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baec9c3d8d4b4269a8030939fb32b1f8, user_id=2b5f63bdbf36446282f04ce69efc9279, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:52.201071 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a6f530-654b-4012-9f4f-5965b7425347 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:52.222133 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 845/1676] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:43:52 2022] PUT /identity/v3/projects/baec9c3d8d4b4269a8030939fb32b1f8/users/2b5f63bdbf36446282f04ce69efc9279/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:43:52.226845 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18efcd8d-e642-47f4-ba76-3cb152fa4bda admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:52.241581 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18efcd8d-e642-47f4-ba76-3cb152fa4bda admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:52.367699 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35b217b-8844-4775-96a2-db28b5899d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:52.372818 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b217b-8844-4775-96a2-db28b5899d55 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:52.374309 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b217b-8844-4775-96a2-db28b5899d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:52.376128 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35b217b-8844-4775-96a2-db28b5899d55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:52.378229 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35b217b-8844-4775-96a2-db28b5899d55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:52.391956 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35b217b-8844-4775-96a2-db28b5899d55 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:52.419539 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 832/1677] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:43:52.423880 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a6f530-654b-4012-9f4f-5965b7425347 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:52.450370 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a6f530-654b-4012-9f4f-5965b7425347 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:52.460557 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa69d0-7768-4de6-99a8-134633759b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:52.461703 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa69d0-7768-4de6-99a8-134633759b66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:52.465363 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa69d0-7768-4de6-99a8-134633759b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:52.465854 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa69d0-7768-4de6-99a8-134633759b66 admin admin] PATH_INFO: `/v3/projects/baec9c3d8d4b4269a8030939fb32b1f8/users/2b5f63bdbf36446282f04ce69efc9279/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:52.475120 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa69d0-7768-4de6-99a8-134633759b66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baec9c3d8d4b4269a8030939fb32b1f8, user_id=2b5f63bdbf36446282f04ce69efc9279, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:52.489372 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa69d0-7768-4de6-99a8-134633759b66 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:52.508922 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 846/1678] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:43:52 2022] PUT /identity/v3/projects/baec9c3d8d4b4269a8030939fb32b1f8/users/2b5f63bdbf36446282f04ce69efc9279/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:43:52.519090 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737da9de-edad-4748-a77f-d3e45c9cd034 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:52.520179 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737da9de-edad-4748-a77f-d3e45c9cd034 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:52.520179 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737da9de-edad-4748-a77f-d3e45c9cd034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:52.581860 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-737da9de-edad-4748-a77f-d3e45c9cd034 None None] MFA Rules not processed for user `2b5f63bdbf36446282f04ce69efc9279`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:52.584769 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-737da9de-edad-4748-a77f-d3e45c9cd034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:52.724766 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 833/1679] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:43:52 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:43:52.739759 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa69d0-7768-4de6-99a8-134633759b66 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:52.741519 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1afa69d0-7768-4de6-99a8-134633759b66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:52.846302 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b37efc-1a8c-4709-ae12-e2efc93c5747 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:52.846805 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b37efc-1a8c-4709-ae12-e2efc93c5747 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:52.847229 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b37efc-1a8c-4709-ae12-e2efc93c5747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:52.857111 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa69d0-7768-4de6-99a8-134633759b66 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:52.862144 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bbabda-7b54-43ea-b171-e1405fab9606 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:52.864016 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bbabda-7b54-43ea-b171-e1405fab9606 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:52.864978 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bbabda-7b54-43ea-b171-e1405fab9606 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:52.865373 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bbabda-7b54-43ea-b171-e1405fab9606 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:52.878272 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bbabda-7b54-43ea-b171-e1405fab9606 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:52.880568 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bbabda-7b54-43ea-b171-e1405fab9606 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:52.906685 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-b6b37efc-1a8c-4709-ae12-e2efc93c5747 None None] MFA Rules not processed for user `3072d072c50d4df6a7d02ea74c1862f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:52.909227 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b6b37efc-1a8c-4709-ae12-e2efc93c5747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:52.912897 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 847/1680] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:43:52 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:43:52.978277 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:43:53.104468 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bbabda-7b54-43ea-b171-e1405fab9606 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:53.105253 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 834/1681] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:43:52 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:43:53.115957 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bbabda-7b54-43ea-b171-e1405fab9606 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:53.130214 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69ebef-0f48-47cf-90e4-f78aac6f6eaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:53.131072 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69ebef-0f48-47cf-90e4-f78aac6f6eaf service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:53.131466 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69ebef-0f48-47cf-90e4-f78aac6f6eaf service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:53.131848 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69ebef-0f48-47cf-90e4-f78aac6f6eaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:53.159736 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b37efc-1a8c-4709-ae12-e2efc93c5747 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:53.161601 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b6b37efc-1a8c-4709-ae12-e2efc93c5747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:53.308808 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b37efc-1a8c-4709-ae12-e2efc93c5747 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:53.320418 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf4eed-5bd6-4fb9-be86-da058627efa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:53.321320 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf4eed-5bd6-4fb9-be86-da058627efa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:53.321611 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf4eed-5bd6-4fb9-be86-da058627efa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:53.321893 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf4eed-5bd6-4fb9-be86-da058627efa7 admin admin] PATH_INFO: `/v3/projects/a2312da8ff744f4696155fb35dfaa624` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:53.324305 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf4eed-5bd6-4fb9-be86-da058627efa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2312da8ff744f4696155fb35dfaa624)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:53.326485 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf4eed-5bd6-4fb9-be86-da058627efa7 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:53.335978 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f69ebef-0f48-47cf-90e4-f78aac6f6eaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:53.341435 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f69ebef-0f48-47cf-90e4-f78aac6f6eaf service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:53.362976 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 848/1682] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:43:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:43:53.437210 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-24cf4eed-5bd6-4fb9-be86-da058627efa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2312da8ff744f4696155fb35dfaa624', 'request_id': 'req-24cf4eed-5bd6-4fb9-be86-da058627efa7'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:53.451491 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-24cf4eed-5bd6-4fb9-be86-da058627efa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2312da8ff744f4696155fb35dfaa624', 'request_id': 'req-24cf4eed-5bd6-4fb9-be86-da058627efa7'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:53.468090 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-24cf4eed-5bd6-4fb9-be86-da058627efa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2312da8ff744f4696155fb35dfaa624', 'request_id': 'req-24cf4eed-5bd6-4fb9-be86-da058627efa7'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:53.491661 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-24cf4eed-5bd6-4fb9-be86-da058627efa7 admin admin] The token cache is being invalidate because project a2312da8ff744f4696155fb35dfaa624 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:43:53.495640 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-24cf4eed-5bd6-4fb9-be86-da058627efa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:53.498183 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-24cf4eed-5bd6-4fb9-be86-da058627efa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:53.501777 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 835/1683] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:43:53 2022] DELETE /identity/v3/projects/a2312da8ff744f4696155fb35dfaa624 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:43:53.507124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69ebef-0f48-47cf-90e4-f78aac6f6eaf service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:53.523877 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69ebef-0f48-47cf-90e4-f78aac6f6eaf service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:53.582952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a5340-2087-4a0e-972f-9b1d6e28f9b2 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:53.583402 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a5340-2087-4a0e-972f-9b1d6e28f9b2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:53.584346 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423a5340-2087-4a0e-972f-9b1d6e28f9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:53.660901 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-423a5340-2087-4a0e-972f-9b1d6e28f9b2 None None] MFA Rules not processed for user `e0f4a87a467643ae90d5de771ff01d50`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:53.665889 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-423a5340-2087-4a0e-972f-9b1d6e28f9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:53.672270 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b0786-4720-40a5-8a1c-dbc606c8e870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:53.673268 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b0786-4720-40a5-8a1c-dbc606c8e870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:53.673558 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b0786-4720-40a5-8a1c-dbc606c8e870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:53.673894 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64b0786-4720-40a5-8a1c-dbc606c8e870 admin admin] PATH_INFO: `/v3/users/d77cccfd49104eb8bd5b42726c76b8d1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:53.675164 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b0786-4720-40a5-8a1c-dbc606c8e870 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d77cccfd49104eb8bd5b42726c76b8d1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:53.679773 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64b0786-4720-40a5-8a1c-dbc606c8e870 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:53.692505 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:43:53.781859 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d64b0786-4720-40a5-8a1c-dbc606c8e870 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd77cccfd49104eb8bd5b42726c76b8d1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:53.782713 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d64b0786-4720-40a5-8a1c-dbc606c8e870 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd77cccfd49104eb8bd5b42726c76b8d1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:53.785644 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d64b0786-4720-40a5-8a1c-dbc606c8e870 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd77cccfd49104eb8bd5b42726c76b8d1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:53.796882 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:43:53.801878 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d64b0786-4720-40a5-8a1c-dbc606c8e870 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd77cccfd49104eb8bd5b42726c76b8d1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:53.819273 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d64b0786-4720-40a5-8a1c-dbc606c8e870 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd77cccfd49104eb8bd5b42726c76b8d1'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:53.844210 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 836/1684] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:43:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:43:53.850717 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 849/1685] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:43:53 2022] DELETE /identity/v3/users/d77cccfd49104eb8bd5b42726c76b8d1 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:43:53.858330 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac9d11-2434-4c51-8d59-d3c07040a74c None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:53.858826 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac9d11-2434-4c51-8d59-d3c07040a74c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:53.859241 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ac9d11-2434-4c51-8d59-d3c07040a74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:53.902690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-14ac9d11-2434-4c51-8d59-d3c07040a74c None None] MFA Rules not processed for user `e0f4a87a467643ae90d5de771ff01d50`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:53.903610 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-14ac9d11-2434-4c51-8d59-d3c07040a74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:54.069414 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 837/1686] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:43:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:43:54.076452 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b0786-4720-40a5-8a1c-dbc606c8e870 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:54.078048 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d64b0786-4720-40a5-8a1c-dbc606c8e870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:54.194819 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64b0786-4720-40a5-8a1c-dbc606c8e870 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:54.202494 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8a4ba-de51-464d-8c1d-2dd22a1742ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:54.203845 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8a4ba-de51-464d-8c1d-2dd22a1742ac service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:54.204281 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8a4ba-de51-464d-8c1d-2dd22a1742ac service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:54.204849 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8a4ba-de51-464d-8c1d-2dd22a1742ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:54.222102 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba8a4ba-de51-464d-8c1d-2dd22a1742ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:54.224222 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba8a4ba-de51-464d-8c1d-2dd22a1742ac service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:54.245310 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 850/1687] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:43:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:43:54.680820 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac9d11-2434-4c51-8d59-d3c07040a74c None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:54.683878 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-14ac9d11-2434-4c51-8d59-d3c07040a74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:54.874991 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ac9d11-2434-4c51-8d59-d3c07040a74c None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:54.884837 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e004a4-d538-4aa3-b173-7d8b030e9556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:54.885734 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e004a4-d538-4aa3-b173-7d8b030e9556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:54.886019 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e004a4-d538-4aa3-b173-7d8b030e9556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:54.886298 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e004a4-d538-4aa3-b173-7d8b030e9556 admin admin] PATH_INFO: `/v3/projects/f02699f74178467eb83c7ca2d4983e11` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:54.891292 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e004a4-d538-4aa3-b173-7d8b030e9556 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f02699f74178467eb83c7ca2d4983e11)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:54.896888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e004a4-d538-4aa3-b173-7d8b030e9556 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:54.992525 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-25e004a4-d538-4aa3-b173-7d8b030e9556 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f02699f74178467eb83c7ca2d4983e11', 'request_id': 'req-25e004a4-d538-4aa3-b173-7d8b030e9556'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:55.011607 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-25e004a4-d538-4aa3-b173-7d8b030e9556 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f02699f74178467eb83c7ca2d4983e11', 'request_id': 'req-25e004a4-d538-4aa3-b173-7d8b030e9556'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:55.034057 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-25e004a4-d538-4aa3-b173-7d8b030e9556 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f02699f74178467eb83c7ca2d4983e11', 'request_id': 'req-25e004a4-d538-4aa3-b173-7d8b030e9556'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:55.054251 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-25e004a4-d538-4aa3-b173-7d8b030e9556 admin admin] The token cache is being invalidate because project f02699f74178467eb83c7ca2d4983e11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:43:55.054582 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-25e004a4-d538-4aa3-b173-7d8b030e9556 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:55.055996 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-25e004a4-d538-4aa3-b173-7d8b030e9556 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:55.058725 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 838/1688] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:43:54 2022] DELETE /identity/v3/projects/f02699f74178467eb83c7ca2d4983e11 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:43:55.065737 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68b47e-cab3-4596-9c65-9006f7a78481 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:55.066730 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68b47e-cab3-4596-9c65-9006f7a78481 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:55.067148 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68b47e-cab3-4596-9c65-9006f7a78481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:55.102245 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-ff68b47e-cab3-4596-9c65-9006f7a78481 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:55.104851 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ff68b47e-cab3-4596-9c65-9006f7a78481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:55.220083 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c2f40-57b5-4373-933f-22ea39c9b4fe None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:55.220439 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c2f40-57b5-4373-933f-22ea39c9b4fe None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:55.220729 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c2f40-57b5-4373-933f-22ea39c9b4fe None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:55.222130 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 839/1689] 10.222.0.20 () {54 vars in 912 bytes} [Thu Jul 21 03:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 03:43:55.228090 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f52cb-40dc-44c0-8dee-d89074623b5d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:55.228513 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f52cb-40dc-44c0-8dee-d89074623b5d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:55.228877 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359f52cb-40dc-44c0-8dee-d89074623b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:55.281364 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 851/1690] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:43:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:43:55.289407 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546de7c4-49d8-420f-b387-8dbd02ab6bdb None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:55.290724 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546de7c4-49d8-420f-b387-8dbd02ab6bdb None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:55.291137 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546de7c4-49d8-420f-b387-8dbd02ab6bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:55.309855 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-359f52cb-40dc-44c0-8dee-d89074623b5d None None] MFA Rules not processed for user `b68c257254de483ab65eb5dc5684a704`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:55.311312 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-359f52cb-40dc-44c0-8dee-d89074623b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:55.329560 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:43:55.350408 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-546de7c4-49d8-420f-b387-8dbd02ab6bdb None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:55.354494 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-546de7c4-49d8-420f-b387-8dbd02ab6bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:55.378116 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 852/1691] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:43:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:43:55.382900 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546de7c4-49d8-420f-b387-8dbd02ab6bdb None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:55.387576 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:43:55.404790 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546de7c4-49d8-420f-b387-8dbd02ab6bdb None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:55.418365 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a667800-a3ce-4531-84d5-ae225d76e75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:55.419080 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a667800-a3ce-4531-84d5-ae225d76e75d admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:55.422034 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a667800-a3ce-4531-84d5-ae225d76e75d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:55.422326 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a667800-a3ce-4531-84d5-ae225d76e75d admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:55.426433 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a667800-a3ce-4531-84d5-ae225d76e75d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:43:55.426779 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a667800-a3ce-4531-84d5-ae225d76e75d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:55.436730 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a667800-a3ce-4531-84d5-ae225d76e75d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:55.457000 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 840/1692] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jul 21 03:43:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:43:55.473951 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f52cb-40dc-44c0-8dee-d89074623b5d None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:55.474399 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 853/1693] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:43:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:43:55.492010 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359f52cb-40dc-44c0-8dee-d89074623b5d None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:55.507223 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d20be1-19b2-4b8e-94b8-3aecef7616b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:55.508520 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d20be1-19b2-4b8e-94b8-3aecef7616b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:55.508520 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d20be1-19b2-4b8e-94b8-3aecef7616b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:55.508520 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d20be1-19b2-4b8e-94b8-3aecef7616b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:55.511253 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d20be1-19b2-4b8e-94b8-3aecef7616b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:55.512877 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d20be1-19b2-4b8e-94b8-3aecef7616b8 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:55.573741 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a667800-a3ce-4531-84d5-ae225d76e75d admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:55.574579 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 841/1694] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:43:55 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:43:55.585371 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a667800-a3ce-4531-84d5-ae225d76e75d admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:55.662096 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09accc-4e15-492b-a45e-9305a09343f8 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:55.662620 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09accc-4e15-492b-a45e-9305a09343f8 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:55.663045 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c09accc-4e15-492b-a45e-9305a09343f8 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:55.664949 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 842/1695] 10.222.0.20 () {54 vars in 921 bytes} [Thu Jul 21 03:43:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:43:55.673737 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a96e3-904b-4ea7-b923-88d1d9fcc697 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:55.674150 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a96e3-904b-4ea7-b923-88d1d9fcc697 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:55.674581 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a96e3-904b-4ea7-b923-88d1d9fcc697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:55.726101 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-785a96e3-904b-4ea7-b923-88d1d9fcc697 None None] MFA Rules not processed for user `cb39129b3ed04db28ed01860b37bd714`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:55.728450 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-785a96e3-904b-4ea7-b923-88d1d9fcc697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:55.763253 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4403f2-4c0d-460c-8f8f-7e0f64b1dc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:55.765743 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4403f2-4c0d-460c-8f8f-7e0f64b1dc24 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:55.766041 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4403f2-4c0d-460c-8f8f-7e0f64b1dc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:55.766329 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4403f2-4c0d-460c-8f8f-7e0f64b1dc24 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:55.767076 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4403f2-4c0d-460c-8f8f-7e0f64b1dc24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:55.773772 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4403f2-4c0d-460c-8f8f-7e0f64b1dc24 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:55.833583 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 854/1696] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:43:55 2022] POST /identity/v3/users => generated 287 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:43:55.838344 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4403f2-4c0d-460c-8f8f-7e0f64b1dc24 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:55.842848 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6f4403f2-4c0d-460c-8f8f-7e0f64b1dc24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:55.893705 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 843/1697] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Jul 21 03:43:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:43:55.894768 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a96e3-904b-4ea7-b923-88d1d9fcc697 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:55.914027 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a96e3-904b-4ea7-b923-88d1d9fcc697 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:55.926652 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2151a762-eb5c-4799-be3d-8bcfd9f1ac2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:55.927554 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151a762-eb5c-4799-be3d-8bcfd9f1ac2e admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:55.927957 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151a762-eb5c-4799-be3d-8bcfd9f1ac2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:55.930291 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2151a762-eb5c-4799-be3d-8bcfd9f1ac2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:55.930291 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2151a762-eb5c-4799-be3d-8bcfd9f1ac2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:55.932873 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2151a762-eb5c-4799-be3d-8bcfd9f1ac2e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:55.967718 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 844/1698] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:43:55.971709 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b3b97-459c-4e2e-9b15-9e0ce9a64037 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:55.972218 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b3b97-459c-4e2e-9b15-9e0ce9a64037 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:55.974247 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b3b97-459c-4e2e-9b15-9e0ce9a64037 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:55.976125 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 845/1699] 10.222.0.20 () {54 vars in 961 bytes} [Thu Jul 21 03:43:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:43:55.982489 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b3b97-459c-4e2e-9b15-9e0ce9a64037 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:56.008923 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4403f2-4c0d-460c-8f8f-7e0f64b1dc24 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:56.019286 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b3b97-459c-4e2e-9b15-9e0ce9a64037 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:56.020755 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb04a4-f280-4c37-b1c9-d1d6eed8e8b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:56.021557 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb04a4-f280-4c37-b1c9-d1d6eed8e8b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:56.021851 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb04a4-f280-4c37-b1c9-d1d6eed8e8b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:56.022135 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cb04a4-f280-4c37-b1c9-d1d6eed8e8b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:56.024637 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf8562c-ed10-446d-909b-04607bff704e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:56.025427 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8562c-ed10-446d-909b-04607bff704e admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:56.025825 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8562c-ed10-446d-909b-04607bff704e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:56.026217 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf8562c-ed10-446d-909b-04607bff704e admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:56.027119 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf8562c-ed10-446d-909b-04607bff704e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:56.028866 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf8562c-ed10-446d-909b-04607bff704e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:56.048023 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb04a4-f280-4c37-b1c9-d1d6eed8e8b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:56.050021 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cb04a4-f280-4c37-b1c9-d1d6eed8e8b1 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:56.053346 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 846/1700] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:43:56.057978 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab889df9-8d15-4ecb-84cc-043ba009593a None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:56.063988 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab889df9-8d15-4ecb-84cc-043ba009593a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:56.064451 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab889df9-8d15-4ecb-84cc-043ba009593a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:56.076511 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 855/1701] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:43:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:43:56.080513 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb04a4-f280-4c37-b1c9-d1d6eed8e8b1 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:56.085356 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f6cb04a4-f280-4c37-b1c9-d1d6eed8e8b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:56.102605 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ab889df9-8d15-4ecb-84cc-043ba009593a None None] MFA Rules not processed for user `cb39129b3ed04db28ed01860b37bd714`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:56.103955 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ab889df9-8d15-4ecb-84cc-043ba009593a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:56.129995 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 847/1702] 10.222.0.20 () {58 vars in 1058 bytes} [Thu Jul 21 03:43:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:43:56.131068 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab889df9-8d15-4ecb-84cc-043ba009593a None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:56.140830 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cb04a4-f280-4c37-b1c9-d1d6eed8e8b1 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:56.156149 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f14cd-58fe-4e0f-aa4e-e8a781b3c452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:56.156777 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab889df9-8d15-4ecb-84cc-043ba009593a None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:56.159244 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f14cd-58fe-4e0f-aa4e-e8a781b3c452 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:56.159587 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f14cd-58fe-4e0f-aa4e-e8a781b3c452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:56.160859 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f14cd-58fe-4e0f-aa4e-e8a781b3c452 admin admin] PATH_INFO: `/v3/projects/6fdb19e2a04b4e6992dcf30e5894adc5` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:56.164041 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f14cd-58fe-4e0f-aa4e-e8a781b3c452 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fdb19e2a04b4e6992dcf30e5894adc5)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:56.169922 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f14cd-58fe-4e0f-aa4e-e8a781b3c452 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:56.176877 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90bfce-c7c9-44a6-86bf-6e34fd2ea831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:56.176877 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90bfce-c7c9-44a6-86bf-6e34fd2ea831 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:56.177118 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90bfce-c7c9-44a6-86bf-6e34fd2ea831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:56.177302 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90bfce-c7c9-44a6-86bf-6e34fd2ea831 admin admin] PATH_INFO: `/v3/projects/64b3ac4a1ede40e98ed5f845f6d1a984/users/2559a2b627b44e9f9b4a2bb45c058f1a/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:56.202514 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a90bfce-c7c9-44a6-86bf-6e34fd2ea831 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64b3ac4a1ede40e98ed5f845f6d1a984, user_id=2559a2b627b44e9f9b4a2bb45c058f1a, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:56.205224 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a90bfce-c7c9-44a6-86bf-6e34fd2ea831 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:56.236192 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 848/1703] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:43:56 2022] PUT /identity/v3/projects/64b3ac4a1ede40e98ed5f845f6d1a984/users/2559a2b627b44e9f9b4a2bb45c058f1a/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:43:56.236893 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90bfce-c7c9-44a6-86bf-6e34fd2ea831 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:56.340528 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-651f14cd-58fe-4e0f-aa4e-e8a781b3c452 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fdb19e2a04b4e6992dcf30e5894adc5', 'request_id': 'req-651f14cd-58fe-4e0f-aa4e-e8a781b3c452'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:56.349071 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:43:56.355465 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-651f14cd-58fe-4e0f-aa4e-e8a781b3c452 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fdb19e2a04b4e6992dcf30e5894adc5', 'request_id': 'req-651f14cd-58fe-4e0f-aa4e-e8a781b3c452'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:56.373395 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-651f14cd-58fe-4e0f-aa4e-e8a781b3c452 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fdb19e2a04b4e6992dcf30e5894adc5', 'request_id': 'req-651f14cd-58fe-4e0f-aa4e-e8a781b3c452'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:56.393372 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-651f14cd-58fe-4e0f-aa4e-e8a781b3c452 admin admin] The token cache is being invalidate because project 6fdb19e2a04b4e6992dcf30e5894adc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:43:56.393668 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-651f14cd-58fe-4e0f-aa4e-e8a781b3c452 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:56.394734 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-651f14cd-58fe-4e0f-aa4e-e8a781b3c452 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:56.395674 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90bfce-c7c9-44a6-86bf-6e34fd2ea831 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:56.399131 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 856/1704] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:43:56 2022] DELETE /identity/v3/projects/6fdb19e2a04b4e6992dcf30e5894adc5 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:43:56.400491 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66049a03-4a29-473a-bab8-583d1573bf81 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:56.400784 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66049a03-4a29-473a-bab8-583d1573bf81 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:56.403092 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66049a03-4a29-473a-bab8-583d1573bf81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:56.420669 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:43:56.461095 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-66049a03-4a29-473a-bab8-583d1573bf81 None None] MFA Rules not processed for user `2559a2b627b44e9f9b4a2bb45c058f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:56.462393 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-66049a03-4a29-473a-bab8-583d1573bf81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:56.542204 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7796ab-d12c-4cdc-ab9f-c57c7f1784eb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb39129b3ed04db28ed01860b37bd714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:56.544933 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7796ab-d12c-4cdc-ab9f-c57c7f1784eb service placement] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:56.545184 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7796ab-d12c-4cdc-ab9f-c57c7f1784eb service placement] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:56.545469 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7796ab-d12c-4cdc-ab9f-c57c7f1784eb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:56.555871 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ae7796ab-d12c-4cdc-ab9f-c57c7f1784eb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:56.589653 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 857/1705] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:43:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:43:56.591103 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c437d-cef8-4f27-a4b6-d5507adb9f66 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:56.591400 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c437d-cef8-4f27-a4b6-d5507adb9f66 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:56.591681 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c437d-cef8-4f27-a4b6-d5507adb9f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:56.601664 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7796ab-d12c-4cdc-ab9f-c57c7f1784eb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:56.604442 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7796ab-d12c-4cdc-ab9f-c57c7f1784eb service placement] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:56.631360 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 849/1706] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:43:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:43:56.632027 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7796ab-d12c-4cdc-ab9f-c57c7f1784eb service placement] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:56.635439 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-df5c437d-cef8-4f27-a4b6-d5507adb9f66 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:56.643119 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-df5c437d-cef8-4f27-a4b6-d5507adb9f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:56.643307 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ae7796ab-d12c-4cdc-ab9f-c57c7f1784eb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:56.773751 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 858/1707] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:43:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:43:56.782111 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3171b-80d3-449a-a1f1-b5492e183096 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:56.782983 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3171b-80d3-449a-a1f1-b5492e183096 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:56.783589 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3171b-80d3-449a-a1f1-b5492e183096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:56.835736 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7796ab-d12c-4cdc-ab9f-c57c7f1784eb service placement] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:56.849498 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-25e3171b-80d3-449a-a1f1-b5492e183096 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:56.850961 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-25e3171b-80d3-449a-a1f1-b5492e183096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:56.857414 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a08761-38a8-4448-ad08-39a4e6282c5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:56.858094 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a08761-38a8-4448-ad08-39a4e6282c5e service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:56.858381 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a08761-38a8-4448-ad08-39a4e6282c5e service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:56.858749 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a08761-38a8-4448-ad08-39a4e6282c5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:56.873270 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 859/1708] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:43:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:43:56.877470 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3171b-80d3-449a-a1f1-b5492e183096 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:56.890380 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3171b-80d3-449a-a1f1-b5492e183096 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:56.901073 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f11197a-a8f9-4e9b-8595-92abe21251ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:56.903123 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11197a-a8f9-4e9b-8595-92abe21251ea admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:56.903938 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11197a-a8f9-4e9b-8595-92abe21251ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:56.910001 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a08761-38a8-4448-ad08-39a4e6282c5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:56.912223 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a08761-38a8-4448-ad08-39a4e6282c5e service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:56.918274 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11197a-a8f9-4e9b-8595-92abe21251ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:56.922067 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f11197a-a8f9-4e9b-8595-92abe21251ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:43:56.926062 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f11197a-a8f9-4e9b-8595-92abe21251ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:56.933338 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 850/1709] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:43:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:43:56.946548 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f11197a-a8f9-4e9b-8595-92abe21251ea admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:57.012115 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 860/1710] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:43:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:43:57.013252 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a08761-38a8-4448-ad08-39a4e6282c5e service nova] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:57.034022 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a08761-38a8-4448-ad08-39a4e6282c5e service nova] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:57.056379 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525cc43a-96e8-4d8e-96aa-7c2ed425f40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:57.056379 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525cc43a-96e8-4d8e-96aa-7c2ed425f40d admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:57.056657 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525cc43a-96e8-4d8e-96aa-7c2ed425f40d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:57.057043 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525cc43a-96e8-4d8e-96aa-7c2ed425f40d admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:57.057682 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525cc43a-96e8-4d8e-96aa-7c2ed425f40d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:57.061768 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525cc43a-96e8-4d8e-96aa-7c2ed425f40d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:57.194446 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 851/1711] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:43:57 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:43:57.195749 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f11197a-a8f9-4e9b-8595-92abe21251ea admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:57.216432 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f11197a-a8f9-4e9b-8595-92abe21251ea admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:57.480796 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525cc43a-96e8-4d8e-96aa-7c2ed425f40d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:57.483736 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-525cc43a-96e8-4d8e-96aa-7c2ed425f40d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:57.566855 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe7e08-3fe4-4af4-8013-54f07af3b279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:57.570328 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe7e08-3fe4-4af4-8013-54f07af3b279 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:57.570645 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe7e08-3fe4-4af4-8013-54f07af3b279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:57.570928 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe7e08-3fe4-4af4-8013-54f07af3b279 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:57.576573 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe7e08-3fe4-4af4-8013-54f07af3b279 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:57.581848 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe7e08-3fe4-4af4-8013-54f07af3b279 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:57.619728 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:43:57.650724 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 861/1712] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:43:57 2022] POST /identity/v3/users => generated 293 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:43:57.653740 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe7e08-3fe4-4af4-8013-54f07af3b279 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:57.679960 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:43:57.689941 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe7e08-3fe4-4af4-8013-54f07af3b279 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:57.702687 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525cc43a-96e8-4d8e-96aa-7c2ed425f40d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:57.710925 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd79bf-122e-4c7c-8f26-706407901093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:57.711625 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd79bf-122e-4c7c-8f26-706407901093 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:57.711908 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd79bf-122e-4c7c-8f26-706407901093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:57.712184 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd79bf-122e-4c7c-8f26-706407901093 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:57.713370 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd79bf-122e-4c7c-8f26-706407901093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:57.714560 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd79bf-122e-4c7c-8f26-706407901093 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:57.717511 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f8a81f-a845-4951-a16c-33c017e1b951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:57.718440 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8a81f-a845-4951-a16c-33c017e1b951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:57.718745 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8a81f-a845-4951-a16c-33c017e1b951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:57.719028 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f8a81f-a845-4951-a16c-33c017e1b951 admin admin] PATH_INFO: `/v3/users/2559a2b627b44e9f9b4a2bb45c058f1a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:57.722284 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f8a81f-a845-4951-a16c-33c017e1b951 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2559a2b627b44e9f9b4a2bb45c058f1a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:57.727034 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f8a81f-a845-4951-a16c-33c017e1b951 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:57.753097 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 862/1713] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:43:57.754734 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd79bf-122e-4c7c-8f26-706407901093 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:57.813345 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd79bf-122e-4c7c-8f26-706407901093 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:57.849481 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48414960-5698-4177-b064-db63455bb939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:57.850183 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48414960-5698-4177-b064-db63455bb939 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:57.850493 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48414960-5698-4177-b064-db63455bb939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:57.860974 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48414960-5698-4177-b064-db63455bb939 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:57.861916 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48414960-5698-4177-b064-db63455bb939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:57.869137 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48414960-5698-4177-b064-db63455bb939 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:57.893539 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f6f8a81f-a845-4951-a16c-33c017e1b951 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2559a2b627b44e9f9b4a2bb45c058f1a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:57.897304 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f6f8a81f-a845-4951-a16c-33c017e1b951 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2559a2b627b44e9f9b4a2bb45c058f1a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:57.898888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f6f8a81f-a845-4951-a16c-33c017e1b951 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2559a2b627b44e9f9b4a2bb45c058f1a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:57.919998 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f6f8a81f-a845-4951-a16c-33c017e1b951 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2559a2b627b44e9f9b4a2bb45c058f1a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:57.927272 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 863/1714] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:43:57.928248 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48414960-5698-4177-b064-db63455bb939 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:57.940624 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-48414960-5698-4177-b064-db63455bb939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:57.944876 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f6f8a81f-a845-4951-a16c-33c017e1b951 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2559a2b627b44e9f9b4a2bb45c058f1a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:43:58.008889 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48414960-5698-4177-b064-db63455bb939 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:58.015258 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 852/1715] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:43:57 2022] DELETE /identity/v3/users/2559a2b627b44e9f9b4a2bb45c058f1a => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:43:58.017340 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cbfeb-1c9e-45d1-89cf-69b72b2e0fd2 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:58.019521 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cbfeb-1c9e-45d1-89cf-69b72b2e0fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:58.021679 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cbfeb-1c9e-45d1-89cf-69b72b2e0fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:58.110771 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-bf9cbfeb-1c9e-45d1-89cf-69b72b2e0fd2 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:58.112637 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-bf9cbfeb-1c9e-45d1-89cf-69b72b2e0fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:58.210410 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710d48f-2b74-424c-abea-99bccba5ed11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:58.211364 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710d48f-2b74-424c-abea-99bccba5ed11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:58.211650 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710d48f-2b74-424c-abea-99bccba5ed11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:58.211927 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710d48f-2b74-424c-abea-99bccba5ed11 admin admin] PATH_INFO: `/v3/projects/319b71bb480544d2bbe8b5c3b4ec243c/users/f21bb28bfbd94385b5758cdd9e87c136/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:58.265670 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710d48f-2b74-424c-abea-99bccba5ed11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=319b71bb480544d2bbe8b5c3b4ec243c, user_id=f21bb28bfbd94385b5758cdd9e87c136, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:58.268409 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710d48f-2b74-424c-abea-99bccba5ed11 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:58.314025 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 864/1716] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:43:57 2022] PUT /identity/v3/projects/319b71bb480544d2bbe8b5c3b4ec243c/users/f21bb28bfbd94385b5758cdd9e87c136/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:43:58.326055 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63002b9d-04c9-4e65-bb5d-b7f2d9ebbdd6 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:58.326357 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63002b9d-04c9-4e65-bb5d-b7f2d9ebbdd6 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:58.326693 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63002b9d-04c9-4e65-bb5d-b7f2d9ebbdd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:58.334615 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 853/1717] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:43:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:43:58.375724 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9cbfeb-1c9e-45d1-89cf-69b72b2e0fd2 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:58.377685 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-bf9cbfeb-1c9e-45d1-89cf-69b72b2e0fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:58.432646 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-63002b9d-04c9-4e65-bb5d-b7f2d9ebbdd6 None None] MFA Rules not processed for user `f21bb28bfbd94385b5758cdd9e87c136`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:58.433874 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-63002b9d-04c9-4e65-bb5d-b7f2d9ebbdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:58.610789 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 865/1718] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:43:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:43:58.610789 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63002b9d-04c9-4e65-bb5d-b7f2d9ebbdd6 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:58.619054 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-63002b9d-04c9-4e65-bb5d-b7f2d9ebbdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:58.624195 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9cbfeb-1c9e-45d1-89cf-69b72b2e0fd2 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:58.659928 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:43:58.783608 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:43:58.836715 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63002b9d-04c9-4e65-bb5d-b7f2d9ebbdd6 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:58.857878 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57ea69-6858-4a0e-8510-3478e05fd010 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb39129b3ed04db28ed01860b37bd714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:58.858960 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57ea69-6858-4a0e-8510-3478e05fd010 service placement] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:58.859448 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57ea69-6858-4a0e-8510-3478e05fd010 service placement] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:58.860040 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd57ea69-6858-4a0e-8510-3478e05fd010 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:58.868237 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-fd57ea69-6858-4a0e-8510-3478e05fd010 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:58.869173 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44cfd1f-0350-41c9-8278-08fafb582c57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:58.870321 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cfd1f-0350-41c9-8278-08fafb582c57 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:58.871565 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cfd1f-0350-41c9-8278-08fafb582c57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:58.873151 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cfd1f-0350-41c9-8278-08fafb582c57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:58.900651 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd57ea69-6858-4a0e-8510-3478e05fd010 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:58.905998 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd57ea69-6858-4a0e-8510-3478e05fd010 service placement] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:58.940802 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 866/1719] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:43:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:43:58.943808 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57ea69-6858-4a0e-8510-3478e05fd010 service placement] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:59.079936 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44cfd1f-0350-41c9-8278-08fafb582c57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:59.081426 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44cfd1f-0350-41c9-8278-08fafb582c57 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:59.090800 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd57ea69-6858-4a0e-8510-3478e05fd010 service placement] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:59.104999 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 854/1720] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:43:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 730 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 03:43:59.105213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb6aa60-6a49-44e5-94c4-46bce2e65f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:59.107622 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6aa60-6a49-44e5-94c4-46bce2e65f72 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:59.109965 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6aa60-6a49-44e5-94c4-46bce2e65f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:59.110341 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6aa60-6a49-44e5-94c4-46bce2e65f72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:59.111119 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb6aa60-6a49-44e5-94c4-46bce2e65f72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:59.122799 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb6aa60-6a49-44e5-94c4-46bce2e65f72 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:59.215286 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 867/1721] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:43:58 2022] POST /identity/v3/projects => generated 387 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:43:59.219499 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44cfd1f-0350-41c9-8278-08fafb582c57 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:59.235111 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44cfd1f-0350-41c9-8278-08fafb582c57 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:59.422648 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a02f9-3371-4d5d-8ad2-52854d62ebff None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:59.423155 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a02f9-3371-4d5d-8ad2-52854d62ebff None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:59.424168 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a02f9-3371-4d5d-8ad2-52854d62ebff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:59.475976 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d109b-9836-4766-8aa5-475f3e6079f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:59.477507 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d109b-9836-4766-8aa5-475f3e6079f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:59.479991 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d109b-9836-4766-8aa5-475f3e6079f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:59.480525 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d109b-9836-4766-8aa5-475f3e6079f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:59.481210 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4d109b-9836-4766-8aa5-475f3e6079f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:59.494467 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4d109b-9836-4766-8aa5-475f3e6079f1 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:59.558113 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-a93a02f9-3371-4d5d-8ad2-52854d62ebff None None] MFA Rules not processed for user `8d4f1b27da1540339cb16efcb079135f`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:59.560318 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a93a02f9-3371-4d5d-8ad2-52854d62ebff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:59.579619 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 855/1722] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:43:59 2022] POST /identity/v3/users => generated 300 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:43:59.581044 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab760e2-ae7c-4cde-9409-3c5d0a27bf65 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:59.585445 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab760e2-ae7c-4cde-9409-3c5d0a27bf65 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:59.585760 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab760e2-ae7c-4cde-9409-3c5d0a27bf65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:59.658165 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-4ab760e2-ae7c-4cde-9409-3c5d0a27bf65 None None] MFA Rules not processed for user `52f492a1c5f5474d86a6ac8f0348321b`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:59.660963 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4ab760e2-ae7c-4cde-9409-3c5d0a27bf65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:59.765419 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 868/1723] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:43:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:43:59.766272 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a02f9-3371-4d5d-8ad2-52854d62ebff None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:59.827520 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a02f9-3371-4d5d-8ad2-52854d62ebff None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:59.837397 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:43:59.862736 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efbdd82-826d-4d72-ada4-8fc9eac123e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:43:59.865151 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efbdd82-826d-4d72-ada4-8fc9eac123e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:59.865968 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efbdd82-826d-4d72-ada4-8fc9eac123e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:59.866628 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efbdd82-826d-4d72-ada4-8fc9eac123e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:59.880173 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efbdd82-826d-4d72-ada4-8fc9eac123e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:43:59.885171 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efbdd82-826d-4d72-ada4-8fc9eac123e9 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:43:59.939636 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 869/1724] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:43:59.941585 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32486630-cb43-4684-beff-2356982a1df7 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:43:59.942181 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32486630-cb43-4684-beff-2356982a1df7 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:43:59.942801 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32486630-cb43-4684-beff-2356982a1df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:43:59.971945 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 856/1725] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:43:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:43:59.980674 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab760e2-ae7c-4cde-9409-3c5d0a27bf65 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:43:59.983034 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-32486630-cb43-4684-beff-2356982a1df7 None None] MFA Rules not processed for user `8d4f1b27da1540339cb16efcb079135f`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:43:59.984272 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-32486630-cb43-4684-beff-2356982a1df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:43:59.993517 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab760e2-ae7c-4cde-9409-3c5d0a27bf65 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:43:59.999852 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02efa82-2ff2-4b79-9169-dd37c3d27599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:00.001033 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02efa82-2ff2-4b79-9169-dd37c3d27599 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:00.001458 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02efa82-2ff2-4b79-9169-dd37c3d27599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:00.003990 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02efa82-2ff2-4b79-9169-dd37c3d27599 admin admin] PATH_INFO: `/v3/projects/31c6a0d54bb04e19896faeeca2172ed8/users/d4c23288340747658efc15a9afa12aed/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:00.014882 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 870/1726] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:43:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:00.015857 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32486630-cb43-4684-beff-2356982a1df7 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:00.022625 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-32486630-cb43-4684-beff-2356982a1df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:00.026354 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02efa82-2ff2-4b79-9169-dd37c3d27599 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31c6a0d54bb04e19896faeeca2172ed8, user_id=d4c23288340747658efc15a9afa12aed, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:00.033387 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02efa82-2ff2-4b79-9169-dd37c3d27599 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:00.054649 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32486630-cb43-4684-beff-2356982a1df7 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:00.065782 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 857/1727] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:43:59 2022] PUT /identity/v3/projects/31c6a0d54bb04e19896faeeca2172ed8/users/d4c23288340747658efc15a9afa12aed/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:00.068201 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02efa82-2ff2-4b79-9169-dd37c3d27599 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:00.071210 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b02efa82-2ff2-4b79-9169-dd37c3d27599 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:00.182062 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:00.222244 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5b5da-6e3f-4c28-bd2f-0d18a21cc6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:00.224664 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5b5da-6e3f-4c28-bd2f-0d18a21cc6f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:00.225099 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5b5da-6e3f-4c28-bd2f-0d18a21cc6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:00.225525 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5b5da-6e3f-4c28-bd2f-0d18a21cc6f3 admin admin] PATH_INFO: `/v3/projects/64b3ac4a1ede40e98ed5f845f6d1a984` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:00.234147 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b5b5da-6e3f-4c28-bd2f-0d18a21cc6f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64b3ac4a1ede40e98ed5f845f6d1a984)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:00.236320 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b5b5da-6e3f-4c28-bd2f-0d18a21cc6f3 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:00.273405 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02efa82-2ff2-4b79-9169-dd37c3d27599 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:00.298120 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3208829e-fce1-4386-8643-1ee6d2a35f63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:00.298967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208829e-fce1-4386-8643-1ee6d2a35f63 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:00.299213 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208829e-fce1-4386-8643-1ee6d2a35f63 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:00.299491 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208829e-fce1-4386-8643-1ee6d2a35f63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:00.328538 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-44b5b5da-6e3f-4c28-bd2f-0d18a21cc6f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64b3ac4a1ede40e98ed5f845f6d1a984', 'request_id': 'req-44b5b5da-6e3f-4c28-bd2f-0d18a21cc6f3'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:00.346039 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-44b5b5da-6e3f-4c28-bd2f-0d18a21cc6f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64b3ac4a1ede40e98ed5f845f6d1a984', 'request_id': 'req-44b5b5da-6e3f-4c28-bd2f-0d18a21cc6f3'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:00.368810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-44b5b5da-6e3f-4c28-bd2f-0d18a21cc6f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64b3ac4a1ede40e98ed5f845f6d1a984', 'request_id': 'req-44b5b5da-6e3f-4c28-bd2f-0d18a21cc6f3'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:00.384443 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-44b5b5da-6e3f-4c28-bd2f-0d18a21cc6f3 admin admin] The token cache is being invalidate because project 64b3ac4a1ede40e98ed5f845f6d1a984 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:44:00.384926 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-44b5b5da-6e3f-4c28-bd2f-0d18a21cc6f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:00.386911 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-44b5b5da-6e3f-4c28-bd2f-0d18a21cc6f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:00.391424 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 871/1728] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:44:00 2022] DELETE /identity/v3/projects/64b3ac4a1ede40e98ed5f845f6d1a984 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:00.392440 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5b5da-6e3f-4c28-bd2f-0d18a21cc6f3 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:00.397337 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-44b5b5da-6e3f-4c28-bd2f-0d18a21cc6f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:00.411060 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3208829e-fce1-4386-8643-1ee6d2a35f63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:00.413026 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3208829e-fce1-4386-8643-1ee6d2a35f63 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:00.449006 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 858/1729] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:44:00.450092 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3208829e-fce1-4386-8643-1ee6d2a35f63 service nova] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:00.451764 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3208829e-fce1-4386-8643-1ee6d2a35f63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:00.483492 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3208829e-fce1-4386-8643-1ee6d2a35f63 service nova] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:00.539859 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5b5da-6e3f-4c28-bd2f-0d18a21cc6f3 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:00.552322 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ba74e-6d75-4875-958f-abd3777c2451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:00.553027 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ba74e-6d75-4875-958f-abd3777c2451 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:00.553310 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ba74e-6d75-4875-958f-abd3777c2451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:00.553586 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ba74e-6d75-4875-958f-abd3777c2451 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:00.554330 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ba74e-6d75-4875-958f-abd3777c2451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:00.555981 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ba74e-6d75-4875-958f-abd3777c2451 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:00.587376 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 872/1730] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:00.588586 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700b336-77e8-4fb7-8888-c2a0dfc7aaac None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:00.588875 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700b336-77e8-4fb7-8888-c2a0dfc7aaac None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:00.589152 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0700b336-77e8-4fb7-8888-c2a0dfc7aaac None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:00.595097 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 873/1731] 10.222.0.20 () {54 vars in 921 bytes} [Thu Jul 21 03:44:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:44:00.596790 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f0bb4-1953-4292-9eb6-4583fa9b6ac3 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:00.597304 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f0bb4-1953-4292-9eb6-4583fa9b6ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:00.598445 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541f0bb4-1953-4292-9eb6-4583fa9b6ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:00.648009 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:00.680658 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-541f0bb4-1953-4292-9eb6-4583fa9b6ac3 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:00.690496 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-541f0bb4-1953-4292-9eb6-4583fa9b6ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:00.695123 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02568569-2216-4816-ab81-ee24c23a67fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:00.695123 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02568569-2216-4816-ab81-ee24c23a67fa service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:00.695402 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02568569-2216-4816-ab81-ee24c23a67fa service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:00.695629 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02568569-2216-4816-ab81-ee24c23a67fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:00.699049 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-02568569-2216-4816-ab81-ee24c23a67fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:00.715451 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 874/1732] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:00.716422 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f0bb4-1953-4292-9eb6-4583fa9b6ac3 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:00.750096 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541f0bb4-1953-4292-9eb6-4583fa9b6ac3 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:00.783980 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf3115-4eb6-4d6c-8047-64931d6713a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:00.785050 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf3115-4eb6-4d6c-8047-64931d6713a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:00.785342 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf3115-4eb6-4d6c-8047-64931d6713a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:00.785656 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf3115-4eb6-4d6c-8047-64931d6713a3 admin admin] PATH_INFO: `/v3/projects/31c6a0d54bb04e19896faeeca2172ed8/users/d4c23288340747658efc15a9afa12aed/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:00.792502 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf3115-4eb6-4d6c-8047-64931d6713a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31c6a0d54bb04e19896faeeca2172ed8, user_id=d4c23288340747658efc15a9afa12aed, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:00.795542 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf3115-4eb6-4d6c-8047-64931d6713a3 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:00.886653 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 875/1733] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:44:00 2022] PUT /identity/v3/projects/31c6a0d54bb04e19896faeeca2172ed8/users/d4c23288340747658efc15a9afa12aed/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:00.886653 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918dc037-e8fb-4daf-b834-bc6b1a7b49b6 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:00.886653 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918dc037-e8fb-4daf-b834-bc6b1a7b49b6 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:00.886653 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918dc037-e8fb-4daf-b834-bc6b1a7b49b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:00.949056 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-918dc037-e8fb-4daf-b834-bc6b1a7b49b6 None None] MFA Rules not processed for user `cb39129b3ed04db28ed01860b37bd714`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:00.951978 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-918dc037-e8fb-4daf-b834-bc6b1a7b49b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:00.982865 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02568569-2216-4816-ab81-ee24c23a67fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:00.984747 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02568569-2216-4816-ab81-ee24c23a67fa service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:01.016233 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 859/1734] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:44:01.018235 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02568569-2216-4816-ab81-ee24c23a67fa service nova] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:01.023768 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-02568569-2216-4816-ab81-ee24c23a67fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:01.062272 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02568569-2216-4816-ab81-ee24c23a67fa service nova] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:01.191977 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:01.232349 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 876/1735] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Jul 21 03:44:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:01.266119 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb6249-1be8-40f9-a555-c92d1aa7058b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:01.266913 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb6249-1be8-40f9-a555-c92d1aa7058b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:01.267466 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb6249-1be8-40f9-a555-c92d1aa7058b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:01.303388 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-3bbb6249-1be8-40f9-a555-c92d1aa7058b None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:01.305027 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3bbb6249-1be8-40f9-a555-c92d1aa7058b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:01.333404 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6a1f2-d96c-47cf-9dd1-ec6bec2c0b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:01.334320 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6a1f2-d96c-47cf-9dd1-ec6bec2c0b7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:01.336377 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6a1f2-d96c-47cf-9dd1-ec6bec2c0b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:01.336685 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6a1f2-d96c-47cf-9dd1-ec6bec2c0b7a admin admin] PATH_INFO: `/v3/users/e8789af4d36544a3a8037e0dba0d51ea` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:01.341804 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6a1f2-d96c-47cf-9dd1-ec6bec2c0b7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8789af4d36544a3a8037e0dba0d51ea)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:01.344026 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6a1f2-d96c-47cf-9dd1-ec6bec2c0b7a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:01.453132 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-78a6a1f2-d96c-47cf-9dd1-ec6bec2c0b7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8789af4d36544a3a8037e0dba0d51ea'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:01.455300 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-78a6a1f2-d96c-47cf-9dd1-ec6bec2c0b7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8789af4d36544a3a8037e0dba0d51ea'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:01.455900 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-78a6a1f2-d96c-47cf-9dd1-ec6bec2c0b7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8789af4d36544a3a8037e0dba0d51ea'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:01.469131 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 877/1736] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:01.470551 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85058cb-0b58-493d-a763-3887d91b15c4 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:01.471276 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85058cb-0b58-493d-a763-3887d91b15c4 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:01.471276 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85058cb-0b58-493d-a763-3887d91b15c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:01.498286 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-78a6a1f2-d96c-47cf-9dd1-ec6bec2c0b7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8789af4d36544a3a8037e0dba0d51ea'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:01.518682 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-78a6a1f2-d96c-47cf-9dd1-ec6bec2c0b7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8789af4d36544a3a8037e0dba0d51ea'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:01.531370 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-c85058cb-0b58-493d-a763-3887d91b15c4 None None] MFA Rules not processed for user `d4c23288340747658efc15a9afa12aed`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:01.533046 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c85058cb-0b58-493d-a763-3887d91b15c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:01.559732 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 860/1737] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:44:01 2022] DELETE /identity/v3/users/e8789af4d36544a3a8037e0dba0d51ea => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:01.561010 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6a1f2-d96c-47cf-9dd1-ec6bec2c0b7a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:01.563564 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-78a6a1f2-d96c-47cf-9dd1-ec6bec2c0b7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:01.596386 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:01.762285 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 878/1738] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:01.763731 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85058cb-0b58-493d-a763-3887d91b15c4 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:01.787648 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6a1f2-d96c-47cf-9dd1-ec6bec2c0b7a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:01.789341 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85058cb-0b58-493d-a763-3887d91b15c4 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:01.833012 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e523346-4b6a-4954-b76c-811b1d029d77 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb39129b3ed04db28ed01860b37bd714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:01.833714 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e523346-4b6a-4954-b76c-811b1d029d77 service placement] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:01.834005 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e523346-4b6a-4954-b76c-811b1d029d77 service placement] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:01.835762 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e523346-4b6a-4954-b76c-811b1d029d77 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:01.839560 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4e523346-4b6a-4954-b76c-811b1d029d77 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:01.864675 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e523346-4b6a-4954-b76c-811b1d029d77 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:01.866375 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e523346-4b6a-4954-b76c-811b1d029d77 service placement] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:01.900908 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5ef6a-c185-472f-9b50-b3b4227b09d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:01.901649 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5ef6a-c185-472f-9b50-b3b4227b09d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:01.901934 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5ef6a-c185-472f-9b50-b3b4227b09d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:01.902226 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5ef6a-c185-472f-9b50-b3b4227b09d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:01.903004 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c5ef6a-c185-472f-9b50-b3b4227b09d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:44:01.903311 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c5ef6a-c185-472f-9b50-b3b4227b09d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:01.905000 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c5ef6a-c185-472f-9b50-b3b4227b09d4 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:01.912089 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 861/1739] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:44:01.914721 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e523346-4b6a-4954-b76c-811b1d029d77 service placement] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:01.920411 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4e523346-4b6a-4954-b76c-811b1d029d77 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:01.943608 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 879/1740] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:44:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:44:01.953750 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5ef6a-c185-472f-9b50-b3b4227b09d4 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:01.962894 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:01.968243 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5ef6a-c185-472f-9b50-b3b4227b09d4 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:01.977362 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d796b1-508e-4f2d-9c87-397bdfb980e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:01.977627 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d796b1-508e-4f2d-9c87-397bdfb980e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:01.977917 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d796b1-508e-4f2d-9c87-397bdfb980e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:01.980718 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d796b1-508e-4f2d-9c87-397bdfb980e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:01.981510 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d796b1-508e-4f2d-9c87-397bdfb980e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:01.983764 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d796b1-508e-4f2d-9c87-397bdfb980e2 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:02.024404 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 880/1741] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:44:01 2022] POST /identity/v3/projects => generated 369 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:02.028049 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d796b1-508e-4f2d-9c87-397bdfb980e2 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:02.063980 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e523346-4b6a-4954-b76c-811b1d029d77 service placement] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:02.183313 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d796b1-508e-4f2d-9c87-397bdfb980e2 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:02.193510 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2084249a-f7cf-49ae-bf2d-5cca1ec73337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:02.194320 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084249a-f7cf-49ae-bf2d-5cca1ec73337 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:02.195582 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084249a-f7cf-49ae-bf2d-5cca1ec73337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:02.196191 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084249a-f7cf-49ae-bf2d-5cca1ec73337 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:02.197051 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2084249a-f7cf-49ae-bf2d-5cca1ec73337 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:02.203456 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2084249a-f7cf-49ae-bf2d-5cca1ec73337 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:02.242704 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ddf1ef-f636-423e-8098-de4f5f638915 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:02.243404 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ddf1ef-f636-423e-8098-de4f5f638915 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:02.243693 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ddf1ef-f636-423e-8098-de4f5f638915 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:02.243973 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ddf1ef-f636-423e-8098-de4f5f638915 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:02.247858 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 881/1742] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:44:02 2022] POST /identity/v3/users => generated 285 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:44:02.251375 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2084249a-f7cf-49ae-bf2d-5cca1ec73337 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:02.255699 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2084249a-f7cf-49ae-bf2d-5cca1ec73337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:02.278483 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2084249a-f7cf-49ae-bf2d-5cca1ec73337 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:02.286434 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98ff95-1447-4488-8edc-8e7cd447a83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:02.287949 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98ff95-1447-4488-8edc-8e7cd447a83a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:02.288260 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98ff95-1447-4488-8edc-8e7cd447a83a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:02.288662 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98ff95-1447-4488-8edc-8e7cd447a83a admin admin] PATH_INFO: `/v3/projects/ebf27116f2c941ab9403e09b895c30a0` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:02.290196 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b98ff95-1447-4488-8edc-8e7cd447a83a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebf27116f2c941ab9403e09b895c30a0)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:02.315866 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b98ff95-1447-4488-8edc-8e7cd447a83a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:02.411844 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4b98ff95-1447-4488-8edc-8e7cd447a83a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebf27116f2c941ab9403e09b895c30a0', 'request_id': 'req-4b98ff95-1447-4488-8edc-8e7cd447a83a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:02.429115 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4b98ff95-1447-4488-8edc-8e7cd447a83a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebf27116f2c941ab9403e09b895c30a0', 'request_id': 'req-4b98ff95-1447-4488-8edc-8e7cd447a83a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:02.442743 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4b98ff95-1447-4488-8edc-8e7cd447a83a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebf27116f2c941ab9403e09b895c30a0', 'request_id': 'req-4b98ff95-1447-4488-8edc-8e7cd447a83a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:02.447600 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ddf1ef-f636-423e-8098-de4f5f638915 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:02.461558 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4b98ff95-1447-4488-8edc-8e7cd447a83a admin admin] The token cache is being invalidate because project ebf27116f2c941ab9403e09b895c30a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:44:02.461861 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4b98ff95-1447-4488-8edc-8e7cd447a83a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:02.463213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4b98ff95-1447-4488-8edc-8e7cd447a83a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:02.465756 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 882/1743] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:44:02 2022] DELETE /identity/v3/projects/ebf27116f2c941ab9403e09b895c30a0 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:02.466821 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98ff95-1447-4488-8edc-8e7cd447a83a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:02.469092 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ddf1ef-f636-423e-8098-de4f5f638915 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:02.469634 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4b98ff95-1447-4488-8edc-8e7cd447a83a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:02.520159 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 862/1744] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 607 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:44:02.521154 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ddf1ef-f636-423e-8098-de4f5f638915 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:02.574435 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ddf1ef-f636-423e-8098-de4f5f638915 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:02.587739 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:02.649724 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:02.659073 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98ff95-1447-4488-8edc-8e7cd447a83a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:02.687607 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee12a5-fb17-4bb5-b3b7-275f2533a1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:02.688944 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee12a5-fb17-4bb5-b3b7-275f2533a1be admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:02.689429 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee12a5-fb17-4bb5-b3b7-275f2533a1be admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:02.690109 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee12a5-fb17-4bb5-b3b7-275f2533a1be admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:02.691221 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ee12a5-fb17-4bb5-b3b7-275f2533a1be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:02.695990 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ee12a5-fb17-4bb5-b3b7-275f2533a1be admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:02.730162 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 883/1745] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:02 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:02.734909 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee12a5-fb17-4bb5-b3b7-275f2533a1be admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:02.767849 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee12a5-fb17-4bb5-b3b7-275f2533a1be admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:02.786883 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f5b97-548a-4431-85ef-cf95aa0624e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:02.787817 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f5b97-548a-4431-85ef-cf95aa0624e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:02.788182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f5b97-548a-4431-85ef-cf95aa0624e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:02.788531 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f5b97-548a-4431-85ef-cf95aa0624e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:02.789392 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1f5b97-548a-4431-85ef-cf95aa0624e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:02.791358 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1f5b97-548a-4431-85ef-cf95aa0624e9 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:02.820229 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 884/1746] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:02 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:02.830295 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f5b97-548a-4431-85ef-cf95aa0624e9 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:02.861273 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f5b97-548a-4431-85ef-cf95aa0624e9 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:02.866157 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ca20a-1114-4a83-963a-518a250752a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:02.867115 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ca20a-1114-4a83-963a-518a250752a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:02.867388 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ca20a-1114-4a83-963a-518a250752a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:02.867660 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ca20a-1114-4a83-963a-518a250752a6 admin admin] PATH_INFO: `/v3/projects/26fa5b3edbcc444fb2fe74f58cae7872/users/8fe0ae10a101462bbe68e85a00adcd40/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:02.877849 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70b176e-aafd-426c-a07e-0e76ab834f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:02.880055 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b176e-aafd-426c-a07e-0e76ab834f6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:02.880355 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b176e-aafd-426c-a07e-0e76ab834f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:02.880638 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70b176e-aafd-426c-a07e-0e76ab834f6d admin admin] PATH_INFO: `/v3/users/3072d072c50d4df6a7d02ea74c1862f9` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:02.884431 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70b176e-aafd-426c-a07e-0e76ab834f6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3072d072c50d4df6a7d02ea74c1862f9)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:02.890106 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70b176e-aafd-426c-a07e-0e76ab834f6d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:02.931498 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ca20a-1114-4a83-963a-518a250752a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26fa5b3edbcc444fb2fe74f58cae7872, user_id=8fe0ae10a101462bbe68e85a00adcd40, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:02.951798 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ca20a-1114-4a83-963a-518a250752a6 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:02.996688 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 885/1747] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:44:02 2022] PUT /identity/v3/projects/26fa5b3edbcc444fb2fe74f58cae7872/users/8fe0ae10a101462bbe68e85a00adcd40/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:02.996917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d70b176e-aafd-426c-a07e-0e76ab834f6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3072d072c50d4df6a7d02ea74c1862f9'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:02.997606 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d70b176e-aafd-426c-a07e-0e76ab834f6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3072d072c50d4df6a7d02ea74c1862f9'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:02.998229 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d70b176e-aafd-426c-a07e-0e76ab834f6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3072d072c50d4df6a7d02ea74c1862f9'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:02.999820 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ca20a-1114-4a83-963a-518a250752a6 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:03.011367 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-fd5ca20a-1114-4a83-963a-518a250752a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:03.027078 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d70b176e-aafd-426c-a07e-0e76ab834f6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3072d072c50d4df6a7d02ea74c1862f9'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:03.051756 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-d70b176e-aafd-426c-a07e-0e76ab834f6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3072d072c50d4df6a7d02ea74c1862f9'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:03.131443 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 863/1748] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:44:02 2022] DELETE /identity/v3/users/3072d072c50d4df6a7d02ea74c1862f9 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:03.133114 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f5aa3-4778-49c7-a1f9-617547bc1fc5 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:03.133554 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f5aa3-4778-49c7-a1f9-617547bc1fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:03.149487 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f5aa3-4778-49c7-a1f9-617547bc1fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:03.158919 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ca20a-1114-4a83-963a-518a250752a6 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:03.244655 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-814f5aa3-4778-49c7-a1f9-617547bc1fc5 None None] MFA Rules not processed for user `8fe0ae10a101462bbe68e85a00adcd40`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:03.247126 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-814f5aa3-4778-49c7-a1f9-617547bc1fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:03.296217 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4ad15-18b6-49c5-966f-f7e069f6d4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:03.297714 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4ad15-18b6-49c5-966f-f7e069f6d4ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:03.297714 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4ad15-18b6-49c5-966f-f7e069f6d4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:03.297714 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4ad15-18b6-49c5-966f-f7e069f6d4ab admin admin] PATH_INFO: `/v3/users/f21bb28bfbd94385b5758cdd9e87c136` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:03.305631 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4ad15-18b6-49c5-966f-f7e069f6d4ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=f21bb28bfbd94385b5758cdd9e87c136)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:03.307758 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4ad15-18b6-49c5-966f-f7e069f6d4ab admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:03.395866 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 864/1749] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:03 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:03.397958 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c5674-5b64-45f0-858b-4e1fa7a2b2f0 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:03.398258 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c5674-5b64-45f0-858b-4e1fa7a2b2f0 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:03.398567 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c5674-5b64-45f0-858b-4e1fa7a2b2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:03.411011 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4af4ad15-18b6-49c5-966f-f7e069f6d4ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f21bb28bfbd94385b5758cdd9e87c136'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:03.419021 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4af4ad15-18b6-49c5-966f-f7e069f6d4ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f21bb28bfbd94385b5758cdd9e87c136'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:03.419784 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4af4ad15-18b6-49c5-966f-f7e069f6d4ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f21bb28bfbd94385b5758cdd9e87c136'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:03.428195 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4af4ad15-18b6-49c5-966f-f7e069f6d4ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f21bb28bfbd94385b5758cdd9e87c136'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:03.437063 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:03.444200 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4af4ad15-18b6-49c5-966f-f7e069f6d4ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f21bb28bfbd94385b5758cdd9e87c136'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:03.446666 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:03.489578 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-390c5674-5b64-45f0-858b-4e1fa7a2b2f0 None None] MFA Rules not processed for user `73fad109df9f449e8ac5f38749c01ace`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:03.490139 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 886/1750] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:44:02 2022] DELETE /identity/v3/users/f21bb28bfbd94385b5758cdd9e87c136 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:03.490139 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4ad15-18b6-49c5-966f-f7e069f6d4ab admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:03.490397 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-390c5674-5b64-45f0-858b-4e1fa7a2b2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:03.494435 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4af4ad15-18b6-49c5-966f-f7e069f6d4ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:03.653201 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4ad15-18b6-49c5-966f-f7e069f6d4ab admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:03.670656 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ea238-1807-43bb-93c6-af2de72de5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:03.671573 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ea238-1807-43bb-93c6-af2de72de5f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:03.671866 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ea238-1807-43bb-93c6-af2de72de5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:03.672127 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ea238-1807-43bb-93c6-af2de72de5f8 admin admin] PATH_INFO: `/v3/users/b2439d27586b4ee2b7be2169c7339779` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:03.674144 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62ea238-1807-43bb-93c6-af2de72de5f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2439d27586b4ee2b7be2169c7339779)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:03.677021 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62ea238-1807-43bb-93c6-af2de72de5f8 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:03.722097 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 865/1751] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jul 21 03:44:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:03.724162 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c5674-5b64-45f0-858b-4e1fa7a2b2f0 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:03.729227 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-390c5674-5b64-45f0-858b-4e1fa7a2b2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:03.776154 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c5674-5b64-45f0-858b-4e1fa7a2b2f0 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:03.793844 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf3be4d-3694-428e-a5f7-762c287ccfad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:03.794556 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3be4d-3694-428e-a5f7-762c287ccfad admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:03.794946 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3be4d-3694-428e-a5f7-762c287ccfad admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:03.795261 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf3be4d-3694-428e-a5f7-762c287ccfad admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:03.796089 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf3be4d-3694-428e-a5f7-762c287ccfad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:03.798169 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf3be4d-3694-428e-a5f7-762c287ccfad admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:03.855706 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b62ea238-1807-43bb-93c6-af2de72de5f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2439d27586b4ee2b7be2169c7339779'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:03.861990 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b62ea238-1807-43bb-93c6-af2de72de5f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2439d27586b4ee2b7be2169c7339779'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:03.864001 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b62ea238-1807-43bb-93c6-af2de72de5f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2439d27586b4ee2b7be2169c7339779'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:03.891013 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b62ea238-1807-43bb-93c6-af2de72de5f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2439d27586b4ee2b7be2169c7339779'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:03.914678 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b62ea238-1807-43bb-93c6-af2de72de5f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2439d27586b4ee2b7be2169c7339779'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:03.920875 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 866/1752] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:44:03 2022] POST /identity/v3/projects => generated 369 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:03.933019 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e955b-5943-4524-ab73-d1c66178c6c3 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:03.933313 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e955b-5943-4524-ab73-d1c66178c6c3 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:03.934639 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e955b-5943-4524-ab73-d1c66178c6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:03.977265 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 887/1753] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:44:03 2022] DELETE /identity/v3/users/b2439d27586b4ee2b7be2169c7339779 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:03.986046 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ea238-1807-43bb-93c6-af2de72de5f8 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:03.989933 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d99e955b-5943-4524-ab73-d1c66178c6c3 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:03.991212 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d99e955b-5943-4524-ab73-d1c66178c6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:03.992163 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b62ea238-1807-43bb-93c6-af2de72de5f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:04.181431 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ea238-1807-43bb-93c6-af2de72de5f8 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:04.192845 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbbda14-91f3-49a0-b082-0433eb38f08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:04.193648 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 867/1754] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:04.194034 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbda14-91f3-49a0-b082-0433eb38f08a admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:04.194443 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbda14-91f3-49a0-b082-0433eb38f08a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:04.194877 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbbda14-91f3-49a0-b082-0433eb38f08a admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:04.195384 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a883aa-6091-45c2-958b-8c15c6f0a826 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:04.195675 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a883aa-6091-45c2-958b-8c15c6f0a826 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:04.195955 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a883aa-6091-45c2-958b-8c15c6f0a826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:04.196177 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbbda14-91f3-49a0-b082-0433eb38f08a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:04.198499 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbbda14-91f3-49a0-b082-0433eb38f08a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:04.219012 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:04.244700 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 888/1755] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:44:03 2022] POST /identity/v3/users => generated 291 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:04.246050 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbbda14-91f3-49a0-b082-0433eb38f08a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:04.251321 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ddbbda14-91f3-49a0-b082-0433eb38f08a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:04.275943 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-21a883aa-6091-45c2-958b-8c15c6f0a826 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:04.277065 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-21a883aa-6091-45c2-958b-8c15c6f0a826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:04.311676 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 868/1756] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:04.312353 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a883aa-6091-45c2-958b-8c15c6f0a826 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:04.343076 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a883aa-6091-45c2-958b-8c15c6f0a826 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:04.369073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7171c5-7e78-40be-b121-34ad5547ca8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:04.369823 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7171c5-7e78-40be-b121-34ad5547ca8e admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:04.370111 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7171c5-7e78-40be-b121-34ad5547ca8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:04.370386 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7171c5-7e78-40be-b121-34ad5547ca8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:04.371229 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7171c5-7e78-40be-b121-34ad5547ca8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:04.372873 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7171c5-7e78-40be-b121-34ad5547ca8e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:04.408807 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbbda14-91f3-49a0-b082-0433eb38f08a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:04.414604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 869/1757] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:04 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:04.415452 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7171c5-7e78-40be-b121-34ad5547ca8e admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:04.418819 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0b7171c5-7e78-40be-b121-34ad5547ca8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:04.426402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d95977-17fa-4e66-bb50-a2ced3fc9226 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8bc228892e45c0a7d1b529c2f9a8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:04.429107 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d95977-17fa-4e66-bb50-a2ced3fc9226 service swift] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:04.429792 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d95977-17fa-4e66-bb50-a2ced3fc9226 service swift] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:04.431691 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d95977-17fa-4e66-bb50-a2ced3fc9226 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:04.437533 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e9d95977-17fa-4e66-bb50-a2ced3fc9226 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:04.572377 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:04.580587 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7171c5-7e78-40be-b121-34ad5547ca8e admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:04.590890 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af340f21-4822-4d96-bd61-8111e0da6937 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:04.592781 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af340f21-4822-4d96-bd61-8111e0da6937 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:04.593224 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af340f21-4822-4d96-bd61-8111e0da6937 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:04.593521 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af340f21-4822-4d96-bd61-8111e0da6937 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:04.594599 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d95977-17fa-4e66-bb50-a2ced3fc9226 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:04.596964 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d95977-17fa-4e66-bb50-a2ced3fc9226 service swift] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:04.617472 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af340f21-4822-4d96-bd61-8111e0da6937 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:04.618580 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 889/1758] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jul 21 03:44:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 03:44:04.619442 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d95977-17fa-4e66-bb50-a2ced3fc9226 service swift] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:04.620789 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af340f21-4822-4d96-bd61-8111e0da6937 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:04.643132 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d95977-17fa-4e66-bb50-a2ced3fc9226 service swift] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:04.643667 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 870/1759] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:44:04.645677 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af340f21-4822-4d96-bd61-8111e0da6937 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:04.653993 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf4702-c1f8-46d6-8a74-b1f27a51fc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:04.655072 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf4702-c1f8-46d6-8a74-b1f27a51fc96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:04.655242 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf4702-c1f8-46d6-8a74-b1f27a51fc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:04.655933 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf4702-c1f8-46d6-8a74-b1f27a51fc96 admin admin] PATH_INFO: `/v3/projects/bb347bce68c84bd28e1363ea1bf12c2d/users/16f8f46686bd486ea82577ec329b0f9f/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:04.668517 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af340f21-4822-4d96-bd61-8111e0da6937 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:04.691574 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b16d01-8ca8-4489-b8c0-525eaed30a2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:04.700689 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b16d01-8ca8-4489-b8c0-525eaed30a2a service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:04.700974 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b16d01-8ca8-4489-b8c0-525eaed30a2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:04.701257 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b16d01-8ca8-4489-b8c0-525eaed30a2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:04.738279 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acf4702-c1f8-46d6-8a74-b1f27a51fc96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb347bce68c84bd28e1363ea1bf12c2d, user_id=16f8f46686bd486ea82577ec329b0f9f, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:04.741008 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acf4702-c1f8-46d6-8a74-b1f27a51fc96 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:04.758344 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b16d01-8ca8-4489-b8c0-525eaed30a2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:04.759931 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b16d01-8ca8-4489-b8c0-525eaed30a2a service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:04.787285 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 890/1760] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:44:04 2022] PUT /identity/v3/projects/bb347bce68c84bd28e1363ea1bf12c2d/users/16f8f46686bd486ea82577ec329b0f9f/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:04.799507 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf4702-c1f8-46d6-8a74-b1f27a51fc96 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:04.811192 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 871/1761] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:44:05.000637 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:05.079364 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf4702-c1f8-46d6-8a74-b1f27a51fc96 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:05.095952 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa7563-2cd1-4eac-a8d2-96715a7cda53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:05.095952 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa7563-2cd1-4eac-a8d2-96715a7cda53 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:05.096274 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa7563-2cd1-4eac-a8d2-96715a7cda53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:05.096540 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa7563-2cd1-4eac-a8d2-96715a7cda53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:05.101659 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa7563-2cd1-4eac-a8d2-96715a7cda53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:05.103798 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa7563-2cd1-4eac-a8d2-96715a7cda53 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:05.150478 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 891/1762] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:04 2022] GET /identity/v3/roles => generated 1420 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:05.155209 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b16d01-8ca8-4489-b8c0-525eaed30a2a service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:05.169069 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b16d01-8ca8-4489-b8c0-525eaed30a2a service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:05.183034 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153736c-7fe2-40af-97a5-1b71e1bfaa69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:05.185867 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa7563-2cd1-4eac-a8d2-96715a7cda53 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:05.187949 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-59fa7563-2cd1-4eac-a8d2-96715a7cda53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:05.200705 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153736c-7fe2-40af-97a5-1b71e1bfaa69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:05.201642 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153736c-7fe2-40af-97a5-1b71e1bfaa69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:05.201954 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153736c-7fe2-40af-97a5-1b71e1bfaa69 admin admin] PATH_INFO: `/v3/projects/bb347bce68c84bd28e1363ea1bf12c2d/users/16f8f46686bd486ea82577ec329b0f9f/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:05.213596 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1153736c-7fe2-40af-97a5-1b71e1bfaa69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb347bce68c84bd28e1363ea1bf12c2d, user_id=16f8f46686bd486ea82577ec329b0f9f, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:05.228926 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1153736c-7fe2-40af-97a5-1b71e1bfaa69 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:05.234335 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa7563-2cd1-4eac-a8d2-96715a7cda53 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:05.247718 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89851d01-c105-4c21-9026-cbd5f8faeec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:05.248786 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89851d01-c105-4c21-9026-cbd5f8faeec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:05.249077 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89851d01-c105-4c21-9026-cbd5f8faeec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:05.249364 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89851d01-c105-4c21-9026-cbd5f8faeec4 admin admin] PATH_INFO: `/v3/projects/fb915d798de3451387a2721c0a220be7` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:05.256683 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89851d01-c105-4c21-9026-cbd5f8faeec4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb915d798de3451387a2721c0a220be7)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:05.258388 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89851d01-c105-4c21-9026-cbd5f8faeec4 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:05.286491 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 872/1763] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:44:05 2022] PUT /identity/v3/projects/bb347bce68c84bd28e1363ea1bf12c2d/users/16f8f46686bd486ea82577ec329b0f9f/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:05.289994 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac77d32-b8bb-467b-b2e0-2c88f1c48bf0 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:05.290291 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac77d32-b8bb-467b-b2e0-2c88f1c48bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:05.290610 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac77d32-b8bb-467b-b2e0-2c88f1c48bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:05.390483 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-dac77d32-b8bb-467b-b2e0-2c88f1c48bf0 None None] MFA Rules not processed for user `16f8f46686bd486ea82577ec329b0f9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:05.393876 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-dac77d32-b8bb-467b-b2e0-2c88f1c48bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:05.458382 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-89851d01-c105-4c21-9026-cbd5f8faeec4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb915d798de3451387a2721c0a220be7', 'request_id': 'req-89851d01-c105-4c21-9026-cbd5f8faeec4'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:05.531091 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-89851d01-c105-4c21-9026-cbd5f8faeec4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb915d798de3451387a2721c0a220be7', 'request_id': 'req-89851d01-c105-4c21-9026-cbd5f8faeec4'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:05.577147 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-89851d01-c105-4c21-9026-cbd5f8faeec4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb915d798de3451387a2721c0a220be7', 'request_id': 'req-89851d01-c105-4c21-9026-cbd5f8faeec4'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:05.625579 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-89851d01-c105-4c21-9026-cbd5f8faeec4 admin admin] The token cache is being invalidate because project fb915d798de3451387a2721c0a220be7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:44:05.625880 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-89851d01-c105-4c21-9026-cbd5f8faeec4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:05.630999 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-89851d01-c105-4c21-9026-cbd5f8faeec4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:05.648407 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 892/1764] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:44:05 2022] DELETE /identity/v3/projects/fb915d798de3451387a2721c0a220be7 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:05.653439 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff412f4c-ed59-4117-9684-e3b2a9cf074b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:05.653739 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff412f4c-ed59-4117-9684-e3b2a9cf074b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:05.654018 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff412f4c-ed59-4117-9684-e3b2a9cf074b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:05.747790 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-ff412f4c-ed59-4117-9684-e3b2a9cf074b None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:05.749046 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ff412f4c-ed59-4117-9684-e3b2a9cf074b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:05.806224 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 873/1765] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:05 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 517 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:44:05.821594 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d18d3-d1b7-4d36-b3e8-294cc34d4881 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:05.822505 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d18d3-d1b7-4d36-b3e8-294cc34d4881 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:05.823284 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d18d3-d1b7-4d36-b3e8-294cc34d4881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:05.875911 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d72d18d3-d1b7-4d36-b3e8-294cc34d4881 None None] MFA Rules not processed for user `8d4f1b27da1540339cb16efcb079135f`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:05.883918 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d72d18d3-d1b7-4d36-b3e8-294cc34d4881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:05.958330 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 893/1766] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:05.959265 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff412f4c-ed59-4117-9684-e3b2a9cf074b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:05.961217 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ff412f4c-ed59-4117-9684-e3b2a9cf074b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:06.101888 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff412f4c-ed59-4117-9684-e3b2a9cf074b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:06.114710 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46a6e3-eb42-45f9-b9a2-538f83baa7b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:06.117541 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46a6e3-eb42-45f9-b9a2-538f83baa7b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:06.118278 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46a6e3-eb42-45f9-b9a2-538f83baa7b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:06.120210 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46a6e3-eb42-45f9-b9a2-538f83baa7b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:06.158039 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46a6e3-eb42-45f9-b9a2-538f83baa7b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:06.163750 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46a6e3-eb42-45f9-b9a2-538f83baa7b5 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:06.167813 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 874/1767] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:06.169262 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505e42f-7eaa-4c36-ad67-ef826c99ed09 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:06.169554 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505e42f-7eaa-4c36-ad67-ef826c99ed09 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:06.169833 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7505e42f-7eaa-4c36-ad67-ef826c99ed09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:06.223285 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 894/1768] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:05 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:44:06.235876 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-7505e42f-7eaa-4c36-ad67-ef826c99ed09 None None] MFA Rules not processed for user `9f13db57fa094debba1664160b6c4b46`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:06.237321 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7505e42f-7eaa-4c36-ad67-ef826c99ed09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:06.242415 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adae89a-3464-49b7-9120-b2d4653c80de None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:06.242678 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adae89a-3464-49b7-9120-b2d4653c80de None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:06.247827 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adae89a-3464-49b7-9120-b2d4653c80de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:06.300394 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:06.360265 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 875/1769] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:06.376782 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-6adae89a-3464-49b7-9120-b2d4653c80de None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:06.389674 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6adae89a-3464-49b7-9120-b2d4653c80de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:06.423091 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505e42f-7eaa-4c36-ad67-ef826c99ed09 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:06.424537 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7505e42f-7eaa-4c36-ad67-ef826c99ed09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:06.441629 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 895/1770] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:06.444549 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adae89a-3464-49b7-9120-b2d4653c80de None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:06.465860 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:06.486802 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adae89a-3464-49b7-9120-b2d4653c80de None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:06.515329 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba96b8-6e57-489c-934c-f32b03ffa8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:06.519335 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba96b8-6e57-489c-934c-f32b03ffa8f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:06.520924 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba96b8-6e57-489c-934c-f32b03ffa8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:06.521218 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba96b8-6e57-489c-934c-f32b03ffa8f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:06.524078 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba96b8-6e57-489c-934c-f32b03ffa8f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:44:06.524362 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba96b8-6e57-489c-934c-f32b03ffa8f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:06.550105 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba96b8-6e57-489c-934c-f32b03ffa8f2 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:06.604878 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 896/1771] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:44:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:44:06.610687 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba96b8-6e57-489c-934c-f32b03ffa8f2 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:06.658534 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba96b8-6e57-489c-934c-f32b03ffa8f2 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:06.673045 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eeedca-4453-4036-8eb9-833eec849e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:06.673865 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eeedca-4453-4036-8eb9-833eec849e35 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:06.674218 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eeedca-4453-4036-8eb9-833eec849e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:06.674613 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eeedca-4453-4036-8eb9-833eec849e35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:06.675328 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eeedca-4453-4036-8eb9-833eec849e35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:06.680051 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eeedca-4453-4036-8eb9-833eec849e35 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:06.709255 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7505e42f-7eaa-4c36-ad67-ef826c99ed09 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:06.730515 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbba38b-509e-4f1d-adf4-2c20e8bb3666 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:06.731289 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbba38b-509e-4f1d-adf4-2c20e8bb3666 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:06.731635 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbba38b-509e-4f1d-adf4-2c20e8bb3666 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:06.731767 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbba38b-509e-4f1d-adf4-2c20e8bb3666 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:06.762249 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbba38b-509e-4f1d-adf4-2c20e8bb3666 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:06.764194 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbba38b-509e-4f1d-adf4-2c20e8bb3666 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:06.799046 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 876/1772] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:44:06.799510 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 897/1773] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:44:06 2022] POST /identity/v3/projects => generated 373 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:06.825977 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbba38b-509e-4f1d-adf4-2c20e8bb3666 service nova] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:06.863898 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbba38b-509e-4f1d-adf4-2c20e8bb3666 service nova] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:07.020507 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4772e-2818-41f9-9ad9-d9d7f558d8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:07.022849 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4772e-2818-41f9-9ad9-d9d7f558d8a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:07.023323 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4772e-2818-41f9-9ad9-d9d7f558d8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:07.024030 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4772e-2818-41f9-9ad9-d9d7f558d8a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:07.025843 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4772e-2818-41f9-9ad9-d9d7f558d8a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:07.060566 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4772e-2818-41f9-9ad9-d9d7f558d8a0 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:07.147115 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 877/1774] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:44:06 2022] POST /identity/v3/users => generated 287 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:07.151445 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eeedca-4453-4036-8eb9-833eec849e35 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:07.164414 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eeedca-4453-4036-8eb9-833eec849e35 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:07.177634 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af19439-28e6-47fe-9192-da9868641368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:07.178448 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af19439-28e6-47fe-9192-da9868641368 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:07.181108 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af19439-28e6-47fe-9192-da9868641368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:07.181449 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af19439-28e6-47fe-9192-da9868641368 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:07.183623 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af19439-28e6-47fe-9192-da9868641368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:07.190832 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af19439-28e6-47fe-9192-da9868641368 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:07.238127 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4772e-2818-41f9-9ad9-d9d7f558d8a0 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:07.245333 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 898/1775] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:07.255308 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4772e-2818-41f9-9ad9-d9d7f558d8a0 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:07.277696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede37e3-8dbe-4be1-87aa-6aa4da94dfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:07.278658 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede37e3-8dbe-4be1-87aa-6aa4da94dfb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:07.279074 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede37e3-8dbe-4be1-87aa-6aa4da94dfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:07.279443 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede37e3-8dbe-4be1-87aa-6aa4da94dfb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:07.280311 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ede37e3-8dbe-4be1-87aa-6aa4da94dfb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:07.282502 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ede37e3-8dbe-4be1-87aa-6aa4da94dfb5 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:07.354668 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af19439-28e6-47fe-9192-da9868641368 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:07.364158 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 878/1776] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 03:44:07.375870 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af19439-28e6-47fe-9192-da9868641368 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:07.394133 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7af55-95e2-4ab6-9b39-9f73ca3efa5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:07.398424 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7af55-95e2-4ab6-9b39-9f73ca3efa5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:07.404151 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7af55-95e2-4ab6-9b39-9f73ca3efa5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:07.404772 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7af55-95e2-4ab6-9b39-9f73ca3efa5a admin admin] PATH_INFO: `/v3/projects/b846d79115b3423399935fbe5918025d/users/4534dd62f34846ea9c1d9fc318aed55e/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:07.469699 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7af55-95e2-4ab6-9b39-9f73ca3efa5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b846d79115b3423399935fbe5918025d, user_id=4534dd62f34846ea9c1d9fc318aed55e, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:07.473001 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7af55-95e2-4ab6-9b39-9f73ca3efa5a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:07.539342 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 899/1777] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:44:07 2022] PUT /identity/v3/projects/b846d79115b3423399935fbe5918025d/users/4534dd62f34846ea9c1d9fc318aed55e/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:44:07.553067 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3d0d0-ebc2-4c68-aee4-a4fc6b23c699 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:07.553563 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3d0d0-ebc2-4c68-aee4-a4fc6b23c699 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:07.553948 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3d0d0-ebc2-4c68-aee4-a4fc6b23c699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:07.623883 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-90e3d0d0-ebc2-4c68-aee4-a4fc6b23c699 None None] MFA Rules not processed for user `4534dd62f34846ea9c1d9fc318aed55e`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:07.627866 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-90e3d0d0-ebc2-4c68-aee4-a4fc6b23c699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:07.788895 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:07.913177 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 879/1778] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:44:07.917814 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7af55-95e2-4ab6-9b39-9f73ca3efa5a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:08.075381 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7af55-95e2-4ab6-9b39-9f73ca3efa5a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:08.086717 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b75fd-d6ee-4df3-86cf-6af04d0a3e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:08.087598 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b75fd-d6ee-4df3-86cf-6af04d0a3e5f admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:08.088231 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b75fd-d6ee-4df3-86cf-6af04d0a3e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:08.088841 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b75fd-d6ee-4df3-86cf-6af04d0a3e5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:08.089985 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b75fd-d6ee-4df3-86cf-6af04d0a3e5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:08.097228 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b75fd-d6ee-4df3-86cf-6af04d0a3e5f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:08.202620 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 900/1779] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:44:07 2022] POST /identity/v3/projects => generated 371 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:08.204103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3d0d0-ebc2-4c68-aee4-a4fc6b23c699 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:08.221816 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3d0d0-ebc2-4c68-aee4-a4fc6b23c699 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:08.503485 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83edb0-b673-40c5-85d7-93fff553fae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:08.505203 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83edb0-b673-40c5-85d7-93fff553fae2 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:08.505732 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83edb0-b673-40c5-85d7-93fff553fae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:08.506265 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83edb0-b673-40c5-85d7-93fff553fae2 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:08.507294 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d83edb0-b673-40c5-85d7-93fff553fae2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:08.509609 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d83edb0-b673-40c5-85d7-93fff553fae2 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:08.556218 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 880/1780] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:44:08 2022] POST /identity/v3/users => generated 292 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:08.561597 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83edb0-b673-40c5-85d7-93fff553fae2 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:08.565724 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6713a93-b315-457f-b3ba-8227107d447b None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:08.566280 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6713a93-b315-457f-b3ba-8227107d447b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:08.569131 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6713a93-b315-457f-b3ba-8227107d447b None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:08.569131 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 901/1781] 10.222.0.20 () {54 vars in 912 bytes} [Thu Jul 21 03:44:08 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:44:08.574501 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb26e9-ffdd-4032-9f70-5c5e260fe936 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:08.574854 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb26e9-ffdd-4032-9f70-5c5e260fe936 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:08.575070 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb26e9-ffdd-4032-9f70-5c5e260fe936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:08.584721 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83edb0-b673-40c5-85d7-93fff553fae2 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:08.595867 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72421936-6df1-494a-9fb2-75b690b311a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:08.596748 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72421936-6df1-494a-9fb2-75b690b311a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:08.597122 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72421936-6df1-494a-9fb2-75b690b311a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:08.598658 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72421936-6df1-494a-9fb2-75b690b311a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:08.599419 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72421936-6df1-494a-9fb2-75b690b311a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:08.601088 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72421936-6df1-494a-9fb2-75b690b311a5 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:08.650718 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 881/1782] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:08.652065 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d937226-9762-42e0-8833-1b6ca787a2a6 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:08.652470 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d937226-9762-42e0-8833-1b6ca787a2a6 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:08.652687 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d937226-9762-42e0-8833-1b6ca787a2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:08.653431 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e7cb26e9-ffdd-4032-9f70-5c5e260fe936 None None] MFA Rules not processed for user `b68c257254de483ab65eb5dc5684a704`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:08.654742 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e7cb26e9-ffdd-4032-9f70-5c5e260fe936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:08.692476 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-0d937226-9762-42e0-8833-1b6ca787a2a6 None None] MFA Rules not processed for user `b68c257254de483ab65eb5dc5684a704`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:08.693753 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0d937226-9762-42e0-8833-1b6ca787a2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:08.832256 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 902/1783] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jul 21 03:44:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:08.833697 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb26e9-ffdd-4032-9f70-5c5e260fe936 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:08.835433 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e7cb26e9-ffdd-4032-9f70-5c5e260fe936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:08.875044 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb26e9-ffdd-4032-9f70-5c5e260fe936 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:08.895831 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 882/1784] 10.222.0.36 () {58 vars in 1015 bytes} [Thu Jul 21 03:44:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:08.898031 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d937226-9762-42e0-8833-1b6ca787a2a6 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:08.910305 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc759d3e-9a01-44a2-97e6-335a82afc840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:08.910305 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc759d3e-9a01-44a2-97e6-335a82afc840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:08.910305 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc759d3e-9a01-44a2-97e6-335a82afc840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:08.910305 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc759d3e-9a01-44a2-97e6-335a82afc840 admin admin] PATH_INFO: `/v3/projects/319b71bb480544d2bbe8b5c3b4ec243c` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:08.921339 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc759d3e-9a01-44a2-97e6-335a82afc840 admin admin] RBAC: Authorizing `identity:delete_project(project_id=319b71bb480544d2bbe8b5c3b4ec243c)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:08.923554 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc759d3e-9a01-44a2-97e6-335a82afc840 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:08.954851 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d937226-9762-42e0-8833-1b6ca787a2a6 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:08.974782 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc4b96-321b-4a47-a64c-6ab30224a9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:08.979218 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc4b96-321b-4a47-a64c-6ab30224a9c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:08.980314 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc4b96-321b-4a47-a64c-6ab30224a9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:08.984166 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efc4b96-321b-4a47-a64c-6ab30224a9c3 admin admin] PATH_INFO: `/v3/projects/ab043741963440e3a16afb258f6dba70/users/396eb173ce004f59a32bbb2562474da3/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:09.007855 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:09.055792 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc4b96-321b-4a47-a64c-6ab30224a9c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab043741963440e3a16afb258f6dba70, user_id=396eb173ce004f59a32bbb2562474da3, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:09.059389 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efc4b96-321b-4a47-a64c-6ab30224a9c3 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:09.111166 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 883/1785] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:44:08 2022] PUT /identity/v3/projects/ab043741963440e3a16afb258f6dba70/users/396eb173ce004f59a32bbb2562474da3/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:09.116026 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc4b96-321b-4a47-a64c-6ab30224a9c3 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:09.121597 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9efc4b96-321b-4a47-a64c-6ab30224a9c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:09.124039 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fc759d3e-9a01-44a2-97e6-335a82afc840 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '319b71bb480544d2bbe8b5c3b4ec243c', 'request_id': 'req-fc759d3e-9a01-44a2-97e6-335a82afc840'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:09.147326 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fc759d3e-9a01-44a2-97e6-335a82afc840 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '319b71bb480544d2bbe8b5c3b4ec243c', 'request_id': 'req-fc759d3e-9a01-44a2-97e6-335a82afc840'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:09.173759 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fc759d3e-9a01-44a2-97e6-335a82afc840 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '319b71bb480544d2bbe8b5c3b4ec243c', 'request_id': 'req-fc759d3e-9a01-44a2-97e6-335a82afc840'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:09.200545 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fc759d3e-9a01-44a2-97e6-335a82afc840 admin admin] The token cache is being invalidate because project 319b71bb480544d2bbe8b5c3b4ec243c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:44:09.201774 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fc759d3e-9a01-44a2-97e6-335a82afc840 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:09.202853 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fc759d3e-9a01-44a2-97e6-335a82afc840 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:09.208732 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 903/1786] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:44:08 2022] DELETE /identity/v3/projects/319b71bb480544d2bbe8b5c3b4ec243c => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:09.209553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc759d3e-9a01-44a2-97e6-335a82afc840 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:09.213246 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-fc759d3e-9a01-44a2-97e6-335a82afc840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:09.301564 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:09.349154 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efc4b96-321b-4a47-a64c-6ab30224a9c3 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:09.360662 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc95ad4-4e72-42d2-8c5a-b1e3daf8e6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:09.362925 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc95ad4-4e72-42d2-8c5a-b1e3daf8e6f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:09.365529 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc95ad4-4e72-42d2-8c5a-b1e3daf8e6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:09.365821 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc95ad4-4e72-42d2-8c5a-b1e3daf8e6f9 admin admin] PATH_INFO: `/v3/projects/32fad15a4404418da143654da624421b` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:09.369445 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc95ad4-4e72-42d2-8c5a-b1e3daf8e6f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32fad15a4404418da143654da624421b)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:09.377155 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc95ad4-4e72-42d2-8c5a-b1e3daf8e6f9 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:09.392269 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc759d3e-9a01-44a2-97e6-335a82afc840 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:09.470494 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ce66a-a602-4345-b5d6-c7be22633a03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:09.471224 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ce66a-a602-4345-b5d6-c7be22633a03 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:09.471512 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ce66a-a602-4345-b5d6-c7be22633a03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:09.471849 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ce66a-a602-4345-b5d6-c7be22633a03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:09.486510 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-445ce66a-a602-4345-b5d6-c7be22633a03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:09.499760 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ce66a-a602-4345-b5d6-c7be22633a03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:09.502573 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445ce66a-a602-4345-b5d6-c7be22633a03 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:09.514376 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 904/1787] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:44:09.515705 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ce66a-a602-4345-b5d6-c7be22633a03 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:09.517524 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-445ce66a-a602-4345-b5d6-c7be22633a03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:09.537038 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ce66a-a602-4345-b5d6-c7be22633a03 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:09.542903 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cce04-f718-43df-aa26-03f84af01b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:09.544355 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cce04-f718-43df-aa26-03f84af01b03 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:09.544870 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cce04-f718-43df-aa26-03f84af01b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:09.545335 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cce04-f718-43df-aa26-03f84af01b03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:09.546822 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2cce04-f718-43df-aa26-03f84af01b03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:09.553323 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2cce04-f718-43df-aa26-03f84af01b03 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:09.578793 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 905/1788] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:09.580821 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cce04-f718-43df-aa26-03f84af01b03 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:09.604314 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ad2cce04-f718-43df-aa26-03f84af01b03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:09.610430 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3fc95ad4-4e72-42d2-8c5a-b1e3daf8e6f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32fad15a4404418da143654da624421b', 'request_id': 'req-3fc95ad4-4e72-42d2-8c5a-b1e3daf8e6f9'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:09.631199 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3fc95ad4-4e72-42d2-8c5a-b1e3daf8e6f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32fad15a4404418da143654da624421b', 'request_id': 'req-3fc95ad4-4e72-42d2-8c5a-b1e3daf8e6f9'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:09.639863 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cce04-f718-43df-aa26-03f84af01b03 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:09.650242 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3fc95ad4-4e72-42d2-8c5a-b1e3daf8e6f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32fad15a4404418da143654da624421b', 'request_id': 'req-3fc95ad4-4e72-42d2-8c5a-b1e3daf8e6f9'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:09.712949 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3fc95ad4-4e72-42d2-8c5a-b1e3daf8e6f9 admin admin] The token cache is being invalidate because project 32fad15a4404418da143654da624421b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:44:09.712949 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3fc95ad4-4e72-42d2-8c5a-b1e3daf8e6f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:09.712949 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3fc95ad4-4e72-42d2-8c5a-b1e3daf8e6f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:09.715935 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 884/1789] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:44:09 2022] DELETE /identity/v3/projects/32fad15a4404418da143654da624421b => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:09.717380 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc95ad4-4e72-42d2-8c5a-b1e3daf8e6f9 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:09.723746 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3fc95ad4-4e72-42d2-8c5a-b1e3daf8e6f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:09.869187 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b6e82-d979-4262-a251-848bf06cd5f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:09.872078 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b6e82-d979-4262-a251-848bf06cd5f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:09.873157 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b6e82-d979-4262-a251-848bf06cd5f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:09.874787 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b6e82-d979-4262-a251-848bf06cd5f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:09.879839 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4a0b6e82-d979-4262-a251-848bf06cd5f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:09.908905 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0b6e82-d979-4262-a251-848bf06cd5f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:09.915018 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0b6e82-d979-4262-a251-848bf06cd5f6 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:09.935690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc95ad4-4e72-42d2-8c5a-b1e3daf8e6f9 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:09.946701 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d84b243-17fd-4379-a75c-d1bfeafb2c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:09.948196 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84b243-17fd-4379-a75c-d1bfeafb2c2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:09.948196 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84b243-17fd-4379-a75c-d1bfeafb2c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:09.953584 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d84b243-17fd-4379-a75c-d1bfeafb2c2e admin admin] PATH_INFO: `/v3/users/d4c23288340747658efc15a9afa12aed` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:09.955402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 906/1790] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:44:09.956234 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d84b243-17fd-4379-a75c-d1bfeafb2c2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4c23288340747658efc15a9afa12aed)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:09.956779 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b6e82-d979-4262-a251-848bf06cd5f6 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:09.967979 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d84b243-17fd-4379-a75c-d1bfeafb2c2e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:09.969340 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4a0b6e82-d979-4262-a251-848bf06cd5f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:10.001622 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:10.024495 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b6e82-d979-4262-a251-848bf06cd5f6 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:10.083919 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34882eb-ad1f-40e4-9f32-41d48c9cb328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:10.089531 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34882eb-ad1f-40e4-9f32-41d48c9cb328 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:10.090270 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34882eb-ad1f-40e4-9f32-41d48c9cb328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:10.092338 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34882eb-ad1f-40e4-9f32-41d48c9cb328 admin admin] PATH_INFO: `/v3/projects/ab043741963440e3a16afb258f6dba70/users/396eb173ce004f59a32bbb2562474da3/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:10.101036 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34882eb-ad1f-40e4-9f32-41d48c9cb328 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab043741963440e3a16afb258f6dba70, user_id=396eb173ce004f59a32bbb2562474da3, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:10.118260 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34882eb-ad1f-40e4-9f32-41d48c9cb328 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:10.127057 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4d84b243-17fd-4379-a75c-d1bfeafb2c2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4c23288340747658efc15a9afa12aed'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:10.128104 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4d84b243-17fd-4379-a75c-d1bfeafb2c2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4c23288340747658efc15a9afa12aed'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:10.129719 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4d84b243-17fd-4379-a75c-d1bfeafb2c2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4c23288340747658efc15a9afa12aed'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:10.178470 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4d84b243-17fd-4379-a75c-d1bfeafb2c2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4c23288340747658efc15a9afa12aed'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:10.197104 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4d84b243-17fd-4379-a75c-d1bfeafb2c2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4c23288340747658efc15a9afa12aed'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:10.205559 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 907/1791] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:44:09 2022] PUT /identity/v3/projects/ab043741963440e3a16afb258f6dba70/users/396eb173ce004f59a32bbb2562474da3/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:10.214634 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34882eb-ad1f-40e4-9f32-41d48c9cb328 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:10.223149 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b34882eb-ad1f-40e4-9f32-41d48c9cb328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:10.253573 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:10.315529 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 885/1792] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:44:09 2022] DELETE /identity/v3/users/d4c23288340747658efc15a9afa12aed => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:10.323089 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d970e-8ade-4b28-a802-4a36014dc3c0 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:10.323492 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d970e-8ade-4b28-a802-4a36014dc3c0 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:10.325351 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d970e-8ade-4b28-a802-4a36014dc3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:10.391397 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-a78d970e-8ade-4b28-a802-4a36014dc3c0 None None] MFA Rules not processed for user `52f492a1c5f5474d86a6ac8f0348321b`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:10.392681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a78d970e-8ade-4b28-a802-4a36014dc3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:10.429362 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34882eb-ad1f-40e4-9f32-41d48c9cb328 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:10.573274 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678bd4d0-ae96-4950-972f-6abff1fe1450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:10.574296 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678bd4d0-ae96-4950-972f-6abff1fe1450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:10.574610 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678bd4d0-ae96-4950-972f-6abff1fe1450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:10.574887 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678bd4d0-ae96-4950-972f-6abff1fe1450 admin admin] PATH_INFO: `/v3/users/2b5f63bdbf36446282f04ce69efc9279` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:10.576617 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678bd4d0-ae96-4950-972f-6abff1fe1450 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b5f63bdbf36446282f04ce69efc9279)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:10.578704 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678bd4d0-ae96-4950-972f-6abff1fe1450 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:10.639429 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 886/1793] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:10.639429 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d970e-8ade-4b28-a802-4a36014dc3c0 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:10.639681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a78d970e-8ade-4b28-a802-4a36014dc3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:10.664348 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d970e-8ade-4b28-a802-4a36014dc3c0 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:10.681951 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b05f8-a518-437d-be1f-f4d8178c504f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:10.683239 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b05f8-a518-437d-be1f-f4d8178c504f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:10.683727 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b05f8-a518-437d-be1f-f4d8178c504f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:10.684198 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b05f8-a518-437d-be1f-f4d8178c504f admin admin] PATH_INFO: `/v3/users/8fe0ae10a101462bbe68e85a00adcd40` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:10.687652 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b05f8-a518-437d-be1f-f4d8178c504f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fe0ae10a101462bbe68e85a00adcd40)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:10.690029 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b05f8-a518-437d-be1f-f4d8178c504f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:10.692874 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-678bd4d0-ae96-4950-972f-6abff1fe1450 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b5f63bdbf36446282f04ce69efc9279'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:10.693910 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-678bd4d0-ae96-4950-972f-6abff1fe1450 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b5f63bdbf36446282f04ce69efc9279'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:10.699340 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-678bd4d0-ae96-4950-972f-6abff1fe1450 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b5f63bdbf36446282f04ce69efc9279'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:10.714525 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-678bd4d0-ae96-4950-972f-6abff1fe1450 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b5f63bdbf36446282f04ce69efc9279'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:10.730791 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-678bd4d0-ae96-4950-972f-6abff1fe1450 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b5f63bdbf36446282f04ce69efc9279'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:10.786562 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 908/1794] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:44:10 2022] DELETE /identity/v3/users/2b5f63bdbf36446282f04ce69efc9279 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:10.788052 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38154dba-ec1d-43dd-8209-2bdc615fa285 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:10.789738 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38154dba-ec1d-43dd-8209-2bdc615fa285 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:10.791114 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38154dba-ec1d-43dd-8209-2bdc615fa285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:10.797571 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f53b05f8-a518-437d-be1f-f4d8178c504f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fe0ae10a101462bbe68e85a00adcd40'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:10.798521 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f53b05f8-a518-437d-be1f-f4d8178c504f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fe0ae10a101462bbe68e85a00adcd40'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:10.800123 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f53b05f8-a518-437d-be1f-f4d8178c504f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fe0ae10a101462bbe68e85a00adcd40'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:10.824224 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f53b05f8-a518-437d-be1f-f4d8178c504f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fe0ae10a101462bbe68e85a00adcd40'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:10.846186 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f53b05f8-a518-437d-be1f-f4d8178c504f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fe0ae10a101462bbe68e85a00adcd40'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:10.895480 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-38154dba-ec1d-43dd-8209-2bdc615fa285 None None] MFA Rules not processed for user `396eb173ce004f59a32bbb2562474da3`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:10.898595 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-38154dba-ec1d-43dd-8209-2bdc615fa285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:10.910930 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 887/1795] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:44:10 2022] DELETE /identity/v3/users/8fe0ae10a101462bbe68e85a00adcd40 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:10.912789 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:10.916951 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c780360-3f23-4fd5-be0f-ebdddc8b999d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:10.917550 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c780360-3f23-4fd5-be0f-ebdddc8b999d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:10.918040 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c780360-3f23-4fd5-be0f-ebdddc8b999d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:10.963834 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-8c780360-3f23-4fd5-be0f-ebdddc8b999d None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:10.965364 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8c780360-3f23-4fd5-be0f-ebdddc8b999d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:11.106875 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 909/1796] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:10 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:11.121738 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38154dba-ec1d-43dd-8209-2bdc615fa285 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:11.123308 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-38154dba-ec1d-43dd-8209-2bdc615fa285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:11.130002 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 888/1797] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:11.241741 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c780360-3f23-4fd5-be0f-ebdddc8b999d None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:11.243402 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8c780360-3f23-4fd5-be0f-ebdddc8b999d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:11.268309 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:11.367965 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38154dba-ec1d-43dd-8209-2bdc615fa285 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:11.432079 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c780360-3f23-4fd5-be0f-ebdddc8b999d None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:11.444692 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464943b-2bec-4291-8720-62fea6408b0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:11.445461 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464943b-2bec-4291-8720-62fea6408b0d service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:11.445823 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464943b-2bec-4291-8720-62fea6408b0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:11.446174 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464943b-2bec-4291-8720-62fea6408b0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:11.467557 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f464943b-2bec-4291-8720-62fea6408b0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:11.469150 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f464943b-2bec-4291-8720-62fea6408b0d service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:11.493256 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 889/1798] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:44:11.496697 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc2696-5557-44d3-9627-af43d025526c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:11.499857 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc2696-5557-44d3-9627-af43d025526c service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:11.506006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc2696-5557-44d3-9627-af43d025526c service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:11.506348 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc2696-5557-44d3-9627-af43d025526c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:11.638389 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bc2696-5557-44d3-9627-af43d025526c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:11.639890 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bc2696-5557-44d3-9627-af43d025526c service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:11.671851 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 910/1799] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:11 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:44:12.732436 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464943b-2bec-4291-8720-62fea6408b0d service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:12.735307 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f464943b-2bec-4291-8720-62fea6408b0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:12.763709 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464943b-2bec-4291-8720-62fea6408b0d service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:12.805380 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280a664-5e26-4583-b178-888af548a104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:12.806778 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280a664-5e26-4583-b178-888af548a104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:12.807269 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280a664-5e26-4583-b178-888af548a104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:12.807932 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280a664-5e26-4583-b178-888af548a104 admin admin] PATH_INFO: `/v3/users/4534dd62f34846ea9c1d9fc318aed55e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:12.809557 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a280a664-5e26-4583-b178-888af548a104 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4534dd62f34846ea9c1d9fc318aed55e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:12.812053 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a280a664-5e26-4583-b178-888af548a104 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:12.952277 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a280a664-5e26-4583-b178-888af548a104 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4534dd62f34846ea9c1d9fc318aed55e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:12.954330 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a280a664-5e26-4583-b178-888af548a104 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4534dd62f34846ea9c1d9fc318aed55e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:12.959869 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a280a664-5e26-4583-b178-888af548a104 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4534dd62f34846ea9c1d9fc318aed55e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:12.984465 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a280a664-5e26-4583-b178-888af548a104 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4534dd62f34846ea9c1d9fc318aed55e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:13.003020 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a280a664-5e26-4583-b178-888af548a104 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4534dd62f34846ea9c1d9fc318aed55e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:13.063682 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 890/1800] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:44:12 2022] DELETE /identity/v3/users/4534dd62f34846ea9c1d9fc318aed55e => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:13.068844 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5626cc-7f58-4abe-823b-105bd1028253 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:13.069786 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5626cc-7f58-4abe-823b-105bd1028253 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:13.070275 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5626cc-7f58-4abe-823b-105bd1028253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:13.087332 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:13.114365 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-6c5626cc-7f58-4abe-823b-105bd1028253 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:13.115759 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6c5626cc-7f58-4abe-823b-105bd1028253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:13.279646 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 911/1801] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:13.321791 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280a664-5e26-4583-b178-888af548a104 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:13.323468 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a280a664-5e26-4583-b178-888af548a104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:13.521264 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280a664-5e26-4583-b178-888af548a104 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:13.543004 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648279a-30f4-422d-b5fd-247350a1f878 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:13.543862 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648279a-30f4-422d-b5fd-247350a1f878 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:13.544287 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648279a-30f4-422d-b5fd-247350a1f878 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:13.544683 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648279a-30f4-422d-b5fd-247350a1f878 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:13.583555 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648279a-30f4-422d-b5fd-247350a1f878 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:13.589877 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648279a-30f4-422d-b5fd-247350a1f878 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:13.636021 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 891/1802] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:44:14.203224 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5626cc-7f58-4abe-823b-105bd1028253 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:14.204696 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6c5626cc-7f58-4abe-823b-105bd1028253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:14.227305 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5626cc-7f58-4abe-823b-105bd1028253 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:14.246711 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13738c3-1d7b-4dd9-9fae-ce6788aadf96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:14.247937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13738c3-1d7b-4dd9-9fae-ce6788aadf96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:14.248378 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13738c3-1d7b-4dd9-9fae-ce6788aadf96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:14.248913 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13738c3-1d7b-4dd9-9fae-ce6788aadf96 admin admin] PATH_INFO: `/v3/projects/baec9c3d8d4b4269a8030939fb32b1f8` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:14.250897 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13738c3-1d7b-4dd9-9fae-ce6788aadf96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=baec9c3d8d4b4269a8030939fb32b1f8)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:14.255343 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13738c3-1d7b-4dd9-9fae-ce6788aadf96 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:14.380742 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e13738c3-1d7b-4dd9-9fae-ce6788aadf96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baec9c3d8d4b4269a8030939fb32b1f8', 'request_id': 'req-e13738c3-1d7b-4dd9-9fae-ce6788aadf96'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:14.387668 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648279a-30f4-422d-b5fd-247350a1f878 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:14.390011 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f648279a-30f4-422d-b5fd-247350a1f878 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:14.408836 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e13738c3-1d7b-4dd9-9fae-ce6788aadf96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baec9c3d8d4b4269a8030939fb32b1f8', 'request_id': 'req-e13738c3-1d7b-4dd9-9fae-ce6788aadf96'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:14.420153 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648279a-30f4-422d-b5fd-247350a1f878 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:14.436551 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e13738c3-1d7b-4dd9-9fae-ce6788aadf96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baec9c3d8d4b4269a8030939fb32b1f8', 'request_id': 'req-e13738c3-1d7b-4dd9-9fae-ce6788aadf96'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:14.470483 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e13738c3-1d7b-4dd9-9fae-ce6788aadf96 admin admin] The token cache is being invalidate because project baec9c3d8d4b4269a8030939fb32b1f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:44:14.470483 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e13738c3-1d7b-4dd9-9fae-ce6788aadf96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:14.474969 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e13738c3-1d7b-4dd9-9fae-ce6788aadf96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:14.484451 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 912/1803] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:44:14 2022] DELETE /identity/v3/projects/baec9c3d8d4b4269a8030939fb32b1f8 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:44:14.489615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737d538-f0e0-44a7-8192-01f52727e943 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:14.490116 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737d538-f0e0-44a7-8192-01f52727e943 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:14.490554 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4737d538-f0e0-44a7-8192-01f52727e943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:14.519157 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:14.561266 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-4737d538-f0e0-44a7-8192-01f52727e943 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:14.563974 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4737d538-f0e0-44a7-8192-01f52727e943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:14.608909 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1442ba-ff9f-487a-bf74-77e79e5143e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:14.609778 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1442ba-ff9f-487a-bf74-77e79e5143e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:14.610043 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1442ba-ff9f-487a-bf74-77e79e5143e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:14.610407 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1442ba-ff9f-487a-bf74-77e79e5143e8 admin admin] PATH_INFO: `/v3/projects/31c6a0d54bb04e19896faeeca2172ed8` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:14.614964 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1442ba-ff9f-487a-bf74-77e79e5143e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31c6a0d54bb04e19896faeeca2172ed8)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:14.627022 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1442ba-ff9f-487a-bf74-77e79e5143e8 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:14.705591 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 913/1804] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:44:14.714876 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02734fee-b484-4671-8e98-12dd56e29c72 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:14.715374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02734fee-b484-4671-8e98-12dd56e29c72 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:14.715685 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02734fee-b484-4671-8e98-12dd56e29c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:14.749888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7c1442ba-ff9f-487a-bf74-77e79e5143e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31c6a0d54bb04e19896faeeca2172ed8', 'request_id': 'req-7c1442ba-ff9f-487a-bf74-77e79e5143e8'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:14.760633 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7c1442ba-ff9f-487a-bf74-77e79e5143e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31c6a0d54bb04e19896faeeca2172ed8', 'request_id': 'req-7c1442ba-ff9f-487a-bf74-77e79e5143e8'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:14.786977 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7c1442ba-ff9f-487a-bf74-77e79e5143e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31c6a0d54bb04e19896faeeca2172ed8', 'request_id': 'req-7c1442ba-ff9f-487a-bf74-77e79e5143e8'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:14.792688 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-02734fee-b484-4671-8e98-12dd56e29c72 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:14.799495 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-02734fee-b484-4671-8e98-12dd56e29c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:14.812785 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7c1442ba-ff9f-487a-bf74-77e79e5143e8 admin admin] The token cache is being invalidate because project 31c6a0d54bb04e19896faeeca2172ed8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:44:14.813082 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7c1442ba-ff9f-487a-bf74-77e79e5143e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:14.818960 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-7c1442ba-ff9f-487a-bf74-77e79e5143e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:14.821911 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 892/1805] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:44:14 2022] DELETE /identity/v3/projects/31c6a0d54bb04e19896faeeca2172ed8 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:14.822544 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1442ba-ff9f-487a-bf74-77e79e5143e8 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:14.834296 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7c1442ba-ff9f-487a-bf74-77e79e5143e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:14.880248 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:14.987300 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 914/1806] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:44:14.989456 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e1c9e-b791-4ef6-93ad-0d06fc732202 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:14.989749 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e1c9e-b791-4ef6-93ad-0d06fc732202 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:14.990032 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e1c9e-b791-4ef6-93ad-0d06fc732202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:15.012807 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1442ba-ff9f-487a-bf74-77e79e5143e8 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:15.039317 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e87927-d9dd-43ff-842e-3f0500972f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:15.040276 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e87927-d9dd-43ff-842e-3f0500972f26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:15.040513 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e87927-d9dd-43ff-842e-3f0500972f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:15.040841 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e87927-d9dd-43ff-842e-3f0500972f26 admin admin] PATH_INFO: `/v3/projects/26fa5b3edbcc444fb2fe74f58cae7872` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:15.043574 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e87927-d9dd-43ff-842e-3f0500972f26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26fa5b3edbcc444fb2fe74f58cae7872)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:15.045526 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e87927-d9dd-43ff-842e-3f0500972f26 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:15.064304 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-168e1c9e-b791-4ef6-93ad-0d06fc732202 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:15.065649 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-168e1c9e-b791-4ef6-93ad-0d06fc732202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:15.095125 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 915/1807] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:15.095994 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e1c9e-b791-4ef6-93ad-0d06fc732202 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:15.127901 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e1c9e-b791-4ef6-93ad-0d06fc732202 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:15.154920 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244354f4-a625-4761-8070-a1df9536f764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:15.155606 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244354f4-a625-4761-8070-a1df9536f764 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:15.155893 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244354f4-a625-4761-8070-a1df9536f764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:15.156174 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244354f4-a625-4761-8070-a1df9536f764 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:15.157178 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244354f4-a625-4761-8070-a1df9536f764 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:44:15.157488 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244354f4-a625-4761-8070-a1df9536f764 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:15.159180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244354f4-a625-4761-8070-a1df9536f764 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:15.204025 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-34e87927-d9dd-43ff-842e-3f0500972f26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26fa5b3edbcc444fb2fe74f58cae7872', 'request_id': 'req-34e87927-d9dd-43ff-842e-3f0500972f26'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:15.208690 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 916/1808] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:44:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:44:15.209787 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e59a2-85ce-408e-b07a-1104615cfb61 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:15.210088 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e59a2-85ce-408e-b07a-1104615cfb61 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:15.210427 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e59a2-85ce-408e-b07a-1104615cfb61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:15.225965 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-34e87927-d9dd-43ff-842e-3f0500972f26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26fa5b3edbcc444fb2fe74f58cae7872', 'request_id': 'req-34e87927-d9dd-43ff-842e-3f0500972f26'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:15.230884 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:15.243963 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-34e87927-d9dd-43ff-842e-3f0500972f26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26fa5b3edbcc444fb2fe74f58cae7872', 'request_id': 'req-34e87927-d9dd-43ff-842e-3f0500972f26'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:15.268388 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d11e59a2-85ce-408e-b07a-1104615cfb61 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:15.279584 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d11e59a2-85ce-408e-b07a-1104615cfb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:15.283864 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-34e87927-d9dd-43ff-842e-3f0500972f26 admin admin] The token cache is being invalidate because project 26fa5b3edbcc444fb2fe74f58cae7872 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:44:15.284211 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-34e87927-d9dd-43ff-842e-3f0500972f26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:15.285205 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-34e87927-d9dd-43ff-842e-3f0500972f26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:15.292254 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 893/1809] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:44:14 2022] DELETE /identity/v3/projects/26fa5b3edbcc444fb2fe74f58cae7872 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:15.292254 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e87927-d9dd-43ff-842e-3f0500972f26 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:15.295702 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-34e87927-d9dd-43ff-842e-3f0500972f26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:15.435730 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 917/1810] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:15.436721 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e59a2-85ce-408e-b07a-1104615cfb61 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:15.438662 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d11e59a2-85ce-408e-b07a-1104615cfb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:15.476825 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e59a2-85ce-408e-b07a-1104615cfb61 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:15.499255 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e87927-d9dd-43ff-842e-3f0500972f26 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:15.500379 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873245bd-2095-4caa-8fa7-25c9764fa925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:15.501322 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873245bd-2095-4caa-8fa7-25c9764fa925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:15.501693 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873245bd-2095-4caa-8fa7-25c9764fa925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:15.502042 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873245bd-2095-4caa-8fa7-25c9764fa925 admin admin] PATH_INFO: `/v3/users/16f8f46686bd486ea82577ec329b0f9f` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:15.504168 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873245bd-2095-4caa-8fa7-25c9764fa925 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16f8f46686bd486ea82577ec329b0f9f)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:15.506331 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873245bd-2095-4caa-8fa7-25c9764fa925 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:15.509790 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0a8c1-b89c-4189-82c1-9f8e2d003e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:15.510851 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0a8c1-b89c-4189-82c1-9f8e2d003e66 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:15.511137 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0a8c1-b89c-4189-82c1-9f8e2d003e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:15.511538 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d0a8c1-b89c-4189-82c1-9f8e2d003e66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:15.512442 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0a8c1-b89c-4189-82c1-9f8e2d003e66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:15.520887 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d0a8c1-b89c-4189-82c1-9f8e2d003e66 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:15.594344 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 894/1811] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:44:15 2022] POST /identity/v3/projects => generated 365 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:15.595500 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0a8c1-b89c-4189-82c1-9f8e2d003e66 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:15.621080 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-873245bd-2095-4caa-8fa7-25c9764fa925 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16f8f46686bd486ea82577ec329b0f9f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:15.621700 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-873245bd-2095-4caa-8fa7-25c9764fa925 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16f8f46686bd486ea82577ec329b0f9f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:15.622418 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-873245bd-2095-4caa-8fa7-25c9764fa925 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16f8f46686bd486ea82577ec329b0f9f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:15.635294 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-873245bd-2095-4caa-8fa7-25c9764fa925 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16f8f46686bd486ea82577ec329b0f9f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:15.656863 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-873245bd-2095-4caa-8fa7-25c9764fa925 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16f8f46686bd486ea82577ec329b0f9f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:15.695895 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 918/1812] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:44:15 2022] DELETE /identity/v3/users/16f8f46686bd486ea82577ec329b0f9f => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:15.696768 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873245bd-2095-4caa-8fa7-25c9764fa925 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:15.699863 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-873245bd-2095-4caa-8fa7-25c9764fa925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:15.759832 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:15.798772 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d0a8c1-b89c-4189-82c1-9f8e2d003e66 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:15.902098 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873245bd-2095-4caa-8fa7-25c9764fa925 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:15.929657 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515e10c-aa1e-40ea-9152-451e5471f0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:15.930403 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515e10c-aa1e-40ea-9152-451e5471f0f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:15.930779 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515e10c-aa1e-40ea-9152-451e5471f0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:15.930990 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515e10c-aa1e-40ea-9152-451e5471f0f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:15.931706 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3515e10c-aa1e-40ea-9152-451e5471f0f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:15.949283 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3515e10c-aa1e-40ea-9152-451e5471f0f9 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:16.013388 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5413a-2659-4dda-8990-20835ad7c670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:16.014690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5413a-2659-4dda-8990-20835ad7c670 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:16.015172 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5413a-2659-4dda-8990-20835ad7c670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:16.015630 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5413a-2659-4dda-8990-20835ad7c670 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:16.016554 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5413a-2659-4dda-8990-20835ad7c670 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:44:16.017084 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5413a-2659-4dda-8990-20835ad7c670 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:16.021597 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 919/1813] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:44:15 2022] POST /identity/v3/users => generated 283 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:16.026434 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515e10c-aa1e-40ea-9152-451e5471f0f9 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:16.027895 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5413a-2659-4dda-8990-20835ad7c670 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:16.053130 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515e10c-aa1e-40ea-9152-451e5471f0f9 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:16.065155 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 895/1814] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:44:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 470 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:44:16.070309 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5413a-2659-4dda-8990-20835ad7c670 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:16.078396 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8ed5413a-2659-4dda-8990-20835ad7c670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:16.092316 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f182946-c569-4fd4-badc-68d19d595458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:16.096223 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f182946-c569-4fd4-badc-68d19d595458 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:16.096517 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f182946-c569-4fd4-badc-68d19d595458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:16.096849 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f182946-c569-4fd4-badc-68d19d595458 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:16.097583 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f182946-c569-4fd4-badc-68d19d595458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:16.099269 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f182946-c569-4fd4-badc-68d19d595458 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:16.108618 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5413a-2659-4dda-8990-20835ad7c670 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:16.130379 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3701a7-fd65-48f4-b1d2-dc45a4bd8fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:16.131468 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3701a7-fd65-48f4-b1d2-dc45a4bd8fdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:16.131821 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3701a7-fd65-48f4-b1d2-dc45a4bd8fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:16.133976 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3701a7-fd65-48f4-b1d2-dc45a4bd8fdf admin admin] PATH_INFO: `/v3/projects/b846d79115b3423399935fbe5918025d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:16.135591 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3701a7-fd65-48f4-b1d2-dc45a4bd8fdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b846d79115b3423399935fbe5918025d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:16.137905 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3701a7-fd65-48f4-b1d2-dc45a4bd8fdf admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:16.158146 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:16.221921 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 920/1815] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:16.229702 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f182946-c569-4fd4-badc-68d19d595458 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:16.241529 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0f182946-c569-4fd4-badc-68d19d595458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:16.268968 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ac3701a7-fd65-48f4-b1d2-dc45a4bd8fdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b846d79115b3423399935fbe5918025d', 'request_id': 'req-ac3701a7-fd65-48f4-b1d2-dc45a4bd8fdf'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:16.282584 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ac3701a7-fd65-48f4-b1d2-dc45a4bd8fdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b846d79115b3423399935fbe5918025d', 'request_id': 'req-ac3701a7-fd65-48f4-b1d2-dc45a4bd8fdf'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:16.305754 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ac3701a7-fd65-48f4-b1d2-dc45a4bd8fdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b846d79115b3423399935fbe5918025d', 'request_id': 'req-ac3701a7-fd65-48f4-b1d2-dc45a4bd8fdf'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:16.313007 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f182946-c569-4fd4-badc-68d19d595458 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:16.355558 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ac3701a7-fd65-48f4-b1d2-dc45a4bd8fdf admin admin] The token cache is being invalidate because project b846d79115b3423399935fbe5918025d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:44:16.356178 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ac3701a7-fd65-48f4-b1d2-dc45a4bd8fdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:16.358411 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ac3701a7-fd65-48f4-b1d2-dc45a4bd8fdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:16.365182 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 896/1816] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:44:16 2022] DELETE /identity/v3/projects/b846d79115b3423399935fbe5918025d => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:16.365182 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3701a7-fd65-48f4-b1d2-dc45a4bd8fdf admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:16.376523 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ac3701a7-fd65-48f4-b1d2-dc45a4bd8fdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:16.658283 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55955cf8-ba7b-424a-ae6b-02649a4ad2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:16.661839 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55955cf8-ba7b-424a-ae6b-02649a4ad2e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:16.662175 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55955cf8-ba7b-424a-ae6b-02649a4ad2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:16.664037 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55955cf8-ba7b-424a-ae6b-02649a4ad2e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:16.665109 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55955cf8-ba7b-424a-ae6b-02649a4ad2e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:16.667494 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55955cf8-ba7b-424a-ae6b-02649a4ad2e0 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:16.704105 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3701a7-fd65-48f4-b1d2-dc45a4bd8fdf admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:16.725087 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef16859-1ce2-4c47-9b69-c8ce402350cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:16.725788 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef16859-1ce2-4c47-9b69-c8ce402350cc admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:16.726076 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef16859-1ce2-4c47-9b69-c8ce402350cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:16.726401 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef16859-1ce2-4c47-9b69-c8ce402350cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:16.727219 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef16859-1ce2-4c47-9b69-c8ce402350cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:16.728990 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef16859-1ce2-4c47-9b69-c8ce402350cc admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:16.761386 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 897/1817] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:16 2022] GET /identity/v3/roles => generated 1420 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:16.767579 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd65a75-9df4-4d2a-863c-2ac64d3cf04b None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:16.768061 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd65a75-9df4-4d2a-863c-2ac64d3cf04b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:16.768492 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd65a75-9df4-4d2a-863c-2ac64d3cf04b None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:16.774729 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 898/1818] 10.222.0.20 () {54 vars in 921 bytes} [Thu Jul 21 03:44:16 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:44:16.775778 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd65a75-9df4-4d2a-863c-2ac64d3cf04b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:16.787544 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2bd65a75-9df4-4d2a-863c-2ac64d3cf04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:16.804453 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 921/1819] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:44:16 2022] POST /identity/v3/projects => generated 379 bytes in 577 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:16.806512 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55955cf8-ba7b-424a-ae6b-02649a4ad2e0 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:17.093476 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55955cf8-ba7b-424a-ae6b-02649a4ad2e0 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:17.114303 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd65a75-9df4-4d2a-863c-2ac64d3cf04b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:17.122576 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099fad8a-a127-474d-bb87-810cc3899867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:17.127545 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fad8a-a127-474d-bb87-810cc3899867 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:17.129775 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fad8a-a127-474d-bb87-810cc3899867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:17.131251 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da03f3-82dc-42b2-80d2-7fc293f2bbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:17.132715 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099fad8a-a127-474d-bb87-810cc3899867 admin admin] PATH_INFO: `/v3/projects/1aadf0d1b1c047fe95bfd118d4611ee5/users/85c92ef589c341788ce793891d44bd9d/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:17.137103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da03f3-82dc-42b2-80d2-7fc293f2bbfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:17.137103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da03f3-82dc-42b2-80d2-7fc293f2bbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:17.137103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da03f3-82dc-42b2-80d2-7fc293f2bbfd admin admin] PATH_INFO: `/v3/users/396eb173ce004f59a32bbb2562474da3` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:17.144758 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da03f3-82dc-42b2-80d2-7fc293f2bbfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=396eb173ce004f59a32bbb2562474da3)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:17.155230 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da03f3-82dc-42b2-80d2-7fc293f2bbfd admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:17.214229 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099fad8a-a127-474d-bb87-810cc3899867 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aadf0d1b1c047fe95bfd118d4611ee5, user_id=85c92ef589c341788ce793891d44bd9d, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:17.224437 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099fad8a-a127-474d-bb87-810cc3899867 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:17.258826 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 922/1820] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:44:16 2022] PUT /identity/v3/projects/1aadf0d1b1c047fe95bfd118d4611ee5/users/85c92ef589c341788ce793891d44bd9d/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:17.270849 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099fad8a-a127-474d-bb87-810cc3899867 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:17.280133 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:17.291118 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-099fad8a-a127-474d-bb87-810cc3899867 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:17.315132 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e7da03f3-82dc-42b2-80d2-7fc293f2bbfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '396eb173ce004f59a32bbb2562474da3'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:17.317796 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e7da03f3-82dc-42b2-80d2-7fc293f2bbfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '396eb173ce004f59a32bbb2562474da3'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:17.319925 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e7da03f3-82dc-42b2-80d2-7fc293f2bbfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '396eb173ce004f59a32bbb2562474da3'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:17.349379 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e7da03f3-82dc-42b2-80d2-7fc293f2bbfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '396eb173ce004f59a32bbb2562474da3'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:17.355910 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:17.395911 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-e7da03f3-82dc-42b2-80d2-7fc293f2bbfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '396eb173ce004f59a32bbb2562474da3'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:17.476824 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 899/1821] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:44:16 2022] DELETE /identity/v3/users/396eb173ce004f59a32bbb2562474da3 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:17.481247 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9654cfb-7f6a-4ce4-80be-9e0ecf6eb613 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:17.484996 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9654cfb-7f6a-4ce4-80be-9e0ecf6eb613 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:17.486224 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9654cfb-7f6a-4ce4-80be-9e0ecf6eb613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:17.492132 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099fad8a-a127-474d-bb87-810cc3899867 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:17.578532 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-a9654cfb-7f6a-4ce4-80be-9e0ecf6eb613 None None] MFA Rules not processed for user `cefbe2d0c739428ab0d4dfeaed6c37ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:17.581018 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a9654cfb-7f6a-4ce4-80be-9e0ecf6eb613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:17.658573 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf79c25-4b56-4649-84ee-9bddcaaf2a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:17.661228 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf79c25-4b56-4649-84ee-9bddcaaf2a0f admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:17.676567 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf79c25-4b56-4649-84ee-9bddcaaf2a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:17.677853 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf79c25-4b56-4649-84ee-9bddcaaf2a0f admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:17.678680 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf79c25-4b56-4649-84ee-9bddcaaf2a0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:17.693272 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf79c25-4b56-4649-84ee-9bddcaaf2a0f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:17.778988 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 923/1822] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:44:17 2022] POST /identity/v3/users => generated 290 bytes in 515 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:17.780524 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2103f-8c35-4575-be2f-fc4365edeebb None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:17.780813 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2103f-8c35-4575-be2f-fc4365edeebb None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:17.781094 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a2103f-8c35-4575-be2f-fc4365edeebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:17.819787 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 900/1823] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Jul 21 03:44:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:17.820904 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9654cfb-7f6a-4ce4-80be-9e0ecf6eb613 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:17.822702 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a9654cfb-7f6a-4ce4-80be-9e0ecf6eb613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:17.843131 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9654cfb-7f6a-4ce4-80be-9e0ecf6eb613 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:17.854451 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b2d9f-ab24-412f-a425-eea13cf94a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:17.855480 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b2d9f-ab24-412f-a425-eea13cf94a9e admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:17.855781 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b2d9f-ab24-412f-a425-eea13cf94a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:17.856188 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b2d9f-ab24-412f-a425-eea13cf94a9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:17.857837 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b2d9f-ab24-412f-a425-eea13cf94a9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:17.867671 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b2d9f-ab24-412f-a425-eea13cf94a9e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:17.889986 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 901/1824] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:17.891290 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b2d9f-ab24-412f-a425-eea13cf94a9e admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:17.895080 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-81a2103f-8c35-4575-be2f-fc4365edeebb None None] MFA Rules not processed for user `85c92ef589c341788ce793891d44bd9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:17.901091 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-81a2103f-8c35-4575-be2f-fc4365edeebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:17.909342 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b2d9f-ab24-412f-a425-eea13cf94a9e admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:17.919215 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5986eca-3e1a-4248-8dc1-55cb3595b524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:17.920333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5986eca-3e1a-4248-8dc1-55cb3595b524 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:17.920670 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5986eca-3e1a-4248-8dc1-55cb3595b524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:17.920955 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5986eca-3e1a-4248-8dc1-55cb3595b524 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:17.921755 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5986eca-3e1a-4248-8dc1-55cb3595b524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:17.923795 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5986eca-3e1a-4248-8dc1-55cb3595b524 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:17.945098 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 902/1825] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:17 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:17.946572 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5986eca-3e1a-4248-8dc1-55cb3595b524 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:17.961034 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5986eca-3e1a-4248-8dc1-55cb3595b524 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:17.967962 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed9e7b1-1a94-43aa-bb66-a5c3b1f2b30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:17.969316 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9e7b1-1a94-43aa-bb66-a5c3b1f2b30b admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:17.969688 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9e7b1-1a94-43aa-bb66-a5c3b1f2b30b admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:17.970600 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9e7b1-1a94-43aa-bb66-a5c3b1f2b30b admin admin] PATH_INFO: `/v3/projects/7f72c33e8f5e4b6daa02846935570d50/users/3b646e2f3d9b46259508e3c76bdad733/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:18.000839 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed9e7b1-1a94-43aa-bb66-a5c3b1f2b30b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f72c33e8f5e4b6daa02846935570d50, user_id=3b646e2f3d9b46259508e3c76bdad733, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:18.005644 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed9e7b1-1a94-43aa-bb66-a5c3b1f2b30b admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:18.040604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 903/1826] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:44:17 2022] PUT /identity/v3/projects/7f72c33e8f5e4b6daa02846935570d50/users/3b646e2f3d9b46259508e3c76bdad733/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:18.042876 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33bf780-f301-4e79-99f8-8a3205895eb0 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:18.043401 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33bf780-f301-4e79-99f8-8a3205895eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:18.043887 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33bf780-f301-4e79-99f8-8a3205895eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:18.116204 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c33bf780-f301-4e79-99f8-8a3205895eb0 None None] MFA Rules not processed for user `3b646e2f3d9b46259508e3c76bdad733`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:18.118103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c33bf780-f301-4e79-99f8-8a3205895eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:18.153402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 924/1827] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:17 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:18.160050 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2103f-8c35-4575-be2f-fc4365edeebb None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:18.164532 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-81a2103f-8c35-4575-be2f-fc4365edeebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:18.224364 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a2103f-8c35-4575-be2f-fc4365edeebb None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:18.305172 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:18.397544 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 904/1828] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:18.397544 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb39e3-aef7-4897-b379-282e68a5b4c9 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:18.397544 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb39e3-aef7-4897-b379-282e68a5b4c9 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:18.397544 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeb39e3-aef7-4897-b379-282e68a5b4c9 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:18.404327 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 905/1829] 10.222.0.20 () {54 vars in 921 bytes} [Thu Jul 21 03:44:18 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:44:18.405047 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb39e3-aef7-4897-b379-282e68a5b4c9 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:18.432499 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:18.502778 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d421c3-2272-4f6e-ad2a-7d3c79fefa2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:18.504697 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d421c3-2272-4f6e-ad2a-7d3c79fefa2b admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:18.505085 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d421c3-2272-4f6e-ad2a-7d3c79fefa2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:18.505802 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d421c3-2272-4f6e-ad2a-7d3c79fefa2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:18.507278 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d421c3-2272-4f6e-ad2a-7d3c79fefa2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:18.509791 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d421c3-2272-4f6e-ad2a-7d3c79fefa2b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:18.564845 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 925/1830] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:44:18 2022] POST /identity/v3/projects => generated 365 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:18.566320 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd68736-a38c-4300-b4cc-14cab5006d74 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:18.567663 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd68736-a38c-4300-b4cc-14cab5006d74 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:18.568303 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd68736-a38c-4300-b4cc-14cab5006d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:18.615525 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-5dd68736-a38c-4300-b4cc-14cab5006d74 None None] MFA Rules not processed for user `cefbe2d0c739428ab0d4dfeaed6c37ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:18.616509 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5dd68736-a38c-4300-b4cc-14cab5006d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:18.652105 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeb39e3-aef7-4897-b379-282e68a5b4c9 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:18.839853 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 926/1831] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Jul 21 03:44:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:18.841598 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd68736-a38c-4300-b4cc-14cab5006d74 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:18.903298 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6714a9-ce42-403e-9fa9-cb3340b989f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:18.904105 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6714a9-ce42-403e-9fa9-cb3340b989f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:18.904563 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6714a9-ce42-403e-9fa9-cb3340b989f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:18.904909 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6714a9-ce42-403e-9fa9-cb3340b989f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:18.905788 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6714a9-ce42-403e-9fa9-cb3340b989f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:18.909098 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6714a9-ce42-403e-9fa9-cb3340b989f2 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:18.975403 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 906/1832] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:44:18 2022] POST /identity/v3/projects => generated 381 bytes in 571 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:18.979709 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6714a9-ce42-403e-9fa9-cb3340b989f2 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:18.981511 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ef6714a9-ce42-403e-9fa9-cb3340b989f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:18.985227 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd68736-a38c-4300-b4cc-14cab5006d74 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:19.076444 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ae665-679f-49ef-ade3-3cc3ccaa2a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:19.077178 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ae665-679f-49ef-ade3-3cc3ccaa2a4f admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:19.077464 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ae665-679f-49ef-ade3-3cc3ccaa2a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:19.078129 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3ae665-679f-49ef-ade3-3cc3ccaa2a4f admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:19.078978 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3ae665-679f-49ef-ade3-3cc3ccaa2a4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:19.083825 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3ae665-679f-49ef-ade3-3cc3ccaa2a4f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:19.098808 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:19.121253 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 927/1833] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:44:18 2022] POST /identity/v3/users => generated 289 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:19.123320 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ae665-679f-49ef-ade3-3cc3ccaa2a4f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:19.128002 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-fb3ae665-679f-49ef-ade3-3cc3ccaa2a4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:19.146639 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6714a9-ce42-403e-9fa9-cb3340b989f2 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:19.162418 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76357e30-52aa-47b1-ab7e-7741707d36d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:19.163316 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76357e30-52aa-47b1-ab7e-7741707d36d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:19.163686 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76357e30-52aa-47b1-ab7e-7741707d36d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:19.163875 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76357e30-52aa-47b1-ab7e-7741707d36d8 admin admin] PATH_INFO: `/v3/projects/ab043741963440e3a16afb258f6dba70` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:19.167166 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76357e30-52aa-47b1-ab7e-7741707d36d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab043741963440e3a16afb258f6dba70)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:19.169314 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76357e30-52aa-47b1-ab7e-7741707d36d8 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:19.202883 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:19.263537 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-76357e30-52aa-47b1-ab7e-7741707d36d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab043741963440e3a16afb258f6dba70', 'request_id': 'req-76357e30-52aa-47b1-ab7e-7741707d36d8'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:19.272435 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-76357e30-52aa-47b1-ab7e-7741707d36d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab043741963440e3a16afb258f6dba70', 'request_id': 'req-76357e30-52aa-47b1-ab7e-7741707d36d8'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:19.295682 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-76357e30-52aa-47b1-ab7e-7741707d36d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab043741963440e3a16afb258f6dba70', 'request_id': 'req-76357e30-52aa-47b1-ab7e-7741707d36d8'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:19.321627 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-76357e30-52aa-47b1-ab7e-7741707d36d8 admin admin] The token cache is being invalidate because project ab043741963440e3a16afb258f6dba70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:44:19.322145 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-76357e30-52aa-47b1-ab7e-7741707d36d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:19.323943 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-76357e30-52aa-47b1-ab7e-7741707d36d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:19.325138 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3ae665-679f-49ef-ade3-3cc3ccaa2a4f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:19.326368 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 907/1834] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:44:18 2022] DELETE /identity/v3/projects/ab043741963440e3a16afb258f6dba70 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:19.327365 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76357e30-52aa-47b1-ab7e-7741707d36d8 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:19.330094 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-76357e30-52aa-47b1-ab7e-7741707d36d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:19.416136 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76357e30-52aa-47b1-ab7e-7741707d36d8 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:19.419456 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649fe53-6fbf-48ef-8664-51a2ae85ae8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:19.420517 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649fe53-6fbf-48ef-8664-51a2ae85ae8c service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:19.420998 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649fe53-6fbf-48ef-8664-51a2ae85ae8c service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:19.421429 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649fe53-6fbf-48ef-8664-51a2ae85ae8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:19.423501 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e649fe53-6fbf-48ef-8664-51a2ae85ae8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:19.424475 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d31b05-c059-4787-a7a7-3abc3f2aa69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:19.426111 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d31b05-c059-4787-a7a7-3abc3f2aa69d admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:19.426642 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d31b05-c059-4787-a7a7-3abc3f2aa69d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:19.427126 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d31b05-c059-4787-a7a7-3abc3f2aa69d admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:19.428124 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d31b05-c059-4787-a7a7-3abc3f2aa69d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:19.430875 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d31b05-c059-4787-a7a7-3abc3f2aa69d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:19.438261 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e649fe53-6fbf-48ef-8664-51a2ae85ae8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:19.440209 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e649fe53-6fbf-48ef-8664-51a2ae85ae8c service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:19.460795 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 928/1835] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:44:19.462004 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649fe53-6fbf-48ef-8664-51a2ae85ae8c service nova] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:19.463595 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e649fe53-6fbf-48ef-8664-51a2ae85ae8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:19.464760 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 908/1836] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:44:19 2022] POST /identity/v3/users => generated 297 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:19.466310 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daed0c6-7173-47b4-b245-b20aaf9e9b58 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:19.467246 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daed0c6-7173-47b4-b245-b20aaf9e9b58 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:19.468231 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daed0c6-7173-47b4-b245-b20aaf9e9b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:19.479088 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649fe53-6fbf-48ef-8664-51a2ae85ae8c service nova] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:19.484498 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce327d9c-d2c0-4494-9392-e5ec42f23bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:19.485361 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce327d9c-d2c0-4494-9392-e5ec42f23bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:19.485665 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce327d9c-d2c0-4494-9392-e5ec42f23bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:19.486517 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce327d9c-d2c0-4494-9392-e5ec42f23bf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:19.486943 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce327d9c-d2c0-4494-9392-e5ec42f23bf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:19.489726 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce327d9c-d2c0-4494-9392-e5ec42f23bf8 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:19.501956 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 929/1837] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:19.503088 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce327d9c-d2c0-4494-9392-e5ec42f23bf8 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:19.517118 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-0daed0c6-7173-47b4-b245-b20aaf9e9b58 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:19.519811 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce327d9c-d2c0-4494-9392-e5ec42f23bf8 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:19.520734 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0daed0c6-7173-47b4-b245-b20aaf9e9b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:19.526707 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f43ed-ed8a-43d2-8ccb-3515358a4ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:19.527542 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f43ed-ed8a-43d2-8ccb-3515358a4ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:19.527834 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f43ed-ed8a-43d2-8ccb-3515358a4ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:19.528115 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f43ed-ed8a-43d2-8ccb-3515358a4ce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:19.528856 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f43ed-ed8a-43d2-8ccb-3515358a4ce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:19.530698 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f43ed-ed8a-43d2-8ccb-3515358a4ce4 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:19.542742 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 909/1838] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:19.546227 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 930/1839] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:19.546372 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daed0c6-7173-47b4-b245-b20aaf9e9b58 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:19.548452 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f43ed-ed8a-43d2-8ccb-3515358a4ce4 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:19.561522 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f43ed-ed8a-43d2-8ccb-3515358a4ce4 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:19.567755 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff1e7b0-4365-4187-b9cc-623e5f1196f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:19.567999 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daed0c6-7173-47b4-b245-b20aaf9e9b58 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:19.569125 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1e7b0-4365-4187-b9cc-623e5f1196f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:19.569521 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1e7b0-4365-4187-b9cc-623e5f1196f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:19.569917 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff1e7b0-4365-4187-b9cc-623e5f1196f1 admin admin] PATH_INFO: `/v3/projects/b1dcce69c4fc4ef3b2ebd147f97ee677/users/6b4fdee2e62b424c935294d31aa175dc/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:19.577264 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55c6f0e-fbad-4da6-8e22-f789c5034e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:19.578175 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55c6f0e-fbad-4da6-8e22-f789c5034e00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:19.578473 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55c6f0e-fbad-4da6-8e22-f789c5034e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:19.578914 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55c6f0e-fbad-4da6-8e22-f789c5034e00 admin admin] PATH_INFO: `/v3/projects/5fc03a77cb554d08aa40e9c86b861f95/users/be909a83960149458f18fe90c624e41c/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:19.592134 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff1e7b0-4365-4187-b9cc-623e5f1196f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1dcce69c4fc4ef3b2ebd147f97ee677, user_id=6b4fdee2e62b424c935294d31aa175dc, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:19.596509 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff1e7b0-4365-4187-b9cc-623e5f1196f1 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:19.598735 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55c6f0e-fbad-4da6-8e22-f789c5034e00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fc03a77cb554d08aa40e9c86b861f95, user_id=be909a83960149458f18fe90c624e41c, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:19.601577 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55c6f0e-fbad-4da6-8e22-f789c5034e00 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:19.622339 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 910/1840] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:44:19 2022] PUT /identity/v3/projects/5fc03a77cb554d08aa40e9c86b861f95/users/be909a83960149458f18fe90c624e41c/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:19.623915 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc77de-3745-4c3c-840a-f7242a4f5713 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:19.624212 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc77de-3745-4c3c-840a-f7242a4f5713 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:19.624623 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc77de-3745-4c3c-840a-f7242a4f5713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:19.634081 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 931/1841] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:44:19 2022] PUT /identity/v3/projects/b1dcce69c4fc4ef3b2ebd147f97ee677/users/6b4fdee2e62b424c935294d31aa175dc/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:44:19.637676 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff1e7b0-4365-4187-b9cc-623e5f1196f1 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:19.646040 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d2fc77de-3745-4c3c-840a-f7242a4f5713 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:19.647339 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d2fc77de-3745-4c3c-840a-f7242a4f5713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:19.687851 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:19.739295 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff1e7b0-4365-4187-b9cc-623e5f1196f1 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:19.745466 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece3cf2-3d16-4c4d-aeed-e62d7f9deb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:19.746221 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece3cf2-3d16-4c4d-aeed-e62d7f9deb23 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:19.746542 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece3cf2-3d16-4c4d-aeed-e62d7f9deb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:19.746824 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece3cf2-3d16-4c4d-aeed-e62d7f9deb23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:19.747561 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece3cf2-3d16-4c4d-aeed-e62d7f9deb23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:19.749335 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece3cf2-3d16-4c4d-aeed-e62d7f9deb23 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:19.765219 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 932/1842] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:19.765219 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece3cf2-3d16-4c4d-aeed-e62d7f9deb23 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:19.792255 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 911/1843] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:19.795337 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc77de-3745-4c3c-840a-f7242a4f5713 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:19.799961 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d2fc77de-3745-4c3c-840a-f7242a4f5713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:19.805568 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece3cf2-3d16-4c4d-aeed-e62d7f9deb23 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:19.816958 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:19.817907 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42999036-9cda-440e-b160-5faa75d76536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:19.818121 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42999036-9cda-440e-b160-5faa75d76536 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:19.819233 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42999036-9cda-440e-b160-5faa75d76536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:19.819535 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42999036-9cda-440e-b160-5faa75d76536 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:19.820505 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42999036-9cda-440e-b160-5faa75d76536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:19.822740 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42999036-9cda-440e-b160-5faa75d76536 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:19.844374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 933/1844] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:19.845436 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42999036-9cda-440e-b160-5faa75d76536 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:19.860367 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42999036-9cda-440e-b160-5faa75d76536 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:19.867267 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eacde4-eefa-434d-bc06-7686c8eb50f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:19.868179 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eacde4-eefa-434d-bc06-7686c8eb50f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:19.868469 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eacde4-eefa-434d-bc06-7686c8eb50f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:19.875298 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eacde4-eefa-434d-bc06-7686c8eb50f6 admin admin] PATH_INFO: `/v3/projects/5fc03a77cb554d08aa40e9c86b861f95/users/be909a83960149458f18fe90c624e41c/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:19.886647 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eacde4-eefa-434d-bc06-7686c8eb50f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fc03a77cb554d08aa40e9c86b861f95, user_id=be909a83960149458f18fe90c624e41c, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:19.896917 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85eacde4-eefa-434d-bc06-7686c8eb50f6 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:19.926413 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 934/1845] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:44:19 2022] PUT /identity/v3/projects/5fc03a77cb554d08aa40e9c86b861f95/users/be909a83960149458f18fe90c624e41c/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:19.930483 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eacde4-eefa-434d-bc06-7686c8eb50f6 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:19.946108 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc77de-3745-4c3c-840a-f7242a4f5713 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:20.029628 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85eacde4-eefa-434d-bc06-7686c8eb50f6 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:20.036628 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6303d2-abc0-45b9-b6ca-ab15a6352089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:20.037460 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6303d2-abc0-45b9-b6ca-ab15a6352089 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:20.037772 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6303d2-abc0-45b9-b6ca-ab15a6352089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:20.038149 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6303d2-abc0-45b9-b6ca-ab15a6352089 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:20.039093 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6303d2-abc0-45b9-b6ca-ab15a6352089 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:44:20.039653 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6303d2-abc0-45b9-b6ca-ab15a6352089 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:20.041113 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6303d2-abc0-45b9-b6ca-ab15a6352089 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:20.050108 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da21c2bd-f046-4add-a166-6cc17a6024e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:20.051140 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21c2bd-f046-4add-a166-6cc17a6024e7 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:20.051261 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21c2bd-f046-4add-a166-6cc17a6024e7 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:20.051506 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21c2bd-f046-4add-a166-6cc17a6024e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:20.053553 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-da21c2bd-f046-4add-a166-6cc17a6024e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:20.055394 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 935/1846] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:44:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:44:20.056293 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6303d2-abc0-45b9-b6ca-ab15a6352089 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:20.067138 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6303d2-abc0-45b9-b6ca-ab15a6352089 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:20.071971 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e74cca-3085-4bb3-9617-02884f2b24a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:20.073382 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e74cca-3085-4bb3-9617-02884f2b24a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:20.073525 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e74cca-3085-4bb3-9617-02884f2b24a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:20.073772 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e74cca-3085-4bb3-9617-02884f2b24a4 admin admin] PATH_INFO: `/v3/projects/b1dcce69c4fc4ef3b2ebd147f97ee677/users/6b4fdee2e62b424c935294d31aa175dc/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:20.076330 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e74cca-3085-4bb3-9617-02884f2b24a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1dcce69c4fc4ef3b2ebd147f97ee677, user_id=6b4fdee2e62b424c935294d31aa175dc, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:20.078260 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da21c2bd-f046-4add-a166-6cc17a6024e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:20.079035 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e74cca-3085-4bb3-9617-02884f2b24a4 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:20.080548 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da21c2bd-f046-4add-a166-6cc17a6024e7 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:20.092284 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 936/1847] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:44:20 2022] PUT /identity/v3/projects/b1dcce69c4fc4ef3b2ebd147f97ee677/users/6b4fdee2e62b424c935294d31aa175dc/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:20.093529 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4f697-0dd3-412b-8198-a8d00d420d86 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:20.093828 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4f697-0dd3-412b-8198-a8d00d420d86 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:20.094266 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 912/1848] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:44:20.095629 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755347d3-102d-4b8c-8cbf-b071b19ad29f None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:20.096039 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755347d3-102d-4b8c-8cbf-b071b19ad29f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:20.096329 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755347d3-102d-4b8c-8cbf-b071b19ad29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:20.109643 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff4f697-0dd3-412b-8198-a8d00d420d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:20.137676 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-755347d3-102d-4b8c-8cbf-b071b19ad29f None None] MFA Rules not processed for user `be909a83960149458f18fe90c624e41c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:20.138911 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-755347d3-102d-4b8c-8cbf-b071b19ad29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:20.141387 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-5ff4f697-0dd3-412b-8198-a8d00d420d86 None None] MFA Rules not processed for user `9f13db57fa094debba1664160b6c4b46`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:20.142870 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5ff4f697-0dd3-412b-8198-a8d00d420d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:20.222823 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 937/1849] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:20.223447 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4f697-0dd3-412b-8198-a8d00d420d86 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:20.246001 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 913/1850] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:20 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:20.246001 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755347d3-102d-4b8c-8cbf-b071b19ad29f None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:20.248406 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-755347d3-102d-4b8c-8cbf-b071b19ad29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:20.278523 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:20.289571 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:20.337996 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755347d3-102d-4b8c-8cbf-b071b19ad29f None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:20.349715 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429710b-f87e-463c-b2ba-a29a1209e9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:20.351179 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429710b-f87e-463c-b2ba-a29a1209e9fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:20.351466 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429710b-f87e-463c-b2ba-a29a1209e9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:20.351909 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429710b-f87e-463c-b2ba-a29a1209e9fb admin admin] PATH_INFO: `/v3/projects/bb347bce68c84bd28e1363ea1bf12c2d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:20.353330 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8429710b-f87e-463c-b2ba-a29a1209e9fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb347bce68c84bd28e1363ea1bf12c2d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:20.356128 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8429710b-f87e-463c-b2ba-a29a1209e9fb admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:20.376525 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff4f697-0dd3-412b-8198-a8d00d420d86 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:20.382974 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331d788-1ed7-480b-8073-43fb9fa2685d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:20.383816 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331d788-1ed7-480b-8073-43fb9fa2685d admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:20.384606 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331d788-1ed7-480b-8073-43fb9fa2685d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:20.385116 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331d788-1ed7-480b-8073-43fb9fa2685d admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:20.385875 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331d788-1ed7-480b-8073-43fb9fa2685d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:20.389743 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331d788-1ed7-480b-8073-43fb9fa2685d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:20.424280 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8429710b-f87e-463c-b2ba-a29a1209e9fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb347bce68c84bd28e1363ea1bf12c2d', 'request_id': 'req-8429710b-f87e-463c-b2ba-a29a1209e9fb'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:20.432317 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8429710b-f87e-463c-b2ba-a29a1209e9fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb347bce68c84bd28e1363ea1bf12c2d', 'request_id': 'req-8429710b-f87e-463c-b2ba-a29a1209e9fb'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:20.441937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 938/1851] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:44:20 2022] POST /identity/v3/projects => generated 379 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:20.445821 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8429710b-f87e-463c-b2ba-a29a1209e9fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb347bce68c84bd28e1363ea1bf12c2d', 'request_id': 'req-8429710b-f87e-463c-b2ba-a29a1209e9fb'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:20.447187 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de586b-98a1-4b9c-a6a2-d41f1c4f35c7 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:20.447484 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de586b-98a1-4b9c-a6a2-d41f1c4f35c7 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:20.447805 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de586b-98a1-4b9c-a6a2-d41f1c4f35c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:20.458835 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8429710b-f87e-463c-b2ba-a29a1209e9fb admin admin] The token cache is being invalidate because project bb347bce68c84bd28e1363ea1bf12c2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:44:20.459127 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8429710b-f87e-463c-b2ba-a29a1209e9fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:20.459813 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8429710b-f87e-463c-b2ba-a29a1209e9fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:20.461677 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 914/1852] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:44:20 2022] DELETE /identity/v3/projects/bb347bce68c84bd28e1363ea1bf12c2d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:20.462645 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429710b-f87e-463c-b2ba-a29a1209e9fb admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:20.464010 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8429710b-f87e-463c-b2ba-a29a1209e9fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:20.486115 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f0de586b-98a1-4b9c-a6a2-d41f1c4f35c7 None None] MFA Rules not processed for user `6b4fdee2e62b424c935294d31aa175dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:20.487303 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f0de586b-98a1-4b9c-a6a2-d41f1c4f35c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:20.541717 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429710b-f87e-463c-b2ba-a29a1209e9fb admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:20.589771 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 939/1853] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:20.590646 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de586b-98a1-4b9c-a6a2-d41f1c4f35c7 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:20.591926 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f0de586b-98a1-4b9c-a6a2-d41f1c4f35c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:20.615946 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e24fd2-f10f-491b-bb91-db294533bd83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:20.616612 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e24fd2-f10f-491b-bb91-db294533bd83 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:20.616899 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e24fd2-f10f-491b-bb91-db294533bd83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:20.617181 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e24fd2-f10f-491b-bb91-db294533bd83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:20.619031 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-63e24fd2-f10f-491b-bb91-db294533bd83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:20.639639 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:20.677532 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de586b-98a1-4b9c-a6a2-d41f1c4f35c7 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:20.682643 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f48a4-cede-4535-97de-be64d945d73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:20.683329 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f48a4-cede-4535-97de-be64d945d73d admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:20.683618 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f48a4-cede-4535-97de-be64d945d73d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:20.683899 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f48a4-cede-4535-97de-be64d945d73d admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:20.684601 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f48a4-cede-4535-97de-be64d945d73d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:20.688013 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f48a4-cede-4535-97de-be64d945d73d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:20.712534 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e24fd2-f10f-491b-bb91-db294533bd83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:20.714979 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 940/1854] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:44:20 2022] POST /identity/v3/users => generated 290 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:20.720310 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e24fd2-f10f-491b-bb91-db294533bd83 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:20.723728 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7067840-0a95-420b-8b68-afd042c95c11 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:20.724227 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7067840-0a95-420b-8b68-afd042c95c11 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:20.724665 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7067840-0a95-420b-8b68-afd042c95c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:20.731911 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 915/1855] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:20 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:44:20.732906 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e24fd2-f10f-491b-bb91-db294533bd83 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:20.734281 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-63e24fd2-f10f-491b-bb91-db294533bd83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:20.755422 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e24fd2-f10f-491b-bb91-db294533bd83 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:20.760220 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-c7067840-0a95-420b-8b68-afd042c95c11 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:20.761530 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c7067840-0a95-420b-8b68-afd042c95c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:20.767038 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f013e2d-7373-4b2a-b628-15e2e5d1e7ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:20.770138 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f013e2d-7373-4b2a-b628-15e2e5d1e7ee service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:20.770603 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 941/1856] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:20.770731 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f013e2d-7373-4b2a-b628-15e2e5d1e7ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:20.770731 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f013e2d-7373-4b2a-b628-15e2e5d1e7ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:20.777498 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7067840-0a95-420b-8b68-afd042c95c11 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:20.793854 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f013e2d-7373-4b2a-b628-15e2e5d1e7ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:20.795338 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f013e2d-7373-4b2a-b628-15e2e5d1e7ee service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:20.799133 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7067840-0a95-420b-8b68-afd042c95c11 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:20.811757 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29d295-a962-4c65-a8c1-518c0a914e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:20.812816 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29d295-a962-4c65-a8c1-518c0a914e65 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:20.813405 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29d295-a962-4c65-a8c1-518c0a914e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:20.813887 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f29d295-a962-4c65-a8c1-518c0a914e65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:20.815413 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 916/1857] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:20 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:44:20.816983 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29d295-a962-4c65-a8c1-518c0a914e65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:20.817465 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433a669-518a-4c8f-b67d-780c7ae51ebe None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:20.817904 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433a669-518a-4c8f-b67d-780c7ae51ebe None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:20.818427 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5433a669-518a-4c8f-b67d-780c7ae51ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:20.819599 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f29d295-a962-4c65-a8c1-518c0a914e65 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:20.840944 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 942/1858] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:20.841962 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29d295-a962-4c65-a8c1-518c0a914e65 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:20.854893 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f29d295-a962-4c65-a8c1-518c0a914e65 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:20.858787 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-5433a669-518a-4c8f-b67d-780c7ae51ebe None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:20.860364 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5433a669-518a-4c8f-b67d-780c7ae51ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:20.861879 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af70ac-948c-4efa-951c-7d996bf5e619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:20.863276 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af70ac-948c-4efa-951c-7d996bf5e619 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:20.863706 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af70ac-948c-4efa-951c-7d996bf5e619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:20.864126 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89af70ac-948c-4efa-951c-7d996bf5e619 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:20.864986 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af70ac-948c-4efa-951c-7d996bf5e619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:20.866924 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89af70ac-948c-4efa-951c-7d996bf5e619 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:20.869756 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:20.888168 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 943/1859] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:20.890152 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 917/1860] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:20.896271 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af70ac-948c-4efa-951c-7d996bf5e619 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:20.896417 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433a669-518a-4c8f-b67d-780c7ae51ebe None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:20.908593 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89af70ac-948c-4efa-951c-7d996bf5e619 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:20.912903 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5433a669-518a-4c8f-b67d-780c7ae51ebe None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:20.920356 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13862a3-6cbb-4576-82f5-cfce666613ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:20.921164 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13862a3-6cbb-4576-82f5-cfce666613ca admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:20.921730 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13862a3-6cbb-4576-82f5-cfce666613ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:20.923196 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13862a3-6cbb-4576-82f5-cfce666613ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:20.923987 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13862a3-6cbb-4576-82f5-cfce666613ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:44:20.924856 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a2d06f-47a4-4658-964c-4a27f2ca42af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:20.925880 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13862a3-6cbb-4576-82f5-cfce666613ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:20.928847 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2d06f-47a4-4658-964c-4a27f2ca42af service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:20.929137 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2d06f-47a4-4658-964c-4a27f2ca42af service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:20.929557 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a2d06f-47a4-4658-964c-4a27f2ca42af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:20.930211 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13862a3-6cbb-4576-82f5-cfce666613ca admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:20.934417 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-26a2d06f-47a4-4658-964c-4a27f2ca42af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:20.960349 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 918/1861] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:44:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:44:20.960349 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13862a3-6cbb-4576-82f5-cfce666613ca admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:20.988557 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13862a3-6cbb-4576-82f5-cfce666613ca admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:21.000846 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f44e4-e209-4a24-aa37-82c48ba229bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:21.001640 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f44e4-e209-4a24-aa37-82c48ba229bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:21.001926 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f44e4-e209-4a24-aa37-82c48ba229bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:21.002199 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f44e4-e209-4a24-aa37-82c48ba229bf admin admin] PATH_INFO: `/v3/projects/6700b80dad6140fea6268209f1eca0e2/users/6d97914670ca479f9bef0627a5e62a50/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:21.055710 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f44e4-e209-4a24-aa37-82c48ba229bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=6700b80dad6140fea6268209f1eca0e2, user_id=6d97914670ca479f9bef0627a5e62a50, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:21.060084 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f44e4-e209-4a24-aa37-82c48ba229bf admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:21.094490 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 919/1862] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:44:20 2022] PUT /identity/v3/projects/6700b80dad6140fea6268209f1eca0e2/users/6d97914670ca479f9bef0627a5e62a50/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:21.095285 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f44e4-e209-4a24-aa37-82c48ba229bf admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:21.099516 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a2d06f-47a4-4658-964c-4a27f2ca42af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:21.100960 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a2d06f-47a4-4658-964c-4a27f2ca42af service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:21.125643 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 944/1863] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:20 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:44:21.128503 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff200bc2-42f3-44c9-bd40-f8ca47e80cac None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:21.128788 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff200bc2-42f3-44c9-bd40-f8ca47e80cac None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:21.129066 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff200bc2-42f3-44c9-bd40-f8ca47e80cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:21.172188 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-ff200bc2-42f3-44c9-bd40-f8ca47e80cac None None] MFA Rules not processed for user `6d97914670ca479f9bef0627a5e62a50`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:21.175227 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ff200bc2-42f3-44c9-bd40-f8ca47e80cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:21.237301 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f44e4-e209-4a24-aa37-82c48ba229bf admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:21.243713 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322fc87-ebff-4136-b50d-8e1c53d5091b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:21.244417 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322fc87-ebff-4136-b50d-8e1c53d5091b admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:21.244773 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322fc87-ebff-4136-b50d-8e1c53d5091b admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:21.245142 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322fc87-ebff-4136-b50d-8e1c53d5091b admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:21.245845 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5322fc87-ebff-4136-b50d-8e1c53d5091b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:21.247780 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5322fc87-ebff-4136-b50d-8e1c53d5091b admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:21.300268 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 920/1864] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:44:21 2022] POST /identity/v3/projects => generated 379 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:21.304744 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322fc87-ebff-4136-b50d-8e1c53d5091b admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:21.408511 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 945/1865] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:21.412860 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff200bc2-42f3-44c9-bd40-f8ca47e80cac None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:21.424431 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff200bc2-42f3-44c9-bd40-f8ca47e80cac None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:21.491009 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:21.522046 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322fc87-ebff-4136-b50d-8e1c53d5091b admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:21.534903 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6bfa9-5a58-421f-823b-eacbca761fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:21.535983 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6bfa9-5a58-421f-823b-eacbca761fb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:21.536637 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6bfa9-5a58-421f-823b-eacbca761fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:21.537254 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6bfa9-5a58-421f-823b-eacbca761fb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:21.538404 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a6bfa9-5a58-421f-823b-eacbca761fb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:21.540859 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a6bfa9-5a58-421f-823b-eacbca761fb7 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:21.560023 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba3199-4c9d-4234-bd51-c173056f7405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:21.561718 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba3199-4c9d-4234-bd51-c173056f7405 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:21.566498 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba3199-4c9d-4234-bd51-c173056f7405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:21.567981 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba3199-4c9d-4234-bd51-c173056f7405 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:21.569962 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ba3199-4c9d-4234-bd51-c173056f7405 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:21.574817 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 921/1866] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:44:21 2022] POST /identity/v3/users => generated 290 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:21.574985 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ba3199-4c9d-4234-bd51-c173056f7405 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:21.575997 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6bfa9-5a58-421f-823b-eacbca761fb7 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:21.595727 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6bfa9-5a58-421f-823b-eacbca761fb7 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:21.614419 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1e76a-c3e9-4e9e-b571-8811a46198de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:21.617804 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1e76a-c3e9-4e9e-b571-8811a46198de admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:21.617804 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1e76a-c3e9-4e9e-b571-8811a46198de admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:21.618152 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1e76a-c3e9-4e9e-b571-8811a46198de admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:21.618992 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe1e76a-c3e9-4e9e-b571-8811a46198de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:21.621436 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe1e76a-c3e9-4e9e-b571-8811a46198de admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:21.637408 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 946/1867] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:44:21 2022] POST /identity/v3/projects => generated 377 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:44:21.638332 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba3199-4c9d-4234-bd51-c173056f7405 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:21.640183 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d5ba3199-4c9d-4234-bd51-c173056f7405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:21.643471 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 922/1868] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:21.645975 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1e76a-c3e9-4e9e-b571-8811a46198de admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:21.658253 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1e76a-c3e9-4e9e-b571-8811a46198de admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:21.662878 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:21.731101 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073fba3-4880-4336-9eee-06db18730bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:21.731838 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073fba3-4880-4336-9eee-06db18730bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:21.732126 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073fba3-4880-4336-9eee-06db18730bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:21.732405 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073fba3-4880-4336-9eee-06db18730bb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:21.733545 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073fba3-4880-4336-9eee-06db18730bb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:21.734859 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073fba3-4880-4336-9eee-06db18730bb5 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:21.746715 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 923/1869] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:21.748258 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073fba3-4880-4336-9eee-06db18730bb5 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:21.751397 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba3199-4c9d-4234-bd51-c173056f7405 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:21.760915 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073fba3-4880-4336-9eee-06db18730bb5 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:21.765893 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791730df-8eeb-4776-9b82-2fde52b1ceec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:21.767138 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791730df-8eeb-4776-9b82-2fde52b1ceec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:21.767503 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f439594-8aa4-4a20-a013-ef6aa1c7d606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:21.767638 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791730df-8eeb-4776-9b82-2fde52b1ceec admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:21.767851 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791730df-8eeb-4776-9b82-2fde52b1ceec admin admin] PATH_INFO: `/v3/users/3b646e2f3d9b46259508e3c76bdad733` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:21.768227 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f439594-8aa4-4a20-a013-ef6aa1c7d606 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:21.768560 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f439594-8aa4-4a20-a013-ef6aa1c7d606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:21.769010 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f439594-8aa4-4a20-a013-ef6aa1c7d606 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:21.769179 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791730df-8eeb-4776-9b82-2fde52b1ceec admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b646e2f3d9b46259508e3c76bdad733)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:21.769899 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f439594-8aa4-4a20-a013-ef6aa1c7d606 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:21.771133 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791730df-8eeb-4776-9b82-2fde52b1ceec admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:21.771860 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f439594-8aa4-4a20-a013-ef6aa1c7d606 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:21.795578 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 924/1870] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:44:21 2022] POST /identity/v3/users => generated 289 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:21.797295 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f439594-8aa4-4a20-a013-ef6aa1c7d606 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:21.809513 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f439594-8aa4-4a20-a013-ef6aa1c7d606 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:21.814607 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbdb675-4395-409c-bb3b-d22e55fcee6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:21.815645 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdb675-4395-409c-bb3b-d22e55fcee6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:21.816577 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdb675-4395-409c-bb3b-d22e55fcee6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:21.816865 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdb675-4395-409c-bb3b-d22e55fcee6a admin admin] PATH_INFO: `/v3/projects/8bd3546b4703441cbd7427619defca0f/users/5c2db4da5650486a862d76cd5e476e36/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:21.828282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-791730df-8eeb-4776-9b82-2fde52b1ceec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b646e2f3d9b46259508e3c76bdad733'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:21.828981 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-791730df-8eeb-4776-9b82-2fde52b1ceec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b646e2f3d9b46259508e3c76bdad733'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:21.829599 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-791730df-8eeb-4776-9b82-2fde52b1ceec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b646e2f3d9b46259508e3c76bdad733'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:21.835706 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbdb675-4395-409c-bb3b-d22e55fcee6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bd3546b4703441cbd7427619defca0f, user_id=5c2db4da5650486a862d76cd5e476e36, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:21.836962 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-791730df-8eeb-4776-9b82-2fde52b1ceec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b646e2f3d9b46259508e3c76bdad733'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:21.838580 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbdb675-4395-409c-bb3b-d22e55fcee6a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:21.845777 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-791730df-8eeb-4776-9b82-2fde52b1ceec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b646e2f3d9b46259508e3c76bdad733'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:21.862487 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 925/1871] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:44:21 2022] PUT /identity/v3/projects/8bd3546b4703441cbd7427619defca0f/users/5c2db4da5650486a862d76cd5e476e36/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:21.862487 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbdb675-4395-409c-bb3b-d22e55fcee6a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:21.862487 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5fbdb675-4395-409c-bb3b-d22e55fcee6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:21.877119 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 947/1872] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:44:21 2022] DELETE /identity/v3/users/3b646e2f3d9b46259508e3c76bdad733 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:21.879822 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291eaae-433b-4630-90e7-df1b7d57a116 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:21.880288 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291eaae-433b-4630-90e7-df1b7d57a116 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:21.880825 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291eaae-433b-4630-90e7-df1b7d57a116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:21.912115 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b291eaae-433b-4630-90e7-df1b7d57a116 None None] MFA Rules not processed for user `5c2db4da5650486a862d76cd5e476e36`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:21.913354 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b291eaae-433b-4630-90e7-df1b7d57a116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:21.938766 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbdb675-4395-409c-bb3b-d22e55fcee6a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:21.958307 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:22.010742 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 948/1873] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:22.010742 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068c2ea-e550-4665-834b-b4b8381b90c0 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:22.010742 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068c2ea-e550-4665-834b-b4b8381b90c0 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:22.010742 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068c2ea-e550-4665-834b-b4b8381b90c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:22.013919 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65cafc1-ce23-49f2-8689-807537f3464c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:22.015134 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65cafc1-ce23-49f2-8689-807537f3464c admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:22.015576 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65cafc1-ce23-49f2-8689-807537f3464c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:22.016234 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65cafc1-ce23-49f2-8689-807537f3464c admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:22.017945 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65cafc1-ce23-49f2-8689-807537f3464c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:22.020281 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65cafc1-ce23-49f2-8689-807537f3464c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:22.032331 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f068c2ea-e550-4665-834b-b4b8381b90c0 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:22.033995 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f068c2ea-e550-4665-834b-b4b8381b90c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:22.040715 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 926/1874] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:22.040715 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65cafc1-ce23-49f2-8689-807537f3464c admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:22.041094 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f65cafc1-ce23-49f2-8689-807537f3464c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:22.047387 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 949/1875] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:22.048561 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068c2ea-e550-4665-834b-b4b8381b90c0 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:22.064011 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068c2ea-e550-4665-834b-b4b8381b90c0 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:22.071005 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401f547-9faf-404e-8a31-fa053bc9f05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:22.071809 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401f547-9faf-404e-8a31-fa053bc9f05b admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:22.072575 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401f547-9faf-404e-8a31-fa053bc9f05b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:22.072874 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5401f547-9faf-404e-8a31-fa053bc9f05b admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:22.073816 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401f547-9faf-404e-8a31-fa053bc9f05b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:22.075269 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65cafc1-ce23-49f2-8689-807537f3464c admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:22.076098 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5401f547-9faf-404e-8a31-fa053bc9f05b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:22.081704 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3279d3-bfd4-4a5e-bfb8-67aaa6a72c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:22.082672 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3279d3-bfd4-4a5e-bfb8-67aaa6a72c4f admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:22.083106 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3279d3-bfd4-4a5e-bfb8-67aaa6a72c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:22.083639 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3279d3-bfd4-4a5e-bfb8-67aaa6a72c4f admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:22.084494 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3279d3-bfd4-4a5e-bfb8-67aaa6a72c4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:22.088235 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3279d3-bfd4-4a5e-bfb8-67aaa6a72c4f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:22.108321 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 950/1876] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:22.109137 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401f547-9faf-404e-8a31-fa053bc9f05b admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:22.111840 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5401f547-9faf-404e-8a31-fa053bc9f05b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:22.120875 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:22.168557 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 927/1877] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:44:22 2022] POST /identity/v3/projects => generated 381 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:22.169412 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3279d3-bfd4-4a5e-bfb8-67aaa6a72c4f admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:22.221470 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5401f547-9faf-404e-8a31-fa053bc9f05b admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:22.282981 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3279d3-bfd4-4a5e-bfb8-67aaa6a72c4f admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:22.296670 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f1021-590a-4a19-85fb-ac3709ef986c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:22.297718 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f1021-590a-4a19-85fb-ac3709ef986c admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:22.297876 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f1021-590a-4a19-85fb-ac3709ef986c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:22.298150 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f1021-590a-4a19-85fb-ac3709ef986c admin admin] PATH_INFO: `/v3/projects/9b5af979130140d69753298d98a22fdd/users/7041070055054575a3cb24248c5fa024/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:22.300029 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470bf54-be02-40b6-8a11-f16c791322c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:22.301421 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470bf54-be02-40b6-8a11-f16c791322c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:22.301913 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470bf54-be02-40b6-8a11-f16c791322c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:22.304749 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470bf54-be02-40b6-8a11-f16c791322c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:22.325228 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470bf54-be02-40b6-8a11-f16c791322c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:22.325595 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762f1021-590a-4a19-85fb-ac3709ef986c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b5af979130140d69753298d98a22fdd, user_id=7041070055054575a3cb24248c5fa024, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:22.328049 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470bf54-be02-40b6-8a11-f16c791322c9 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:22.328655 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762f1021-590a-4a19-85fb-ac3709ef986c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:22.346918 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 951/1878] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:44:22.351659 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470bf54-be02-40b6-8a11-f16c791322c9 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:22.360881 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 928/1879] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:44:22 2022] PUT /identity/v3/projects/9b5af979130140d69753298d98a22fdd/users/7041070055054575a3cb24248c5fa024/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:22.362428 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61656072-af73-4908-a0f7-4ed5003afdbf None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:22.363333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61656072-af73-4908-a0f7-4ed5003afdbf None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:22.363617 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61656072-af73-4908-a0f7-4ed5003afdbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:22.368677 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470bf54-be02-40b6-8a11-f16c791322c9 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:22.392922 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-61656072-af73-4908-a0f7-4ed5003afdbf None None] MFA Rules not processed for user `7041070055054575a3cb24248c5fa024`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:22.395126 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-61656072-af73-4908-a0f7-4ed5003afdbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:22.467794 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ca0d2-7f1d-4160-8218-71c96753ccf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:22.468811 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ca0d2-7f1d-4160-8218-71c96753ccf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:22.469169 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ca0d2-7f1d-4160-8218-71c96753ccf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:22.469453 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09ca0d2-7f1d-4160-8218-71c96753ccf9 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:22.470268 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ca0d2-7f1d-4160-8218-71c96753ccf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:22.473570 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09ca0d2-7f1d-4160-8218-71c96753ccf9 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:22.526554 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 929/1880] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:22.531118 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61656072-af73-4908-a0f7-4ed5003afdbf None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:22.531632 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 952/1881] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:44:22 2022] POST /identity/v3/users => generated 297 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:22.539941 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ca0d2-7f1d-4160-8218-71c96753ccf9 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:22.554084 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61656072-af73-4908-a0f7-4ed5003afdbf None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:22.559852 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6802a4-f77f-48e6-88c5-c2b7aa98a76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:22.561490 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6802a4-f77f-48e6-88c5-c2b7aa98a76a admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:22.561989 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6802a4-f77f-48e6-88c5-c2b7aa98a76a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:22.562414 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09ca0d2-7f1d-4160-8218-71c96753ccf9 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:22.563092 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6802a4-f77f-48e6-88c5-c2b7aa98a76a admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:22.563989 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6802a4-f77f-48e6-88c5-c2b7aa98a76a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:22.567738 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6802a4-f77f-48e6-88c5-c2b7aa98a76a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:22.574115 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:22.578373 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf77443-7547-4bb4-815a-861b6c8ab939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:22.579092 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf77443-7547-4bb4-815a-861b6c8ab939 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:22.579393 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf77443-7547-4bb4-815a-861b6c8ab939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:22.579656 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf77443-7547-4bb4-815a-861b6c8ab939 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:22.580531 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf77443-7547-4bb4-815a-861b6c8ab939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:22.582338 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf77443-7547-4bb4-815a-861b6c8ab939 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:22.626321 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 953/1882] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:22.632294 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 930/1883] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:44:22 2022] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:22.632469 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf77443-7547-4bb4-815a-861b6c8ab939 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:22.633411 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6802a4-f77f-48e6-88c5-c2b7aa98a76a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:22.648169 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf77443-7547-4bb4-815a-861b6c8ab939 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:22.703578 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:22.743387 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5444f-a996-4ae9-a6e3-f1d0ed581e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:22.744430 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5444f-a996-4ae9-a6e3-f1d0ed581e60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:22.744732 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5444f-a996-4ae9-a6e3-f1d0ed581e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:22.744994 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5444f-a996-4ae9-a6e3-f1d0ed581e60 admin admin] PATH_INFO: `/v3/projects/e301168cf3554411ac27aa96048848fd/users/3bdb06491d374a5486080f7ce4df8b44/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:22.774915 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f5444f-a996-4ae9-a6e3-f1d0ed581e60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e301168cf3554411ac27aa96048848fd, user_id=3bdb06491d374a5486080f7ce4df8b44, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:22.780307 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f5444f-a996-4ae9-a6e3-f1d0ed581e60 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:22.800883 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6802a4-f77f-48e6-88c5-c2b7aa98a76a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:22.813873 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 954/1884] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:44:22 2022] PUT /identity/v3/projects/e301168cf3554411ac27aa96048848fd/users/3bdb06491d374a5486080f7ce4df8b44/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:22.815396 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5444f-a996-4ae9-a6e3-f1d0ed581e60 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:22.822789 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f234723-5cf2-448c-8482-2e1cee9dd435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:22.823720 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f234723-5cf2-448c-8482-2e1cee9dd435 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:22.824169 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f234723-5cf2-448c-8482-2e1cee9dd435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:22.824606 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f234723-5cf2-448c-8482-2e1cee9dd435 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:22.825463 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f234723-5cf2-448c-8482-2e1cee9dd435 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:22.830681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f234723-5cf2-448c-8482-2e1cee9dd435 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:22.860907 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 931/1885] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:44:22 2022] POST /identity/v3/users => generated 296 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:22.862087 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f234723-5cf2-448c-8482-2e1cee9dd435 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:22.864542 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3f234723-5cf2-448c-8482-2e1cee9dd435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:22.887538 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f234723-5cf2-448c-8482-2e1cee9dd435 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:22.919108 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5444f-a996-4ae9-a6e3-f1d0ed581e60 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:22.926964 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e837cc-8632-493b-ad96-34ff81a7beb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:22.927864 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e837cc-8632-493b-ad96-34ff81a7beb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:22.928691 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e837cc-8632-493b-ad96-34ff81a7beb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:22.929041 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e837cc-8632-493b-ad96-34ff81a7beb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:22.930382 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e837cc-8632-493b-ad96-34ff81a7beb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:22.933335 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e837cc-8632-493b-ad96-34ff81a7beb2 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:22.950632 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 955/1886] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:22.952179 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e837cc-8632-493b-ad96-34ff81a7beb2 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:22.963393 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e837cc-8632-493b-ad96-34ff81a7beb2 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:22.968994 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdaa0bb-a8eb-42a5-a4a0-b48d2e9e586a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:22.969360 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdaa0bb-a8eb-42a5-a4a0-b48d2e9e586a admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:22.969646 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdaa0bb-a8eb-42a5-a4a0-b48d2e9e586a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:22.969926 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdaa0bb-a8eb-42a5-a4a0-b48d2e9e586a admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:22.970688 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdaa0bb-a8eb-42a5-a4a0-b48d2e9e586a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:22.972949 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdaa0bb-a8eb-42a5-a4a0-b48d2e9e586a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:22.984336 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 956/1887] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:22.985238 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdaa0bb-a8eb-42a5-a4a0-b48d2e9e586a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:22.999411 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdaa0bb-a8eb-42a5-a4a0-b48d2e9e586a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:23.006261 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318b300-0ee6-433b-97c9-39649e0f1b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:23.006408 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa7451-a063-4d7e-8073-9c8b83ae835e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:23.007407 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318b300-0ee6-433b-97c9-39649e0f1b94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:23.007540 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa7451-a063-4d7e-8073-9c8b83ae835e admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:23.007715 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa7451-a063-4d7e-8073-9c8b83ae835e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:23.007955 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318b300-0ee6-433b-97c9-39649e0f1b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:23.008143 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa7451-a063-4d7e-8073-9c8b83ae835e admin admin] PATH_INFO: `/v3/projects/e301168cf3554411ac27aa96048848fd/users/3bdb06491d374a5486080f7ce4df8b44/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:23.008529 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318b300-0ee6-433b-97c9-39649e0f1b94 admin admin] PATH_INFO: `/v3/projects/7f72c33e8f5e4b6daa02846935570d50` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:23.010510 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa7451-a063-4d7e-8073-9c8b83ae835e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e301168cf3554411ac27aa96048848fd, user_id=3bdb06491d374a5486080f7ce4df8b44, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:23.013166 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa7451-a063-4d7e-8073-9c8b83ae835e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:23.018781 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b318b300-0ee6-433b-97c9-39649e0f1b94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f72c33e8f5e4b6daa02846935570d50)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:23.020766 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b318b300-0ee6-433b-97c9-39649e0f1b94 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:23.027694 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 957/1888] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:44:22 2022] PUT /identity/v3/projects/e301168cf3554411ac27aa96048848fd/users/3bdb06491d374a5486080f7ce4df8b44/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:23.028238 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa7451-a063-4d7e-8073-9c8b83ae835e admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:23.090144 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b318b300-0ee6-433b-97c9-39649e0f1b94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f72c33e8f5e4b6daa02846935570d50', 'request_id': 'req-b318b300-0ee6-433b-97c9-39649e0f1b94'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:23.096779 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b318b300-0ee6-433b-97c9-39649e0f1b94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f72c33e8f5e4b6daa02846935570d50', 'request_id': 'req-b318b300-0ee6-433b-97c9-39649e0f1b94'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:23.100076 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa7451-a063-4d7e-8073-9c8b83ae835e admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:23.106958 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b318b300-0ee6-433b-97c9-39649e0f1b94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f72c33e8f5e4b6daa02846935570d50', 'request_id': 'req-b318b300-0ee6-433b-97c9-39649e0f1b94'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:23.119455 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b318b300-0ee6-433b-97c9-39649e0f1b94 admin admin] The token cache is being invalidate because project 7f72c33e8f5e4b6daa02846935570d50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:44:23.119747 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b318b300-0ee6-433b-97c9-39649e0f1b94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:23.120401 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b318b300-0ee6-433b-97c9-39649e0f1b94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:23.122332 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 932/1889] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:44:22 2022] DELETE /identity/v3/projects/7f72c33e8f5e4b6daa02846935570d50 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:23.124578 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38b8ca-57b8-4d9c-9cfd-f0d3ae57f89f None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:23.124995 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38b8ca-57b8-4d9c-9cfd-f0d3ae57f89f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:23.125282 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38b8ca-57b8-4d9c-9cfd-f0d3ae57f89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:23.138396 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:23.150190 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:23.163671 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-bc38b8ca-57b8-4d9c-9cfd-f0d3ae57f89f None None] MFA Rules not processed for user `3bdb06491d374a5486080f7ce4df8b44`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:23.167240 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-bc38b8ca-57b8-4d9c-9cfd-f0d3ae57f89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:23.173678 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603060f1-670f-4275-8107-16b8dd424653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:23.175753 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603060f1-670f-4275-8107-16b8dd424653 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:23.176243 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603060f1-670f-4275-8107-16b8dd424653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:23.176566 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603060f1-670f-4275-8107-16b8dd424653 admin admin] PATH_INFO: `/v3/projects/964f54a58d4147908f4e50e48cc0418e/users/6492a9e77b2a43abb7ea398ccfba1f1a/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:23.199671 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603060f1-670f-4275-8107-16b8dd424653 admin admin] RBAC: Authorizing `identity:create_grant(project_id=964f54a58d4147908f4e50e48cc0418e, user_id=6492a9e77b2a43abb7ea398ccfba1f1a, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:23.202610 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603060f1-670f-4275-8107-16b8dd424653 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:23.216095 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 958/1890] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:44:23 2022] PUT /identity/v3/projects/964f54a58d4147908f4e50e48cc0418e/users/6492a9e77b2a43abb7ea398ccfba1f1a/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:23.217097 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603060f1-670f-4275-8107-16b8dd424653 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:23.218894 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-603060f1-670f-4275-8107-16b8dd424653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:23.247180 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 933/1891] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:23 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:23.247950 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38b8ca-57b8-4d9c-9cfd-f0d3ae57f89f None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:23.249294 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-bc38b8ca-57b8-4d9c-9cfd-f0d3ae57f89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:23.262207 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38b8ca-57b8-4d9c-9cfd-f0d3ae57f89f None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:23.288495 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603060f1-670f-4275-8107-16b8dd424653 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:23.293885 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143c9b8-8c15-45db-834b-025c94d59b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:23.294778 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143c9b8-8c15-45db-834b-025c94d59b24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:23.295062 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143c9b8-8c15-45db-834b-025c94d59b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:23.295343 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143c9b8-8c15-45db-834b-025c94d59b24 admin admin] PATH_INFO: `/v3/users/6b4fdee2e62b424c935294d31aa175dc` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:23.298252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a143c9b8-8c15-45db-834b-025c94d59b24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b4fdee2e62b424c935294d31aa175dc)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:23.300293 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a143c9b8-8c15-45db-834b-025c94d59b24 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:23.326194 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf10856-1cec-49e7-b87f-c124e8697958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:23.327089 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf10856-1cec-49e7-b87f-c124e8697958 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:23.327403 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf10856-1cec-49e7-b87f-c124e8697958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:23.327708 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf10856-1cec-49e7-b87f-c124e8697958 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:23.329665 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf10856-1cec-49e7-b87f-c124e8697958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:23.330415 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf10856-1cec-49e7-b87f-c124e8697958 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:23.345101 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 934/1892] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:23 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:23.346002 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf10856-1cec-49e7-b87f-c124e8697958 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:23.348473 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ccf10856-1cec-49e7-b87f-c124e8697958 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:23.354544 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a143c9b8-8c15-45db-834b-025c94d59b24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b4fdee2e62b424c935294d31aa175dc'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:23.355624 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a143c9b8-8c15-45db-834b-025c94d59b24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b4fdee2e62b424c935294d31aa175dc'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:23.356347 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a143c9b8-8c15-45db-834b-025c94d59b24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b4fdee2e62b424c935294d31aa175dc'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:23.371553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a143c9b8-8c15-45db-834b-025c94d59b24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b4fdee2e62b424c935294d31aa175dc'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:23.384258 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a143c9b8-8c15-45db-834b-025c94d59b24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b4fdee2e62b424c935294d31aa175dc'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:23.405828 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 959/1893] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:44:23 2022] DELETE /identity/v3/users/6b4fdee2e62b424c935294d31aa175dc => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:23.407088 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143c9b8-8c15-45db-834b-025c94d59b24 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:23.408486 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a143c9b8-8c15-45db-834b-025c94d59b24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:23.412710 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf10856-1cec-49e7-b87f-c124e8697958 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:23.464950 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:23.466950 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:23.478510 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d92bd-b42a-41e3-a72f-41c8bd1b8efd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:23.479517 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d92bd-b42a-41e3-a72f-41c8bd1b8efd service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:23.480104 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d92bd-b42a-41e3-a72f-41c8bd1b8efd service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:23.480485 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d92bd-b42a-41e3-a72f-41c8bd1b8efd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:23.482683 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-630d92bd-b42a-41e3-a72f-41c8bd1b8efd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:23.499730 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143c9b8-8c15-45db-834b-025c94d59b24 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:23.506975 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9907621-7e9b-4f6f-ba1d-e0a074bb10da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:23.520589 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9907621-7e9b-4f6f-ba1d-e0a074bb10da admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:23.520949 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9907621-7e9b-4f6f-ba1d-e0a074bb10da admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:23.521200 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9907621-7e9b-4f6f-ba1d-e0a074bb10da admin admin] PATH_INFO: `/v3/projects/964f54a58d4147908f4e50e48cc0418e/users/6492a9e77b2a43abb7ea398ccfba1f1a/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:23.531537 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9907621-7e9b-4f6f-ba1d-e0a074bb10da admin admin] RBAC: Authorizing `identity:create_grant(project_id=964f54a58d4147908f4e50e48cc0418e, user_id=6492a9e77b2a43abb7ea398ccfba1f1a, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:23.540169 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9907621-7e9b-4f6f-ba1d-e0a074bb10da admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:23.557208 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 960/1894] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:44:23 2022] PUT /identity/v3/projects/964f54a58d4147908f4e50e48cc0418e/users/6492a9e77b2a43abb7ea398ccfba1f1a/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:23.569458 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9b005-13a6-4f07-b53b-1a2e7a3d5afa None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:23.570113 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9b005-13a6-4f07-b53b-1a2e7a3d5afa None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:23.570113 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9b005-13a6-4f07-b53b-1a2e7a3d5afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:23.577676 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d92bd-b42a-41e3-a72f-41c8bd1b8efd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:23.579295 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d92bd-b42a-41e3-a72f-41c8bd1b8efd service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:23.594598 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 935/1895] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:23 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:44:23.600100 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-37b9b005-13a6-4f07-b53b-1a2e7a3d5afa None None] MFA Rules not processed for user `6492a9e77b2a43abb7ea398ccfba1f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:23.601508 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-37b9b005-13a6-4f07-b53b-1a2e7a3d5afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:23.698866 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 961/1896] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:23 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:44:23.705370 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d92bd-b42a-41e3-a72f-41c8bd1b8efd service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:23.706863 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-630d92bd-b42a-41e3-a72f-41c8bd1b8efd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:23.719814 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d92bd-b42a-41e3-a72f-41c8bd1b8efd service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:23.779460 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ea78f-006a-42a6-bf86-034dce5a048b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:23.780265 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ea78f-006a-42a6-bf86-034dce5a048b service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:23.780555 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ea78f-006a-42a6-bf86-034dce5a048b service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:23.780836 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ea78f-006a-42a6-bf86-034dce5a048b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:23.790867 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0ea78f-006a-42a6-bf86-034dce5a048b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:23.792257 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0ea78f-006a-42a6-bf86-034dce5a048b service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:23.804830 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 936/1897] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:23 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:44:23.822981 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b9b005-13a6-4f07-b53b-1a2e7a3d5afa None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:23.824860 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-37b9b005-13a6-4f07-b53b-1a2e7a3d5afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:23.854737 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ea78f-006a-42a6-bf86-034dce5a048b service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:23.865097 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ea78f-006a-42a6-bf86-034dce5a048b service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:23.869587 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f36988-b235-44ca-bf5d-1cd5436146f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:23.870272 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f36988-b235-44ca-bf5d-1cd5436146f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:23.870592 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f36988-b235-44ca-bf5d-1cd5436146f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:23.870872 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f36988-b235-44ca-bf5d-1cd5436146f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:23.873373 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b0f36988-b235-44ca-bf5d-1cd5436146f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:23.919856 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b9b005-13a6-4f07-b53b-1a2e7a3d5afa None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:23.926577 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f847f-1d2e-4a13-9ac5-e898fb05a627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:23.927676 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f847f-1d2e-4a13-9ac5-e898fb05a627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:23.928041 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f847f-1d2e-4a13-9ac5-e898fb05a627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:23.928308 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f847f-1d2e-4a13-9ac5-e898fb05a627 admin admin] PATH_INFO: `/v3/projects/b1dcce69c4fc4ef3b2ebd147f97ee677` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:23.929717 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f847f-1d2e-4a13-9ac5-e898fb05a627 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1dcce69c4fc4ef3b2ebd147f97ee677)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:23.931871 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f847f-1d2e-4a13-9ac5-e898fb05a627 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:23.949141 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f36988-b235-44ca-bf5d-1cd5436146f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:23.950651 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f36988-b235-44ca-bf5d-1cd5436146f8 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:23.964678 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 937/1898] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:23 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 03:44:23.994413 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f87f847f-1d2e-4a13-9ac5-e898fb05a627 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1dcce69c4fc4ef3b2ebd147f97ee677', 'request_id': 'req-f87f847f-1d2e-4a13-9ac5-e898fb05a627'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:24.002073 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f87f847f-1d2e-4a13-9ac5-e898fb05a627 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1dcce69c4fc4ef3b2ebd147f97ee677', 'request_id': 'req-f87f847f-1d2e-4a13-9ac5-e898fb05a627'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:24.009674 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f36988-b235-44ca-bf5d-1cd5436146f8 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:24.016060 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f87f847f-1d2e-4a13-9ac5-e898fb05a627 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1dcce69c4fc4ef3b2ebd147f97ee677', 'request_id': 'req-f87f847f-1d2e-4a13-9ac5-e898fb05a627'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:24.022998 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:24.034402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f87f847f-1d2e-4a13-9ac5-e898fb05a627 admin admin] The token cache is being invalidate because project b1dcce69c4fc4ef3b2ebd147f97ee677 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:44:24.035134 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f87f847f-1d2e-4a13-9ac5-e898fb05a627 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:24.036583 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f87f847f-1d2e-4a13-9ac5-e898fb05a627 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:24.038914 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 962/1899] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:44:23 2022] DELETE /identity/v3/projects/b1dcce69c4fc4ef3b2ebd147f97ee677 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:24.043950 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277971b1-2107-4fec-930e-13c62a01d0ce None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:24.044589 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277971b1-2107-4fec-930e-13c62a01d0ce None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:24.045103 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277971b1-2107-4fec-930e-13c62a01d0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:24.068110 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-277971b1-2107-4fec-930e-13c62a01d0ce None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:24.069903 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-277971b1-2107-4fec-930e-13c62a01d0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:24.070049 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:24.096355 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f36988-b235-44ca-bf5d-1cd5436146f8 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:24.152814 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 963/1900] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:44:24.162617 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d1cdb-948a-42aa-b36a-856c5d51dcd9 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:24.163268 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d1cdb-948a-42aa-b36a-856c5d51dcd9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:24.163664 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d1cdb-948a-42aa-b36a-856c5d51dcd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:24.181973 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeee688-d737-4bea-8fb3-ff6dcc546523 tempest-VolumeQuotaClassesTest-2117797158 tempest-VolumeQuotaClassesTest-2117797158-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bdb06491d374a5486080f7ce4df8b44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e301168cf3554411ac27aa96048848fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:24.182943 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeee688-d737-4bea-8fb3-ff6dcc546523 tempest-VolumeQuotaClassesTest-2117797158 tempest-VolumeQuotaClassesTest-2117797158-project-admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:24.183348 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeee688-d737-4bea-8fb3-ff6dcc546523 tempest-VolumeQuotaClassesTest-2117797158 tempest-VolumeQuotaClassesTest-2117797158-project-admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:24.183726 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeee688-d737-4bea-8fb3-ff6dcc546523 tempest-VolumeQuotaClassesTest-2117797158 tempest-VolumeQuotaClassesTest-2117797158-project-admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:24.184541 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeee688-d737-4bea-8fb3-ff6dcc546523 tempest-VolumeQuotaClassesTest-2117797158 tempest-VolumeQuotaClassesTest-2117797158-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:44:24.185314 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeee688-d737-4bea-8fb3-ff6dcc546523 tempest-VolumeQuotaClassesTest-2117797158 tempest-VolumeQuotaClassesTest-2117797158-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:24.188165 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeee688-d737-4bea-8fb3-ff6dcc546523 tempest-VolumeQuotaClassesTest-2117797158 tempest-VolumeQuotaClassesTest-2117797158-project-admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:24.188282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-879d1cdb-948a-42aa-b36a-856c5d51dcd9 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:24.189419 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-879d1cdb-948a-42aa-b36a-856c5d51dcd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:24.202377 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 964/1901] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:24.206885 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d1cdb-948a-42aa-b36a-856c5d51dcd9 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:24.221348 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d1cdb-948a-42aa-b36a-856c5d51dcd9 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:24.239346 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de469f5-2e87-462c-be4d-a324e40823e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:24.239346 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de469f5-2e87-462c-be4d-a324e40823e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:24.239346 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de469f5-2e87-462c-be4d-a324e40823e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:24.239346 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de469f5-2e87-462c-be4d-a324e40823e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:24.239944 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de469f5-2e87-462c-be4d-a324e40823e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:44:24.239944 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de469f5-2e87-462c-be4d-a324e40823e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:24.239944 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de469f5-2e87-462c-be4d-a324e40823e9 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:24.240166 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 938/1902] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:44:24.241187 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeee688-d737-4bea-8fb3-ff6dcc546523 tempest-VolumeQuotaClassesTest-2117797158 tempest-VolumeQuotaClassesTest-2117797158-project-admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:24.243985 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-aaeee688-d737-4bea-8fb3-ff6dcc546523 tempest-VolumeQuotaClassesTest-2117797158 tempest-VolumeQuotaClassesTest-2117797158-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:24.248366 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 965/1903] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:44:24.258037 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de469f5-2e87-462c-be4d-a324e40823e9 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:24.269245 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeee688-d737-4bea-8fb3-ff6dcc546523 tempest-VolumeQuotaClassesTest-2117797158 tempest-VolumeQuotaClassesTest-2117797158-project-admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:24.273839 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de469f5-2e87-462c-be4d-a324e40823e9 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:24.275809 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae912d18-dc4b-4f4c-aefa-3a51d182cd62 tempest-VolumeQuotaClassesTest-2117797158 tempest-VolumeQuotaClassesTest-2117797158-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bdb06491d374a5486080f7ce4df8b44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e301168cf3554411ac27aa96048848fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:24.276559 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae912d18-dc4b-4f4c-aefa-3a51d182cd62 tempest-VolumeQuotaClassesTest-2117797158 tempest-VolumeQuotaClassesTest-2117797158-project-admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:24.276919 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae912d18-dc4b-4f4c-aefa-3a51d182cd62 tempest-VolumeQuotaClassesTest-2117797158 tempest-VolumeQuotaClassesTest-2117797158-project-admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:24.277287 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae912d18-dc4b-4f4c-aefa-3a51d182cd62 tempest-VolumeQuotaClassesTest-2117797158 tempest-VolumeQuotaClassesTest-2117797158-project-admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:24.278058 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae912d18-dc4b-4f4c-aefa-3a51d182cd62 tempest-VolumeQuotaClassesTest-2117797158 tempest-VolumeQuotaClassesTest-2117797158-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:24.280508 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae912d18-dc4b-4f4c-aefa-3a51d182cd62 tempest-VolumeQuotaClassesTest-2117797158 tempest-VolumeQuotaClassesTest-2117797158-project-admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:24.290517 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f05804-a385-46f9-8c7e-65e4ab7b1eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:24.291730 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f05804-a385-46f9-8c7e-65e4ab7b1eaa admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:24.291730 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f05804-a385-46f9-8c7e-65e4ab7b1eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:24.291919 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f05804-a385-46f9-8c7e-65e4ab7b1eaa admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:24.292829 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f05804-a385-46f9-8c7e-65e4ab7b1eaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:24.295040 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f05804-a385-46f9-8c7e-65e4ab7b1eaa admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:24.318035 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 939/1904] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:44:24 2022] POST /identity/v3/projects => generated 355 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:24.321822 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae912d18-dc4b-4f4c-aefa-3a51d182cd62 tempest-VolumeQuotaClassesTest-2117797158 tempest-VolumeQuotaClassesTest-2117797158-project-admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:24.327707 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 966/1905] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:44:24 2022] POST /identity/v3/projects => generated 383 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:24.337746 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f05804-a385-46f9-8c7e-65e4ab7b1eaa admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:24.435793 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae912d18-dc4b-4f4c-aefa-3a51d182cd62 tempest-VolumeQuotaClassesTest-2117797158 tempest-VolumeQuotaClassesTest-2117797158-project-admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:24.442491 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f05804-a385-46f9-8c7e-65e4ab7b1eaa admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:24.448474 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b52731-90d1-45d8-a672-d3c730ba3c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:24.449153 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b52731-90d1-45d8-a672-d3c730ba3c9b admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:24.449438 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b52731-90d1-45d8-a672-d3c730ba3c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:24.449739 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b52731-90d1-45d8-a672-d3c730ba3c9b admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:24.450440 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b52731-90d1-45d8-a672-d3c730ba3c9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:24.452426 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b52731-90d1-45d8-a672-d3c730ba3c9b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:24.477271 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 967/1906] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:44:24 2022] POST /identity/v3/users => generated 292 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:24.478530 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b52731-90d1-45d8-a672-d3c730ba3c9b admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:24.480546 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-30b52731-90d1-45d8-a672-d3c730ba3c9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:24.493888 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b52731-90d1-45d8-a672-d3c730ba3c9b admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:24.499665 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367c6bf-822e-4cac-b68d-142463b3ebc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:24.500820 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367c6bf-822e-4cac-b68d-142463b3ebc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:24.501433 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367c6bf-822e-4cac-b68d-142463b3ebc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:24.502038 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367c6bf-822e-4cac-b68d-142463b3ebc7 admin admin] PATH_INFO: `/v3/users/85c92ef589c341788ce793891d44bd9d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:24.503441 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534aa535-9918-4dad-85da-54bd3a2b5dc4 tempest-VolumeQuotaClassesTest-2117797158 tempest-VolumeQuotaClassesTest-2117797158-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bdb06491d374a5486080f7ce4df8b44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e301168cf3554411ac27aa96048848fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:24.503946 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367c6bf-822e-4cac-b68d-142463b3ebc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85c92ef589c341788ce793891d44bd9d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:24.504255 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534aa535-9918-4dad-85da-54bd3a2b5dc4 tempest-VolumeQuotaClassesTest-2117797158 tempest-VolumeQuotaClassesTest-2117797158-project-admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:24.504577 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534aa535-9918-4dad-85da-54bd3a2b5dc4 tempest-VolumeQuotaClassesTest-2117797158 tempest-VolumeQuotaClassesTest-2117797158-project-admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:24.504861 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534aa535-9918-4dad-85da-54bd3a2b5dc4 tempest-VolumeQuotaClassesTest-2117797158 tempest-VolumeQuotaClassesTest-2117797158-project-admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:24.505624 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534aa535-9918-4dad-85da-54bd3a2b5dc4 tempest-VolumeQuotaClassesTest-2117797158 tempest-VolumeQuotaClassesTest-2117797158-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:44:24.505933 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534aa535-9918-4dad-85da-54bd3a2b5dc4 tempest-VolumeQuotaClassesTest-2117797158 tempest-VolumeQuotaClassesTest-2117797158-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:24.507139 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367c6bf-822e-4cac-b68d-142463b3ebc7 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:24.507742 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534aa535-9918-4dad-85da-54bd3a2b5dc4 tempest-VolumeQuotaClassesTest-2117797158 tempest-VolumeQuotaClassesTest-2117797158-project-admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:24.511495 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:24.526724 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 940/1907] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:44:24.527802 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534aa535-9918-4dad-85da-54bd3a2b5dc4 tempest-VolumeQuotaClassesTest-2117797158 tempest-VolumeQuotaClassesTest-2117797158-project-admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:24.543275 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534aa535-9918-4dad-85da-54bd3a2b5dc4 tempest-VolumeQuotaClassesTest-2117797158 tempest-VolumeQuotaClassesTest-2117797158-project-admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:24.552360 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f527f88f-d188-44f2-beb1-a479fabba27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:24.553135 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527f88f-d188-44f2-beb1-a479fabba27f admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:24.553480 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527f88f-d188-44f2-beb1-a479fabba27f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:24.553757 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527f88f-d188-44f2-beb1-a479fabba27f admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:24.554521 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f527f88f-d188-44f2-beb1-a479fabba27f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:24.556235 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f527f88f-d188-44f2-beb1-a479fabba27f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:24.569367 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:24.570795 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 941/1908] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:24.574629 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f527f88f-d188-44f2-beb1-a479fabba27f admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:24.583009 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0367c6bf-822e-4cac-b68d-142463b3ebc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85c92ef589c341788ce793891d44bd9d'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:24.584089 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0367c6bf-822e-4cac-b68d-142463b3ebc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85c92ef589c341788ce793891d44bd9d'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:24.585357 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0367c6bf-822e-4cac-b68d-142463b3ebc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85c92ef589c341788ce793891d44bd9d'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:24.586141 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f527f88f-d188-44f2-beb1-a479fabba27f admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:24.593815 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0367c6bf-822e-4cac-b68d-142463b3ebc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85c92ef589c341788ce793891d44bd9d'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:24.596709 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a18b04e-5ebb-4144-a6b4-f1d2e4673b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:24.597511 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18b04e-5ebb-4144-a6b4-f1d2e4673b5e admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:24.597805 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18b04e-5ebb-4144-a6b4-f1d2e4673b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:24.598086 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a18b04e-5ebb-4144-a6b4-f1d2e4673b5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:24.598870 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a18b04e-5ebb-4144-a6b4-f1d2e4673b5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:24.600807 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a18b04e-5ebb-4144-a6b4-f1d2e4673b5e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:24.603019 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-0367c6bf-822e-4cac-b68d-142463b3ebc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85c92ef589c341788ce793891d44bd9d'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:24.612276 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 942/1909] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 03:44:24.612276 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a18b04e-5ebb-4144-a6b4-f1d2e4673b5e admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:24.614895 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8a18b04e-5ebb-4144-a6b4-f1d2e4673b5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:24.626578 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 968/1910] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:44:24 2022] DELETE /identity/v3/users/85c92ef589c341788ce793891d44bd9d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:24.627582 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367c6bf-822e-4cac-b68d-142463b3ebc7 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:24.630212 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0367c6bf-822e-4cac-b68d-142463b3ebc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:24.634930 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a18b04e-5ebb-4144-a6b4-f1d2e4673b5e admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:24.707826 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da10f18e-7368-4905-bb14-621a664938d9 tempest-VolumeQuotaClassesTest-2117797158 tempest-VolumeQuotaClassesTest-2117797158-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bdb06491d374a5486080f7ce4df8b44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e301168cf3554411ac27aa96048848fd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:24.713200 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10f18e-7368-4905-bb14-621a664938d9 tempest-VolumeQuotaClassesTest-2117797158 tempest-VolumeQuotaClassesTest-2117797158-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:24.713200 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10f18e-7368-4905-bb14-621a664938d9 tempest-VolumeQuotaClassesTest-2117797158 tempest-VolumeQuotaClassesTest-2117797158-project-admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:24.713200 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da10f18e-7368-4905-bb14-621a664938d9 tempest-VolumeQuotaClassesTest-2117797158 tempest-VolumeQuotaClassesTest-2117797158-project-admin] PATH_INFO: `/v3/projects/1e18e9dede3c42c5894d1c9ff2002393` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:24.713200 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da10f18e-7368-4905-bb14-621a664938d9 tempest-VolumeQuotaClassesTest-2117797158 tempest-VolumeQuotaClassesTest-2117797158-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1e18e9dede3c42c5894d1c9ff2002393)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:24.713513 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da10f18e-7368-4905-bb14-621a664938d9 tempest-VolumeQuotaClassesTest-2117797158 tempest-VolumeQuotaClassesTest-2117797158-project-admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:24.729425 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367c6bf-822e-4cac-b68d-142463b3ebc7 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:24.736977 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ac987f-4fbb-4767-9af0-e5ae3641366e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:24.738777 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac987f-4fbb-4767-9af0-e5ae3641366e admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:24.739365 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac987f-4fbb-4767-9af0-e5ae3641366e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:24.739839 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ac987f-4fbb-4767-9af0-e5ae3641366e admin admin] PATH_INFO: `/v3/projects/f0bf721ef905433690003b0cc2fcbb4c/users/3f1e019858a94793a363f9d2f8717e44/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:24.757725 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac987f-4fbb-4767-9af0-e5ae3641366e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0bf721ef905433690003b0cc2fcbb4c, user_id=3f1e019858a94793a363f9d2f8717e44, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:24.760859 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ac987f-4fbb-4767-9af0-e5ae3641366e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:24.765817 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-da10f18e-7368-4905-bb14-621a664938d9 tempest-VolumeQuotaClassesTest-2117797158 tempest-VolumeQuotaClassesTest-2117797158-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e18e9dede3c42c5894d1c9ff2002393', 'request_id': 'req-da10f18e-7368-4905-bb14-621a664938d9'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:24.772427 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-da10f18e-7368-4905-bb14-621a664938d9 tempest-VolumeQuotaClassesTest-2117797158 tempest-VolumeQuotaClassesTest-2117797158-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e18e9dede3c42c5894d1c9ff2002393', 'request_id': 'req-da10f18e-7368-4905-bb14-621a664938d9'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:24.777625 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 969/1911] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:44:24 2022] PUT /identity/v3/projects/f0bf721ef905433690003b0cc2fcbb4c/users/3f1e019858a94793a363f9d2f8717e44/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:24.779153 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd9bf9-a553-4241-97e4-408c4fc0b2ac None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:24.779422 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd9bf9-a553-4241-97e4-408c4fc0b2ac None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:24.779814 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd9bf9-a553-4241-97e4-408c4fc0b2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:24.784770 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-da10f18e-7368-4905-bb14-621a664938d9 tempest-VolumeQuotaClassesTest-2117797158 tempest-VolumeQuotaClassesTest-2117797158-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e18e9dede3c42c5894d1c9ff2002393', 'request_id': 'req-da10f18e-7368-4905-bb14-621a664938d9'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:24.798738 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-aacd9bf9-a553-4241-97e4-408c4fc0b2ac None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:24.799355 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-da10f18e-7368-4905-bb14-621a664938d9 tempest-VolumeQuotaClassesTest-2117797158 tempest-VolumeQuotaClassesTest-2117797158-project-admin] The token cache is being invalidate because project 1e18e9dede3c42c5894d1c9ff2002393 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:44:24.799960 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-aacd9bf9-a553-4241-97e4-408c4fc0b2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:24.802851 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-da10f18e-7368-4905-bb14-621a664938d9 tempest-VolumeQuotaClassesTest-2117797158 tempest-VolumeQuotaClassesTest-2117797158-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:24.803742 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-da10f18e-7368-4905-bb14-621a664938d9 tempest-VolumeQuotaClassesTest-2117797158 tempest-VolumeQuotaClassesTest-2117797158-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:24.806665 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 943/1912] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:44:24 2022] DELETE /identity/v3/projects/1e18e9dede3c42c5894d1c9ff2002393 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:24.808285 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674b9e5-9a93-4b84-88c2-78fc4323efc1 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:24.808581 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674b9e5-9a93-4b84-88c2-78fc4323efc1 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:24.809161 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d674b9e5-9a93-4b84-88c2-78fc4323efc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:24.841772 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d674b9e5-9a93-4b84-88c2-78fc4323efc1 None None] MFA Rules not processed for user `3f1e019858a94793a363f9d2f8717e44`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:24.843183 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d674b9e5-9a93-4b84-88c2-78fc4323efc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:24.875911 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 970/1913] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:24.887872 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd9bf9-a553-4241-97e4-408c4fc0b2ac None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:24.889513 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-aacd9bf9-a553-4241-97e4-408c4fc0b2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:24.908578 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:24.921684 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 944/1914] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:24.926660 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674b9e5-9a93-4b84-88c2-78fc4323efc1 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:24.928659 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d674b9e5-9a93-4b84-88c2-78fc4323efc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:24.942771 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:24.949753 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d674b9e5-9a93-4b84-88c2-78fc4323efc1 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:24.954724 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea8654-00d3-4aa2-a445-5580df0bb9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:24.955299 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea8654-00d3-4aa2-a445-5580df0bb9b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:24.956059 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea8654-00d3-4aa2-a445-5580df0bb9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:24.956059 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ea8654-00d3-4aa2-a445-5580df0bb9b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:24.957139 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ea8654-00d3-4aa2-a445-5580df0bb9b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:24.959067 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ea8654-00d3-4aa2-a445-5580df0bb9b8 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:24.960521 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd9bf9-a553-4241-97e4-408c4fc0b2ac None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:24.964225 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e27ce-1eae-442e-8f4f-3318cfc62192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:24.964901 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e27ce-1eae-442e-8f4f-3318cfc62192 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:24.965189 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e27ce-1eae-442e-8f4f-3318cfc62192 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:24.965470 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e27ce-1eae-442e-8f4f-3318cfc62192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:24.975769 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e27ce-1eae-442e-8f4f-3318cfc62192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:24.977368 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e27ce-1eae-442e-8f4f-3318cfc62192 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:24.991877 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 945/1915] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:44:24 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:24.992048 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 971/1916] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 03:44:24.993473 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea8654-00d3-4aa2-a445-5580df0bb9b8 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:25.020614 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e27ce-1eae-442e-8f4f-3318cfc62192 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:25.022580 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-035e27ce-1eae-442e-8f4f-3318cfc62192 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:25.041444 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e27ce-1eae-442e-8f4f-3318cfc62192 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:25.075653 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ea8654-00d3-4aa2-a445-5580df0bb9b8 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:25.082658 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f4d5b-8d55-4d5f-aa25-81e2a905bb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:25.083370 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f4d5b-8d55-4d5f-aa25-81e2a905bb04 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:25.083681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f4d5b-8d55-4d5f-aa25-81e2a905bb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:25.083930 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f4d5b-8d55-4d5f-aa25-81e2a905bb04 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:25.084947 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f4d5b-8d55-4d5f-aa25-81e2a905bb04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:25.086733 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f4d5b-8d55-4d5f-aa25-81e2a905bb04 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:25.111749 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 946/1917] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:44:24 2022] POST /identity/v3/users => generated 299 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:44:25.114352 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f399d-fdc6-4f40-8dd2-874020dc3541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:25.115268 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f4d5b-8d55-4d5f-aa25-81e2a905bb04 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:25.115399 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f399d-fdc6-4f40-8dd2-874020dc3541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:25.116286 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f399d-fdc6-4f40-8dd2-874020dc3541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:25.116286 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f399d-fdc6-4f40-8dd2-874020dc3541 admin admin] PATH_INFO: `/v3/users/5c2db4da5650486a862d76cd5e476e36` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:25.117516 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27f399d-fdc6-4f40-8dd2-874020dc3541 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c2db4da5650486a862d76cd5e476e36)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:25.120450 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27f399d-fdc6-4f40-8dd2-874020dc3541 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:25.125720 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f4d5b-8d55-4d5f-aa25-81e2a905bb04 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:25.132353 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b877991-8e95-4658-bae8-be54bbdd35fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:25.133179 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b877991-8e95-4658-bae8-be54bbdd35fd admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:25.133460 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b877991-8e95-4658-bae8-be54bbdd35fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:25.133736 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b877991-8e95-4658-bae8-be54bbdd35fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:25.135025 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b877991-8e95-4658-bae8-be54bbdd35fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:25.136230 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b877991-8e95-4658-bae8-be54bbdd35fd admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:25.151392 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 947/1918] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:25.155475 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b877991-8e95-4658-bae8-be54bbdd35fd admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:25.167365 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b877991-8e95-4658-bae8-be54bbdd35fd admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:25.175536 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051192ef-69b0-4a8c-8706-2ea43ad22aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:25.176462 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051192ef-69b0-4a8c-8706-2ea43ad22aa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:25.176827 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051192ef-69b0-4a8c-8706-2ea43ad22aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:25.177116 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051192ef-69b0-4a8c-8706-2ea43ad22aa3 admin admin] PATH_INFO: `/v3/projects/17a19a60db1842eebc9003094a5932f6/users/9ca644bbe7894fc09de244891b885d14/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:25.197811 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051192ef-69b0-4a8c-8706-2ea43ad22aa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17a19a60db1842eebc9003094a5932f6, user_id=9ca644bbe7894fc09de244891b885d14, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:25.200537 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051192ef-69b0-4a8c-8706-2ea43ad22aa3 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:25.203697 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f27f399d-fdc6-4f40-8dd2-874020dc3541 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c2db4da5650486a862d76cd5e476e36'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:25.204773 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f27f399d-fdc6-4f40-8dd2-874020dc3541 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c2db4da5650486a862d76cd5e476e36'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:25.205758 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f27f399d-fdc6-4f40-8dd2-874020dc3541 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c2db4da5650486a862d76cd5e476e36'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:25.215495 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f27f399d-fdc6-4f40-8dd2-874020dc3541 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c2db4da5650486a862d76cd5e476e36'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:25.218556 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 948/1919] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:44:25 2022] PUT /identity/v3/projects/17a19a60db1842eebc9003094a5932f6/users/9ca644bbe7894fc09de244891b885d14/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:25.221889 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051192ef-69b0-4a8c-8706-2ea43ad22aa3 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:25.224031 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-051192ef-69b0-4a8c-8706-2ea43ad22aa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:25.227579 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f27f399d-fdc6-4f40-8dd2-874020dc3541 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c2db4da5650486a862d76cd5e476e36'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:25.248352 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 972/1920] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:44:25 2022] DELETE /identity/v3/users/5c2db4da5650486a862d76cd5e476e36 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:44:25.253053 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45e736-a923-46d6-8357-2662f7fe04f1 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:25.254017 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45e736-a923-46d6-8357-2662f7fe04f1 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:25.255281 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a45e736-a923-46d6-8357-2662f7fe04f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:25.282627 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-7a45e736-a923-46d6-8357-2662f7fe04f1 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:25.284280 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7a45e736-a923-46d6-8357-2662f7fe04f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:25.306181 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051192ef-69b0-4a8c-8706-2ea43ad22aa3 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:25.343389 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:25.354046 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:25.357466 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 973/1921] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:25.357466 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45e736-a923-46d6-8357-2662f7fe04f1 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:25.363472 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7a45e736-a923-46d6-8357-2662f7fe04f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:25.376117 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a45e736-a923-46d6-8357-2662f7fe04f1 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:25.383116 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529b181-5f45-4316-9554-ce418567bf9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:25.384191 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529b181-5f45-4316-9554-ce418567bf9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:25.384481 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529b181-5f45-4316-9554-ce418567bf9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:25.385293 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529b181-5f45-4316-9554-ce418567bf9a admin admin] PATH_INFO: `/v3/projects/1aadf0d1b1c047fe95bfd118d4611ee5` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:25.385403 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d309f1-2072-4ae5-ada9-7971962d4262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:25.385699 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d309f1-2072-4ae5-ada9-7971962d4262 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:25.385987 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d309f1-2072-4ae5-ada9-7971962d4262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:25.386227 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c529b181-5f45-4316-9554-ce418567bf9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1aadf0d1b1c047fe95bfd118d4611ee5)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:25.386336 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d309f1-2072-4ae5-ada9-7971962d4262 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:25.387131 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d309f1-2072-4ae5-ada9-7971962d4262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:25.388610 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c529b181-5f45-4316-9554-ce418567bf9a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:25.388773 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d309f1-2072-4ae5-ada9-7971962d4262 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:25.399676 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 949/1922] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 03:44:25.400466 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d309f1-2072-4ae5-ada9-7971962d4262 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:25.402159 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-07d309f1-2072-4ae5-ada9-7971962d4262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:25.452191 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c529b181-5f45-4316-9554-ce418567bf9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1aadf0d1b1c047fe95bfd118d4611ee5', 'request_id': 'req-c529b181-5f45-4316-9554-ce418567bf9a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:25.459932 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c529b181-5f45-4316-9554-ce418567bf9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1aadf0d1b1c047fe95bfd118d4611ee5', 'request_id': 'req-c529b181-5f45-4316-9554-ce418567bf9a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:25.469919 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c529b181-5f45-4316-9554-ce418567bf9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1aadf0d1b1c047fe95bfd118d4611ee5', 'request_id': 'req-c529b181-5f45-4316-9554-ce418567bf9a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:25.470210 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d309f1-2072-4ae5-ada9-7971962d4262 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:25.481569 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c529b181-5f45-4316-9554-ce418567bf9a admin admin] The token cache is being invalidate because project 1aadf0d1b1c047fe95bfd118d4611ee5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:44:25.481863 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c529b181-5f45-4316-9554-ce418567bf9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:25.482564 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c529b181-5f45-4316-9554-ce418567bf9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:25.486859 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 974/1923] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:44:25 2022] DELETE /identity/v3/projects/1aadf0d1b1c047fe95bfd118d4611ee5 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:25.486859 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529b181-5f45-4316-9554-ce418567bf9a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:25.486859 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c529b181-5f45-4316-9554-ce418567bf9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:25.535072 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44d13b-9930-4839-af05-8a61f827b721 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:25.536051 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44d13b-9930-4839-af05-8a61f827b721 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:25.536358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44d13b-9930-4839-af05-8a61f827b721 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:25.536739 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44d13b-9930-4839-af05-8a61f827b721 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:25.538906 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6a44d13b-9930-4839-af05-8a61f827b721 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:25.566721 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529b181-5f45-4316-9554-ce418567bf9a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:25.573335 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb48ec-a5cd-4172-8c59-0714ad74efd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:25.574196 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb48ec-a5cd-4172-8c59-0714ad74efd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:25.575110 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb48ec-a5cd-4172-8c59-0714ad74efd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:25.575801 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb48ec-a5cd-4172-8c59-0714ad74efd8 admin admin] PATH_INFO: `/v3/projects/17a19a60db1842eebc9003094a5932f6/users/9ca644bbe7894fc09de244891b885d14/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:25.578846 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eb48ec-a5cd-4172-8c59-0714ad74efd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17a19a60db1842eebc9003094a5932f6, user_id=9ca644bbe7894fc09de244891b885d14, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:25.583894 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eb48ec-a5cd-4172-8c59-0714ad74efd8 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:25.612094 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 975/1924] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:44:25 2022] PUT /identity/v3/projects/17a19a60db1842eebc9003094a5932f6/users/9ca644bbe7894fc09de244891b885d14/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:25.612094 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb48ec-a5cd-4172-8c59-0714ad74efd8 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:25.612094 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-11eb48ec-a5cd-4172-8c59-0714ad74efd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:25.627452 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44d13b-9930-4839-af05-8a61f827b721 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:25.629507 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a44d13b-9930-4839-af05-8a61f827b721 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:25.641034 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 950/1925] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:44:25.642644 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d7f98-7938-4839-9646-78e1e63d0013 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:25.642951 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d7f98-7938-4839-9646-78e1e63d0013 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:25.643236 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d7f98-7938-4839-9646-78e1e63d0013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:25.682056 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-001d7f98-7938-4839-9646-78e1e63d0013 None None] MFA Rules not processed for user `9ca644bbe7894fc09de244891b885d14`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:25.683343 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-001d7f98-7938-4839-9646-78e1e63d0013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:25.713019 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb48ec-a5cd-4172-8c59-0714ad74efd8 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:25.718932 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981cbdf-7642-468c-ad94-85be00ab07b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:25.722717 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981cbdf-7642-468c-ad94-85be00ab07b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:25.722717 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981cbdf-7642-468c-ad94-85be00ab07b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:25.722717 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3981cbdf-7642-468c-ad94-85be00ab07b2 admin admin] PATH_INFO: `/v3/users/be909a83960149458f18fe90c624e41c` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:25.723924 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3981cbdf-7642-468c-ad94-85be00ab07b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be909a83960149458f18fe90c624e41c)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:25.726664 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3981cbdf-7642-468c-ad94-85be00ab07b2 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:25.767886 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:25.770779 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:25.832871 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3981cbdf-7642-468c-ad94-85be00ab07b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be909a83960149458f18fe90c624e41c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:25.835726 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3981cbdf-7642-468c-ad94-85be00ab07b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be909a83960149458f18fe90c624e41c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:25.837454 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3981cbdf-7642-468c-ad94-85be00ab07b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be909a83960149458f18fe90c624e41c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:25.860069 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3981cbdf-7642-468c-ad94-85be00ab07b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be909a83960149458f18fe90c624e41c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:25.864599 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 951/1926] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:25 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:25.876854 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d7f98-7938-4839-9646-78e1e63d0013 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:25.880078 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-001d7f98-7938-4839-9646-78e1e63d0013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:25.881763 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3981cbdf-7642-468c-ad94-85be00ab07b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be909a83960149458f18fe90c624e41c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:25.929663 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 976/1927] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:44:25 2022] DELETE /identity/v3/users/be909a83960149458f18fe90c624e41c => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:25.978386 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d7f98-7938-4839-9646-78e1e63d0013 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:26.055743 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598edb2-ffdd-4b72-8f39-dfe6059cce86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:26.056837 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598edb2-ffdd-4b72-8f39-dfe6059cce86 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:26.057131 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598edb2-ffdd-4b72-8f39-dfe6059cce86 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:26.057756 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598edb2-ffdd-4b72-8f39-dfe6059cce86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:26.061036 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c598edb2-ffdd-4b72-8f39-dfe6059cce86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:26.138915 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981cbdf-7642-468c-ad94-85be00ab07b2 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:26.140547 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3981cbdf-7642-468c-ad94-85be00ab07b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:26.146258 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598edb2-ffdd-4b72-8f39-dfe6059cce86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:26.148952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598edb2-ffdd-4b72-8f39-dfe6059cce86 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:26.172011 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 952/1928] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:44:26.251878 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3981cbdf-7642-468c-ad94-85be00ab07b2 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:26.259728 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa5895-bd13-4961-a061-ee9184d2631d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:26.261407 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa5895-bd13-4961-a061-ee9184d2631d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:26.262037 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa5895-bd13-4961-a061-ee9184d2631d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:26.262379 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa5895-bd13-4961-a061-ee9184d2631d admin admin] PATH_INFO: `/v3/projects/8bd3546b4703441cbd7427619defca0f` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:26.263782 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caa5895-bd13-4961-a061-ee9184d2631d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bd3546b4703441cbd7427619defca0f)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:26.265710 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caa5895-bd13-4961-a061-ee9184d2631d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:26.349104 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598edb2-ffdd-4b72-8f39-dfe6059cce86 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:26.351145 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c598edb2-ffdd-4b72-8f39-dfe6059cce86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:26.380419 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598edb2-ffdd-4b72-8f39-dfe6059cce86 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:26.408219 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9caa5895-bd13-4961-a061-ee9184d2631d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bd3546b4703441cbd7427619defca0f', 'request_id': 'req-9caa5895-bd13-4961-a061-ee9184d2631d'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:26.428058 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9caa5895-bd13-4961-a061-ee9184d2631d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bd3546b4703441cbd7427619defca0f', 'request_id': 'req-9caa5895-bd13-4961-a061-ee9184d2631d'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:26.457782 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9caa5895-bd13-4961-a061-ee9184d2631d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bd3546b4703441cbd7427619defca0f', 'request_id': 'req-9caa5895-bd13-4961-a061-ee9184d2631d'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:26.467067 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:26.489936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9caa5895-bd13-4961-a061-ee9184d2631d admin admin] The token cache is being invalidate because project 8bd3546b4703441cbd7427619defca0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:44:26.490493 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9caa5895-bd13-4961-a061-ee9184d2631d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:26.492237 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9caa5895-bd13-4961-a061-ee9184d2631d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:26.497512 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 977/1929] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:44:26 2022] DELETE /identity/v3/projects/8bd3546b4703441cbd7427619defca0f => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:44:26.499414 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa5895-bd13-4961-a061-ee9184d2631d admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:26.502252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9caa5895-bd13-4961-a061-ee9184d2631d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:26.519028 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc695189-0e9f-4cb1-ada5-6932fe31a4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:26.521174 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc695189-0e9f-4cb1-ada5-6932fe31a4ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:26.521558 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc695189-0e9f-4cb1-ada5-6932fe31a4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:26.521980 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc695189-0e9f-4cb1-ada5-6932fe31a4ab admin admin] PATH_INFO: `/v3/projects/5fc03a77cb554d08aa40e9c86b861f95` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:26.524905 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc695189-0e9f-4cb1-ada5-6932fe31a4ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fc03a77cb554d08aa40e9c86b861f95)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:26.527491 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc695189-0e9f-4cb1-ada5-6932fe31a4ab admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:26.609936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:26.637143 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cc695189-0e9f-4cb1-ada5-6932fe31a4ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fc03a77cb554d08aa40e9c86b861f95', 'request_id': 'req-cc695189-0e9f-4cb1-ada5-6932fe31a4ab'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:26.655419 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cc695189-0e9f-4cb1-ada5-6932fe31a4ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fc03a77cb554d08aa40e9c86b861f95', 'request_id': 'req-cc695189-0e9f-4cb1-ada5-6932fe31a4ab'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:26.690595 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cc695189-0e9f-4cb1-ada5-6932fe31a4ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fc03a77cb554d08aa40e9c86b861f95', 'request_id': 'req-cc695189-0e9f-4cb1-ada5-6932fe31a4ab'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:26.730795 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cc695189-0e9f-4cb1-ada5-6932fe31a4ab admin admin] The token cache is being invalidate because project 5fc03a77cb554d08aa40e9c86b861f95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:44:26.730795 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cc695189-0e9f-4cb1-ada5-6932fe31a4ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:26.731779 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-cc695189-0e9f-4cb1-ada5-6932fe31a4ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:26.735411 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa5895-bd13-4961-a061-ee9184d2631d admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:26.736084 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 953/1930] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:44:26 2022] DELETE /identity/v3/projects/5fc03a77cb554d08aa40e9c86b861f95 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:26.742986 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b8e4b-186a-45fa-89da-11581e51d6ce None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:26.743280 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b8e4b-186a-45fa-89da-11581e51d6ce None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:26.743983 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b8e4b-186a-45fa-89da-11581e51d6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:26.802754 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c81b8e4b-186a-45fa-89da-11581e51d6ce None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:26.804495 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c81b8e4b-186a-45fa-89da-11581e51d6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:26.921511 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ea225-8f16-49ec-ad2e-d81edca50f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:26.934169 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ea225-8f16-49ec-ad2e-d81edca50f4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:26.934169 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ea225-8f16-49ec-ad2e-d81edca50f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:26.934169 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ea225-8f16-49ec-ad2e-d81edca50f4b admin admin] PATH_INFO: `/v3/users/3bdb06491d374a5486080f7ce4df8b44` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:26.934169 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ea225-8f16-49ec-ad2e-d81edca50f4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bdb06491d374a5486080f7ce4df8b44)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:26.949119 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ea225-8f16-49ec-ad2e-d81edca50f4b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:26.995353 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 954/1931] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:27.004447 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42119ae4-ecd6-4601-8fca-417a0307215e None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:27.005283 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42119ae4-ecd6-4601-8fca-417a0307215e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:27.005793 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42119ae4-ecd6-4601-8fca-417a0307215e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:27.061888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-42119ae4-ecd6-4601-8fca-417a0307215e None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:27.063882 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-42119ae4-ecd6-4601-8fca-417a0307215e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:27.085049 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 955/1932] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:44:27.086642 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42119ae4-ecd6-4601-8fca-417a0307215e None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:27.091729 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3e8ea225-8f16-49ec-ad2e-d81edca50f4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bdb06491d374a5486080f7ce4df8b44'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:27.092644 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3e8ea225-8f16-49ec-ad2e-d81edca50f4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bdb06491d374a5486080f7ce4df8b44'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:27.094881 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3e8ea225-8f16-49ec-ad2e-d81edca50f4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bdb06491d374a5486080f7ce4df8b44'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:27.104197 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42119ae4-ecd6-4601-8fca-417a0307215e None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:27.112070 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40dfa6-ff34-48a4-976a-190341bf77c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:27.113661 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40dfa6-ff34-48a4-976a-190341bf77c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:27.114751 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40dfa6-ff34-48a4-976a-190341bf77c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:27.115238 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40dfa6-ff34-48a4-976a-190341bf77c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:27.116634 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b40dfa6-ff34-48a4-976a-190341bf77c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:44:27.117107 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3e8ea225-8f16-49ec-ad2e-d81edca50f4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bdb06491d374a5486080f7ce4df8b44'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:27.117688 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b40dfa6-ff34-48a4-976a-190341bf77c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:27.120360 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b40dfa6-ff34-48a4-976a-190341bf77c3 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:27.145309 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 956/1933] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:44:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:44:27.147334 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40dfa6-ff34-48a4-976a-190341bf77c3 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:27.147952 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3e8ea225-8f16-49ec-ad2e-d81edca50f4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bdb06491d374a5486080f7ce4df8b44'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:27.165793 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8b40dfa6-ff34-48a4-976a-190341bf77c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:27.185904 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 978/1934] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:44:26 2022] DELETE /identity/v3/users/3bdb06491d374a5486080f7ce4df8b44 => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:27.201856 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ea225-8f16-49ec-ad2e-d81edca50f4b admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:27.203380 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3e8ea225-8f16-49ec-ad2e-d81edca50f4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:27.208561 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40dfa6-ff34-48a4-976a-190341bf77c3 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:27.267680 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:27.292194 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feeda8b-6819-460a-9f30-5b3789e96741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:27.293134 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feeda8b-6819-460a-9f30-5b3789e96741 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:27.293485 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feeda8b-6819-460a-9f30-5b3789e96741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:27.293836 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feeda8b-6819-460a-9f30-5b3789e96741 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:27.294632 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feeda8b-6819-460a-9f30-5b3789e96741 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:27.298429 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feeda8b-6819-460a-9f30-5b3789e96741 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:27.353810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:27.379197 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ea225-8f16-49ec-ad2e-d81edca50f4b admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:27.381837 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 957/1935] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:44:27 2022] POST /identity/v3/projects => generated 379 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:27.383124 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feeda8b-6819-460a-9f30-5b3789e96741 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:27.506100 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624722cb-5581-4f43-a522-7cb8c60e0335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:27.507554 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624722cb-5581-4f43-a522-7cb8c60e0335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:27.508181 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624722cb-5581-4f43-a522-7cb8c60e0335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:27.508553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624722cb-5581-4f43-a522-7cb8c60e0335 admin admin] PATH_INFO: `/v3/users/6d97914670ca479f9bef0627a5e62a50` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:27.510540 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624722cb-5581-4f43-a522-7cb8c60e0335 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d97914670ca479f9bef0627a5e62a50)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:27.516006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624722cb-5581-4f43-a522-7cb8c60e0335 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:27.561666 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feeda8b-6819-460a-9f30-5b3789e96741 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:27.588135 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2398f-9004-495a-8e61-10fd32a57172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:27.595093 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2398f-9004-495a-8e61-10fd32a57172 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:27.595410 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2398f-9004-495a-8e61-10fd32a57172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:27.595707 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab2398f-9004-495a-8e61-10fd32a57172 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:27.596473 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab2398f-9004-495a-8e61-10fd32a57172 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:27.598589 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab2398f-9004-495a-8e61-10fd32a57172 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:27.634380 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 958/1936] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:44:27 2022] POST /identity/v3/users => generated 290 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:27.638498 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2398f-9004-495a-8e61-10fd32a57172 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:27.653034 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-624722cb-5581-4f43-a522-7cb8c60e0335 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d97914670ca479f9bef0627a5e62a50'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:27.654045 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-624722cb-5581-4f43-a522-7cb8c60e0335 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d97914670ca479f9bef0627a5e62a50'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:27.657514 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab2398f-9004-495a-8e61-10fd32a57172 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:27.657878 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-624722cb-5581-4f43-a522-7cb8c60e0335 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d97914670ca479f9bef0627a5e62a50'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:27.665851 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f687ad-e055-41d3-bff5-df3a36be5a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:27.668114 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f687ad-e055-41d3-bff5-df3a36be5a7a admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:27.669001 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f687ad-e055-41d3-bff5-df3a36be5a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:27.669590 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f687ad-e055-41d3-bff5-df3a36be5a7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:27.671033 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f687ad-e055-41d3-bff5-df3a36be5a7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:27.672970 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f687ad-e055-41d3-bff5-df3a36be5a7a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:27.674640 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-624722cb-5581-4f43-a522-7cb8c60e0335 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d97914670ca479f9bef0627a5e62a50'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:27.690110 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 959/1937] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:27.694747 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-624722cb-5581-4f43-a522-7cb8c60e0335 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d97914670ca479f9bef0627a5e62a50'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:27.695487 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f687ad-e055-41d3-bff5-df3a36be5a7a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:27.697779 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-97f687ad-e055-41d3-bff5-df3a36be5a7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:27.714068 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f687ad-e055-41d3-bff5-df3a36be5a7a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:27.721408 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c176d68-1773-4a4c-a11a-475d132ea289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:27.722786 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c176d68-1773-4a4c-a11a-475d132ea289 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:27.723315 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c176d68-1773-4a4c-a11a-475d132ea289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:27.723851 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c176d68-1773-4a4c-a11a-475d132ea289 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:27.724908 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c176d68-1773-4a4c-a11a-475d132ea289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:27.727032 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c176d68-1773-4a4c-a11a-475d132ea289 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:27.734899 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 979/1938] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:44:27 2022] DELETE /identity/v3/users/6d97914670ca479f9bef0627a5e62a50 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:27.740193 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c2ef4-2976-41af-8ab1-d2067eb56a5c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:27.743763 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c2ef4-2976-41af-8ab1-d2067eb56a5c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:27.744243 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c2ef4-2976-41af-8ab1-d2067eb56a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:27.746299 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 960/1939] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:27.751517 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c176d68-1773-4a4c-a11a-475d132ea289 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:27.765485 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c176d68-1773-4a4c-a11a-475d132ea289 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:27.787525 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e14c2ef4-2976-41af-8ab1-d2067eb56a5c None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:27.791628 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e14c2ef4-2976-41af-8ab1-d2067eb56a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:27.845027 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215387d0-c4d2-4db3-a902-0fd8191f5e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:27.846418 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215387d0-c4d2-4db3-a902-0fd8191f5e6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:27.846739 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215387d0-c4d2-4db3-a902-0fd8191f5e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:27.847243 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215387d0-c4d2-4db3-a902-0fd8191f5e6d admin admin] PATH_INFO: `/v3/projects/b9de162749904bbcbcb2acfbdc503331/users/1ea3dd02344c4bc094b0d93884205aab/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:27.869002 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215387d0-c4d2-4db3-a902-0fd8191f5e6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9de162749904bbcbcb2acfbdc503331, user_id=1ea3dd02344c4bc094b0d93884205aab, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:27.871912 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215387d0-c4d2-4db3-a902-0fd8191f5e6d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:27.901550 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 961/1940] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:44:27 2022] PUT /identity/v3/projects/b9de162749904bbcbcb2acfbdc503331/users/1ea3dd02344c4bc094b0d93884205aab/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:44:27.903818 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685872b-9b9c-493f-a0f4-cbabfcb70288 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:27.904123 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685872b-9b9c-493f-a0f4-cbabfcb70288 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:27.904411 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1685872b-9b9c-493f-a0f4-cbabfcb70288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:27.945589 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-1685872b-9b9c-493f-a0f4-cbabfcb70288 None None] MFA Rules not processed for user `1ea3dd02344c4bc094b0d93884205aab`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:27.948304 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1685872b-9b9c-493f-a0f4-cbabfcb70288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:27.955734 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:27.991209 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 980/1941] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:28.051553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c2ef4-2976-41af-8ab1-d2067eb56a5c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:28.053461 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e14c2ef4-2976-41af-8ab1-d2067eb56a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:28.106679 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:28.114783 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 962/1942] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:28.116018 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685872b-9b9c-493f-a0f4-cbabfcb70288 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:28.197904 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c2ef4-2976-41af-8ab1-d2067eb56a5c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:28.235217 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1685872b-9b9c-493f-a0f4-cbabfcb70288 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:28.258349 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef4aad-58e0-456c-b234-29cce08c436e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:28.259176 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c132d4c-bbef-4eed-adbf-bdda43353801 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:28.260227 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c132d4c-bbef-4eed-adbf-bdda43353801 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:28.260587 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c132d4c-bbef-4eed-adbf-bdda43353801 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:28.260798 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef4aad-58e0-456c-b234-29cce08c436e admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:28.260989 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c132d4c-bbef-4eed-adbf-bdda43353801 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:28.261868 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef4aad-58e0-456c-b234-29cce08c436e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:28.263077 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef4aad-58e0-456c-b234-29cce08c436e admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:28.266480 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ef4aad-58e0-456c-b234-29cce08c436e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:28.272108 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c132d4c-bbef-4eed-adbf-bdda43353801 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:28.273645 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c132d4c-bbef-4eed-adbf-bdda43353801 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:28.276593 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ef4aad-58e0-456c-b234-29cce08c436e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:28.285670 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 981/1943] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 03:44:28.325639 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 963/1944] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:44:28 2022] POST /identity/v3/projects => generated 379 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:28.330421 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c132d4c-bbef-4eed-adbf-bdda43353801 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:28.345203 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c132d4c-bbef-4eed-adbf-bdda43353801 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:28.502060 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398f968-3470-4591-aff8-802dca2a6091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:28.504897 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398f968-3470-4591-aff8-802dca2a6091 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:28.505942 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398f968-3470-4591-aff8-802dca2a6091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:28.505942 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398f968-3470-4591-aff8-802dca2a6091 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:28.508163 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3398f968-3470-4591-aff8-802dca2a6091 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:28.515402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3398f968-3470-4591-aff8-802dca2a6091 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:28.582543 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 982/1945] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:44:28 2022] POST /identity/v3/users => generated 296 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:28.586037 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef4aad-58e0-456c-b234-29cce08c436e admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:28.600683 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef4aad-58e0-456c-b234-29cce08c436e admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:28.620765 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7acd4-24f0-42b2-b697-86aa4d5131e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:28.622878 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7acd4-24f0-42b2-b697-86aa4d5131e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:28.623295 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7acd4-24f0-42b2-b697-86aa4d5131e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:28.623740 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7acd4-24f0-42b2-b697-86aa4d5131e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:28.625092 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7acd4-24f0-42b2-b697-86aa4d5131e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:28.626932 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db7acd4-24f0-42b2-b697-86aa4d5131e8 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:28.651464 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398f968-3470-4591-aff8-802dca2a6091 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:28.651866 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 964/1946] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:28.669133 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398f968-3470-4591-aff8-802dca2a6091 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:28.675719 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94177d-560b-4ede-a25f-a76864f24a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:28.678573 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94177d-560b-4ede-a25f-a76864f24a6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:28.679223 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94177d-560b-4ede-a25f-a76864f24a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:28.680059 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94177d-560b-4ede-a25f-a76864f24a6e admin admin] PATH_INFO: `/v3/projects/898615ff19fc4702a83adf476625a393/users/2eb9364940e74cab89abd981c1ef9f05/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:28.725912 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94177d-560b-4ede-a25f-a76864f24a6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=898615ff19fc4702a83adf476625a393, user_id=2eb9364940e74cab89abd981c1ef9f05, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:28.728999 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94177d-560b-4ede-a25f-a76864f24a6e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:28.749033 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 983/1947] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:44:28 2022] PUT /identity/v3/projects/898615ff19fc4702a83adf476625a393/users/2eb9364940e74cab89abd981c1ef9f05/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:44:28.755119 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7acd4-24f0-42b2-b697-86aa4d5131e8 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:28.770223 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7acd4-24f0-42b2-b697-86aa4d5131e8 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:28.912656 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201f506-3cc9-4ce1-b89e-5aca1984f6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:28.914072 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201f506-3cc9-4ce1-b89e-5aca1984f6fc admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:28.914072 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201f506-3cc9-4ce1-b89e-5aca1984f6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:28.914072 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201f506-3cc9-4ce1-b89e-5aca1984f6fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:28.915161 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201f506-3cc9-4ce1-b89e-5aca1984f6fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:28.918852 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201f506-3cc9-4ce1-b89e-5aca1984f6fc admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:28.977166 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94177d-560b-4ede-a25f-a76864f24a6e admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:28.990276 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 965/1948] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:28.991909 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94177d-560b-4ede-a25f-a76864f24a6e admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:29.002602 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8bb0e-fd78-4389-b57c-04868fb8b06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:29.006668 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8bb0e-fd78-4389-b57c-04868fb8b06c admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:29.007162 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8bb0e-fd78-4389-b57c-04868fb8b06c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:29.007727 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8bb0e-fd78-4389-b57c-04868fb8b06c admin admin] PATH_INFO: `/v3/projects/898615ff19fc4702a83adf476625a393/users/2eb9364940e74cab89abd981c1ef9f05/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:29.013424 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f8bb0e-fd78-4389-b57c-04868fb8b06c admin admin] RBAC: Authorizing `identity:create_grant(project_id=898615ff19fc4702a83adf476625a393, user_id=2eb9364940e74cab89abd981c1ef9f05, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:29.020255 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f8bb0e-fd78-4389-b57c-04868fb8b06c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:29.031043 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201f506-3cc9-4ce1-b89e-5aca1984f6fc admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:29.034237 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0201f506-3cc9-4ce1-b89e-5aca1984f6fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:29.048028 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 984/1949] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:44:28 2022] PUT /identity/v3/projects/898615ff19fc4702a83adf476625a393/users/2eb9364940e74cab89abd981c1ef9f05/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:29.060504 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858976b2-bafb-4e8e-b656-a5f1b0297963 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:29.060985 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858976b2-bafb-4e8e-b656-a5f1b0297963 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:29.061467 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858976b2-bafb-4e8e-b656-a5f1b0297963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:29.084863 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201f506-3cc9-4ce1-b89e-5aca1984f6fc admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:29.120444 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-858976b2-bafb-4e8e-b656-a5f1b0297963 None None] MFA Rules not processed for user `2eb9364940e74cab89abd981c1ef9f05`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:29.122160 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-858976b2-bafb-4e8e-b656-a5f1b0297963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:29.126080 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:29.169902 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:29.258308 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9be36-4827-4e5a-893f-91647f2fc088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:29.265741 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9be36-4827-4e5a-893f-91647f2fc088 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:29.266189 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9be36-4827-4e5a-893f-91647f2fc088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:29.266842 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9be36-4827-4e5a-893f-91647f2fc088 admin admin] PATH_INFO: `/v3/projects/e301168cf3554411ac27aa96048848fd` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:29.271131 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb9be36-4827-4e5a-893f-91647f2fc088 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e301168cf3554411ac27aa96048848fd)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:29.273203 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb9be36-4827-4e5a-893f-91647f2fc088 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:29.338056 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 985/1950] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:29 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:29.355652 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858976b2-bafb-4e8e-b656-a5f1b0297963 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:29.357176 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-858976b2-bafb-4e8e-b656-a5f1b0297963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:29.404771 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-1fb9be36-4827-4e5a-893f-91647f2fc088 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e301168cf3554411ac27aa96048848fd', 'request_id': 'req-1fb9be36-4827-4e5a-893f-91647f2fc088'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:29.413400 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-1fb9be36-4827-4e5a-893f-91647f2fc088 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e301168cf3554411ac27aa96048848fd', 'request_id': 'req-1fb9be36-4827-4e5a-893f-91647f2fc088'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:29.429257 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-1fb9be36-4827-4e5a-893f-91647f2fc088 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e301168cf3554411ac27aa96048848fd', 'request_id': 'req-1fb9be36-4827-4e5a-893f-91647f2fc088'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:29.451320 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858976b2-bafb-4e8e-b656-a5f1b0297963 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:29.451468 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-1fb9be36-4827-4e5a-893f-91647f2fc088 admin admin] The token cache is being invalidate because project e301168cf3554411ac27aa96048848fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:44:29.452620 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-1fb9be36-4827-4e5a-893f-91647f2fc088 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:29.454869 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-1fb9be36-4827-4e5a-893f-91647f2fc088 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:29.459339 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 966/1951] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:44:29 2022] DELETE /identity/v3/projects/e301168cf3554411ac27aa96048848fd => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:29.471535 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465befb-2173-4ad4-a038-c6676c8fde16 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:29.472490 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465befb-2173-4ad4-a038-c6676c8fde16 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:29.473905 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465befb-2173-4ad4-a038-c6676c8fde16 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:29.476149 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 967/1952] 10.222.0.20 () {54 vars in 921 bytes} [Thu Jul 21 03:44:29 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:44:29.477461 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ecdee0-969b-47e2-bca3-9c57ef84796b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:29.478450 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ecdee0-969b-47e2-bca3-9c57ef84796b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:29.479096 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ecdee0-969b-47e2-bca3-9c57ef84796b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:29.520979 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-58ecdee0-969b-47e2-bca3-9c57ef84796b None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:29.525771 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-58ecdee0-969b-47e2-bca3-9c57ef84796b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:29.562300 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db2131-0ea1-4fa2-bc67-e5b99872d213 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:29.563227 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db2131-0ea1-4fa2-bc67-e5b99872d213 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:29.563928 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db2131-0ea1-4fa2-bc67-e5b99872d213 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:29.563928 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db2131-0ea1-4fa2-bc67-e5b99872d213 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:29.569272 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b0db2131-0ea1-4fa2-bc67-e5b99872d213 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:29.683794 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 968/1953] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:29.684735 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ecdee0-969b-47e2-bca3-9c57ef84796b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:29.686112 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-58ecdee0-969b-47e2-bca3-9c57ef84796b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:29.727766 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ecdee0-969b-47e2-bca3-9c57ef84796b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:29.756714 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db2131-0ea1-4fa2-bc67-e5b99872d213 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:29.757880 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03128586-038e-4a9c-9a2b-bef084c0efa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:29.758170 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db2131-0ea1-4fa2-bc67-e5b99872d213 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:29.760734 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03128586-038e-4a9c-9a2b-bef084c0efa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:29.760734 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03128586-038e-4a9c-9a2b-bef084c0efa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:29.761128 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03128586-038e-4a9c-9a2b-bef084c0efa1 admin admin] PATH_INFO: `/v3/projects/6700b80dad6140fea6268209f1eca0e2` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:29.765681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03128586-038e-4a9c-9a2b-bef084c0efa1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6700b80dad6140fea6268209f1eca0e2)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:29.770572 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03128586-038e-4a9c-9a2b-bef084c0efa1 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:29.780611 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 986/1954] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:29 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 03:44:29.783393 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1559d-a8b3-41e2-a062-c648192ded91 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:29.783873 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1559d-a8b3-41e2-a062-c648192ded91 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:29.784305 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1559d-a8b3-41e2-a062-c648192ded91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:29.811016 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b8a1559d-a8b3-41e2-a062-c648192ded91 None None] MFA Rules not processed for user `cefbe2d0c739428ab0d4dfeaed6c37ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:29.812902 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b8a1559d-a8b3-41e2-a062-c648192ded91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:29.849006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:29.859659 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:29.864129 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-03128586-038e-4a9c-9a2b-bef084c0efa1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6700b80dad6140fea6268209f1eca0e2', 'request_id': 'req-03128586-038e-4a9c-9a2b-bef084c0efa1'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:29.874352 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-03128586-038e-4a9c-9a2b-bef084c0efa1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6700b80dad6140fea6268209f1eca0e2', 'request_id': 'req-03128586-038e-4a9c-9a2b-bef084c0efa1'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:29.889306 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-03128586-038e-4a9c-9a2b-bef084c0efa1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6700b80dad6140fea6268209f1eca0e2', 'request_id': 'req-03128586-038e-4a9c-9a2b-bef084c0efa1'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:29.916739 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-03128586-038e-4a9c-9a2b-bef084c0efa1 admin admin] The token cache is being invalidate because project 6700b80dad6140fea6268209f1eca0e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:44:29.917111 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-03128586-038e-4a9c-9a2b-bef084c0efa1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:29.918177 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-03128586-038e-4a9c-9a2b-bef084c0efa1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:29.926033 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 969/1955] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:44:29 2022] DELETE /identity/v3/projects/6700b80dad6140fea6268209f1eca0e2 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:29.926033 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4cf63-31a8-455e-b561-d9461de8e7f2 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:29.926033 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4cf63-31a8-455e-b561-d9461de8e7f2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:29.927667 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4cf63-31a8-455e-b561-d9461de8e7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:29.974010 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 987/1956] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Jul 21 03:44:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:29.975241 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1559d-a8b3-41e2-a062-c648192ded91 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:29.977321 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b8a1559d-a8b3-41e2-a062-c648192ded91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:30.000863 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c2d4cf63-31a8-455e-b561-d9461de8e7f2 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:30.002057 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1559d-a8b3-41e2-a062-c648192ded91 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:30.002179 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c2d4cf63-31a8-455e-b561-d9461de8e7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:30.098843 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 970/1957] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:30.103340 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4cf63-31a8-455e-b561-d9461de8e7f2 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:30.105107 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c2d4cf63-31a8-455e-b561-d9461de8e7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:30.121329 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d473e-e009-4bf2-87b5-6e9e1573a985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:30.122077 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d473e-e009-4bf2-87b5-6e9e1573a985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:30.122329 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d473e-e009-4bf2-87b5-6e9e1573a985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:30.122735 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d473e-e009-4bf2-87b5-6e9e1573a985 admin admin] PATH_INFO: `/v3/users/7041070055054575a3cb24248c5fa024` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:30.124642 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d473e-e009-4bf2-87b5-6e9e1573a985 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7041070055054575a3cb24248c5fa024)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:30.127012 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d473e-e009-4bf2-87b5-6e9e1573a985 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:30.255397 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-492d473e-e009-4bf2-87b5-6e9e1573a985 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7041070055054575a3cb24248c5fa024'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:30.256592 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-492d473e-e009-4bf2-87b5-6e9e1573a985 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7041070055054575a3cb24248c5fa024'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:30.257352 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-492d473e-e009-4bf2-87b5-6e9e1573a985 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7041070055054575a3cb24248c5fa024'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:30.268535 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d4cf63-31a8-455e-b561-d9461de8e7f2 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:30.270003 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-492d473e-e009-4bf2-87b5-6e9e1573a985 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7041070055054575a3cb24248c5fa024'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:30.282520 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01d7da-b851-4879-a6b3-d4f07ec70307 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:30.283219 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01d7da-b851-4879-a6b3-d4f07ec70307 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:30.283618 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01d7da-b851-4879-a6b3-d4f07ec70307 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:30.284080 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01d7da-b851-4879-a6b3-d4f07ec70307 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:30.287878 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-492d473e-e009-4bf2-87b5-6e9e1573a985 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7041070055054575a3cb24248c5fa024'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:30.291055 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3b01d7da-b851-4879-a6b3-d4f07ec70307 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:30.313253 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b01d7da-b851-4879-a6b3-d4f07ec70307 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:30.314879 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b01d7da-b851-4879-a6b3-d4f07ec70307 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:30.318743 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 988/1958] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:44:29 2022] DELETE /identity/v3/users/7041070055054575a3cb24248c5fa024 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:30.319947 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d473e-e009-4bf2-87b5-6e9e1573a985 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:30.321998 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-492d473e-e009-4bf2-87b5-6e9e1573a985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:30.326573 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 971/1959] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:44:30.381044 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:30.426659 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d473e-e009-4bf2-87b5-6e9e1573a985 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:30.433817 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd3104-dce9-4470-98bb-d70343c2864c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:30.434904 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd3104-dce9-4470-98bb-d70343c2864c admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:30.435624 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd3104-dce9-4470-98bb-d70343c2864c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:30.436169 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd3104-dce9-4470-98bb-d70343c2864c admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:30.437126 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bd3104-dce9-4470-98bb-d70343c2864c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:44:30.437992 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bd3104-dce9-4470-98bb-d70343c2864c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:30.440298 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bd3104-dce9-4470-98bb-d70343c2864c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:30.459128 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 989/1960] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:44:30.464590 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01d7da-b851-4879-a6b3-d4f07ec70307 service nova] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:30.476133 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01d7da-b851-4879-a6b3-d4f07ec70307 service nova] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:30.481914 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d3209-055e-458e-a803-509a882c636e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:30.482856 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d3209-055e-458e-a803-509a882c636e admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:30.483040 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d3209-055e-458e-a803-509a882c636e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:30.483328 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d3209-055e-458e-a803-509a882c636e admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:30.484034 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d3209-055e-458e-a803-509a882c636e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:30.486086 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d3209-055e-458e-a803-509a882c636e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:30.535434 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 972/1961] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:44:30 2022] POST /identity/v3/projects => generated 401 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:30.536156 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd3104-dce9-4470-98bb-d70343c2864c admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:30.547158 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd3104-dce9-4470-98bb-d70343c2864c admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:30.604742 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab00d737-5d84-4208-897c-f4ccf9e1bda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:30.605272 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00d737-5d84-4208-897c-f4ccf9e1bda9 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:30.605590 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00d737-5d84-4208-897c-f4ccf9e1bda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:30.605843 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00d737-5d84-4208-897c-f4ccf9e1bda9 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:30.606579 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab00d737-5d84-4208-897c-f4ccf9e1bda9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:30.608738 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab00d737-5d84-4208-897c-f4ccf9e1bda9 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:30.630301 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 990/1962] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:44:30 2022] POST /identity/v3/users => generated 301 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:30.634546 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d3209-055e-458e-a803-509a882c636e admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:30.646750 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d3209-055e-458e-a803-509a882c636e admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:30.651668 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab00d737-5d84-4208-897c-f4ccf9e1bda9 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:30.654034 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ab00d737-5d84-4208-897c-f4ccf9e1bda9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:30.655174 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b05cd7-38c6-45ef-af35-225ca780501d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:30.656298 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b05cd7-38c6-45ef-af35-225ca780501d admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:30.656592 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b05cd7-38c6-45ef-af35-225ca780501d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:30.657183 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b05cd7-38c6-45ef-af35-225ca780501d admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:30.659092 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b05cd7-38c6-45ef-af35-225ca780501d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:30.661440 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b05cd7-38c6-45ef-af35-225ca780501d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:30.671412 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab00d737-5d84-4208-897c-f4ccf9e1bda9 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:30.676720 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 973/1963] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 03:44:30.678615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd529e36-dd59-4f29-bfb6-90a148db8430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:30.680264 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd529e36-dd59-4f29-bfb6-90a148db8430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:30.680610 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd529e36-dd59-4f29-bfb6-90a148db8430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:30.680687 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b05cd7-38c6-45ef-af35-225ca780501d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:30.680897 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd529e36-dd59-4f29-bfb6-90a148db8430 admin admin] PATH_INFO: `/v3/projects/9b5af979130140d69753298d98a22fdd` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:30.682188 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd529e36-dd59-4f29-bfb6-90a148db8430 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b5af979130140d69753298d98a22fdd)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:30.684216 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd529e36-dd59-4f29-bfb6-90a148db8430 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:30.700955 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b05cd7-38c6-45ef-af35-225ca780501d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:30.706155 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc8fc9-3ea3-4858-a357-122ce24bbd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:30.712430 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc8fc9-3ea3-4858-a357-122ce24bbd52 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:30.712430 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc8fc9-3ea3-4858-a357-122ce24bbd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:30.712430 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc8fc9-3ea3-4858-a357-122ce24bbd52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:30.712430 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc8fc9-3ea3-4858-a357-122ce24bbd52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:30.712430 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc8fc9-3ea3-4858-a357-122ce24bbd52 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:30.725454 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 974/1964] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:30.730016 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc8fc9-3ea3-4858-a357-122ce24bbd52 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:30.742497 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc8fc9-3ea3-4858-a357-122ce24bbd52 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:30.742661 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-bd529e36-dd59-4f29-bfb6-90a148db8430 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b5af979130140d69753298d98a22fdd', 'request_id': 'req-bd529e36-dd59-4f29-bfb6-90a148db8430'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:30.750743 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:30.751461 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-bd529e36-dd59-4f29-bfb6-90a148db8430 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b5af979130140d69753298d98a22fdd', 'request_id': 'req-bd529e36-dd59-4f29-bfb6-90a148db8430'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:30.760958 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-bd529e36-dd59-4f29-bfb6-90a148db8430 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b5af979130140d69753298d98a22fdd', 'request_id': 'req-bd529e36-dd59-4f29-bfb6-90a148db8430'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:30.774229 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-bd529e36-dd59-4f29-bfb6-90a148db8430 admin admin] The token cache is being invalidate because project 9b5af979130140d69753298d98a22fdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:44:30.774567 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-bd529e36-dd59-4f29-bfb6-90a148db8430 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:30.775272 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-bd529e36-dd59-4f29-bfb6-90a148db8430 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:30.776872 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 991/1965] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:44:30 2022] DELETE /identity/v3/projects/9b5af979130140d69753298d98a22fdd => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:30.780840 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd529e36-dd59-4f29-bfb6-90a148db8430 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:30.783006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-bd529e36-dd59-4f29-bfb6-90a148db8430 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:30.816405 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406f72f4-1ae3-4034-b56e-04496464815c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:30.819056 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f72f4-1ae3-4034-b56e-04496464815c admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:30.819510 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f72f4-1ae3-4034-b56e-04496464815c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:30.820054 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f72f4-1ae3-4034-b56e-04496464815c admin admin] PATH_INFO: `/v3/projects/899397be9a0f49c492e9a41b9391036c/users/52edf23b28ee4121bd6484f7f765446f/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:30.837610 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:30.841885 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f72f4-1ae3-4034-b56e-04496464815c admin admin] RBAC: Authorizing `identity:create_grant(project_id=899397be9a0f49c492e9a41b9391036c, user_id=52edf23b28ee4121bd6484f7f765446f, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:30.844752 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406f72f4-1ae3-4034-b56e-04496464815c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:30.859002 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd529e36-dd59-4f29-bfb6-90a148db8430 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:30.859353 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 975/1966] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:44:30 2022] PUT /identity/v3/projects/899397be9a0f49c492e9a41b9391036c/users/52edf23b28ee4121bd6484f7f765446f/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:44:30.869562 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13426e0f-d4c6-4026-bec8-d13098f51ac0 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:30.869854 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13426e0f-d4c6-4026-bec8-d13098f51ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:30.870129 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13426e0f-d4c6-4026-bec8-d13098f51ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:30.898703 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-13426e0f-d4c6-4026-bec8-d13098f51ac0 None None] MFA Rules not processed for user `52edf23b28ee4121bd6484f7f765446f`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:30.899929 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-13426e0f-d4c6-4026-bec8-d13098f51ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:30.916915 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b4e3f-347d-4658-bd80-6fd847f4e0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:30.917800 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b4e3f-347d-4658-bd80-6fd847f4e0c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:30.918090 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b4e3f-347d-4658-bd80-6fd847f4e0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:30.918372 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b4e3f-347d-4658-bd80-6fd847f4e0c0 admin admin] PATH_INFO: `/v3/users/6492a9e77b2a43abb7ea398ccfba1f1a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:30.919970 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6b4e3f-347d-4658-bd80-6fd847f4e0c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6492a9e77b2a43abb7ea398ccfba1f1a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:30.921903 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6b4e3f-347d-4658-bd80-6fd847f4e0c0 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:30.975156 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 976/1967] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:30 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:44:30.979053 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13426e0f-d4c6-4026-bec8-d13098f51ac0 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:30.980857 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-13426e0f-d4c6-4026-bec8-d13098f51ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:30.985209 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4a6b4e3f-347d-4658-bd80-6fd847f4e0c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6492a9e77b2a43abb7ea398ccfba1f1a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:30.986003 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4a6b4e3f-347d-4658-bd80-6fd847f4e0c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6492a9e77b2a43abb7ea398ccfba1f1a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:30.986656 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4a6b4e3f-347d-4658-bd80-6fd847f4e0c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6492a9e77b2a43abb7ea398ccfba1f1a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:30.994203 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4a6b4e3f-347d-4658-bd80-6fd847f4e0c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6492a9e77b2a43abb7ea398ccfba1f1a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:30.995180 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13426e0f-d4c6-4026-bec8-d13098f51ac0 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:31.004354 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0fe44c-5350-403f-bab3-9f0add7dadb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:31.005116 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4a6b4e3f-347d-4658-bd80-6fd847f4e0c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6492a9e77b2a43abb7ea398ccfba1f1a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:31.005617 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0fe44c-5350-403f-bab3-9f0add7dadb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:31.006035 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0fe44c-5350-403f-bab3-9f0add7dadb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:31.006483 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0fe44c-5350-403f-bab3-9f0add7dadb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:31.007319 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0fe44c-5350-403f-bab3-9f0add7dadb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:31.009712 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0fe44c-5350-403f-bab3-9f0add7dadb8 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:31.030055 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 992/1968] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:44:30 2022] DELETE /identity/v3/users/6492a9e77b2a43abb7ea398ccfba1f1a => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:31.053978 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 977/1969] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:44:30 2022] POST /identity/v3/projects => generated 399 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:31.054763 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b4e3f-347d-4658-bd80-6fd847f4e0c0 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:31.056553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4a6b4e3f-347d-4658-bd80-6fd847f4e0c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:31.141304 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b4e3f-347d-4658-bd80-6fd847f4e0c0 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:31.170113 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:31.237331 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08615f21-a9f3-4c0d-b495-9198925931dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:31.238447 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08615f21-a9f3-4c0d-b495-9198925931dc admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:31.238858 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08615f21-a9f3-4c0d-b495-9198925931dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:31.239198 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08615f21-a9f3-4c0d-b495-9198925931dc admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:31.240028 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08615f21-a9f3-4c0d-b495-9198925931dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:31.243341 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08615f21-a9f3-4c0d-b495-9198925931dc admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:31.281032 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 993/1970] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:44:31 2022] POST /identity/v3/users => generated 306 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:44:31.284642 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0fe44c-5350-403f-bab3-9f0add7dadb8 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:31.327079 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0fe44c-5350-403f-bab3-9f0add7dadb8 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:31.345065 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83dbb13-a128-4a48-838a-19e660ee1844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:31.345831 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dbb13-a128-4a48-838a-19e660ee1844 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:31.346209 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dbb13-a128-4a48-838a-19e660ee1844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:31.346518 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dbb13-a128-4a48-838a-19e660ee1844 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:31.347829 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83dbb13-a128-4a48-838a-19e660ee1844 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:31.349112 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83dbb13-a128-4a48-838a-19e660ee1844 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:31.391793 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08615f21-a9f3-4c0d-b495-9198925931dc admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:31.397796 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 978/1971] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:31.414173 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08615f21-a9f3-4c0d-b495-9198925931dc admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:31.436768 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77726b5-3fe5-4b1c-91af-294fb703de45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:31.437809 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77726b5-3fe5-4b1c-91af-294fb703de45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:31.438987 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77726b5-3fe5-4b1c-91af-294fb703de45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:31.440070 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77726b5-3fe5-4b1c-91af-294fb703de45 admin admin] PATH_INFO: `/v3/projects/dfeca6a7441f4e2d846ebc892c645d08/users/c494795eaf79462e97290492f9c1454a/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:31.440416 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83dbb13-a128-4a48-838a-19e660ee1844 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:31.443002 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f83dbb13-a128-4a48-838a-19e660ee1844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:31.484291 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77726b5-3fe5-4b1c-91af-294fb703de45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfeca6a7441f4e2d846ebc892c645d08, user_id=c494795eaf79462e97290492f9c1454a, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:31.487649 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77726b5-3fe5-4b1c-91af-294fb703de45 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:31.510229 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 994/1972] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:44:31 2022] PUT /identity/v3/projects/dfeca6a7441f4e2d846ebc892c645d08/users/c494795eaf79462e97290492f9c1454a/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:31.517882 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77726b5-3fe5-4b1c-91af-294fb703de45 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:31.584272 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83dbb13-a128-4a48-838a-19e660ee1844 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:31.594057 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:31.637606 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77726b5-3fe5-4b1c-91af-294fb703de45 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:31.646211 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c4e13-75a1-4f4c-b219-f21faad4764f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:31.647418 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c4e13-75a1-4f4c-b219-f21faad4764f admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:31.647989 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c4e13-75a1-4f4c-b219-f21faad4764f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:31.648465 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c4e13-75a1-4f4c-b219-f21faad4764f admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:31.649709 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5c4e13-75a1-4f4c-b219-f21faad4764f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:31.651732 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5c4e13-75a1-4f4c-b219-f21faad4764f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:31.687919 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 995/1973] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:31.690508 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c4e13-75a1-4f4c-b219-f21faad4764f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:31.694855 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2b5c4e13-75a1-4f4c-b219-f21faad4764f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:31.703915 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2db9a-c0ef-4449-862a-47f3629ffb65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:31.704977 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2db9a-c0ef-4449-862a-47f3629ffb65 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:31.705501 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2db9a-c0ef-4449-862a-47f3629ffb65 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:31.705978 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2db9a-c0ef-4449-862a-47f3629ffb65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:31.711328 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9bb2db9a-c0ef-4449-862a-47f3629ffb65 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:31.723886 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c4e13-75a1-4f4c-b219-f21faad4764f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:31.729304 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff7b87a-9a3d-4aaa-b8e3-a87e73787a60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:31.730030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7b87a-9a3d-4aaa-b8e3-a87e73787a60 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:31.730978 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7b87a-9a3d-4aaa-b8e3-a87e73787a60 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:31.731231 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff7b87a-9a3d-4aaa-b8e3-a87e73787a60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:31.735183 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6ff7b87a-9a3d-4aaa-b8e3-a87e73787a60 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:31.841903 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2db9a-c0ef-4449-862a-47f3629ffb65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:31.843792 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb2db9a-c0ef-4449-862a-47f3629ffb65 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:31.847897 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff7b87a-9a3d-4aaa-b8e3-a87e73787a60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:31.865236 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff7b87a-9a3d-4aaa-b8e3-a87e73787a60 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:31.873353 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 979/1974] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:31 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:44:31.875674 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2db9a-c0ef-4449-862a-47f3629ffb65 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:31.904662 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb2db9a-c0ef-4449-862a-47f3629ffb65 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:31.919602 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041cb99a-0830-4ca9-811b-ed575e11ca0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:31.920966 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041cb99a-0830-4ca9-811b-ed575e11ca0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:31.921431 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041cb99a-0830-4ca9-811b-ed575e11ca0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:31.922208 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041cb99a-0830-4ca9-811b-ed575e11ca0e admin admin] PATH_INFO: `/v3/projects/dfeca6a7441f4e2d846ebc892c645d08/users/c494795eaf79462e97290492f9c1454a/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:31.926307 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041cb99a-0830-4ca9-811b-ed575e11ca0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfeca6a7441f4e2d846ebc892c645d08, user_id=c494795eaf79462e97290492f9c1454a, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:31.933550 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041cb99a-0830-4ca9-811b-ed575e11ca0e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:31.936318 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 996/1975] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:44:31.964258 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 980/1976] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:44:31 2022] PUT /identity/v3/projects/dfeca6a7441f4e2d846ebc892c645d08/users/c494795eaf79462e97290492f9c1454a/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:31.976144 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df595a-05a1-48c2-88c7-4d3a22bdee82 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:31.976440 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df595a-05a1-48c2-88c7-4d3a22bdee82 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:31.976723 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df595a-05a1-48c2-88c7-4d3a22bdee82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:32.036377 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:32.042735 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-23df595a-05a1-48c2-88c7-4d3a22bdee82 None None] MFA Rules not processed for user `c494795eaf79462e97290492f9c1454a`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:32.044256 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-23df595a-05a1-48c2-88c7-4d3a22bdee82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:32.128811 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041cb99a-0830-4ca9-811b-ed575e11ca0e admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:32.131871 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-041cb99a-0830-4ca9-811b-ed575e11ca0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:32.255270 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 997/1977] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:31 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:32.257285 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df595a-05a1-48c2-88c7-4d3a22bdee82 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:32.379021 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041cb99a-0830-4ca9-811b-ed575e11ca0e admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:32.401247 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da503f-e22c-4062-adcc-f1a9fd027fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:32.402192 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da503f-e22c-4062-adcc-f1a9fd027fa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:32.402571 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da503f-e22c-4062-adcc-f1a9fd027fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:32.403335 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da503f-e22c-4062-adcc-f1a9fd027fa9 admin admin] PATH_INFO: `/v3/projects/964f54a58d4147908f4e50e48cc0418e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:32.405309 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16da503f-e22c-4062-adcc-f1a9fd027fa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=964f54a58d4147908f4e50e48cc0418e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:32.410064 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16da503f-e22c-4062-adcc-f1a9fd027fa9 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:32.433072 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df595a-05a1-48c2-88c7-4d3a22bdee82 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:32.445154 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759cc8bc-fb6c-4802-b736-3da33ebe793c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:32.445927 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cc8bc-fb6c-4802-b736-3da33ebe793c service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:32.446226 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cc8bc-fb6c-4802-b736-3da33ebe793c service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:32.446677 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759cc8bc-fb6c-4802-b736-3da33ebe793c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:32.482441 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759cc8bc-fb6c-4802-b736-3da33ebe793c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:32.484746 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759cc8bc-fb6c-4802-b736-3da33ebe793c service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:32.526796 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 998/1978] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:32 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:44:32.534448 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:32.536806 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-16da503f-e22c-4062-adcc-f1a9fd027fa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '964f54a58d4147908f4e50e48cc0418e', 'request_id': 'req-16da503f-e22c-4062-adcc-f1a9fd027fa9'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:32.553481 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-16da503f-e22c-4062-adcc-f1a9fd027fa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '964f54a58d4147908f4e50e48cc0418e', 'request_id': 'req-16da503f-e22c-4062-adcc-f1a9fd027fa9'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:32.578566 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-16da503f-e22c-4062-adcc-f1a9fd027fa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '964f54a58d4147908f4e50e48cc0418e', 'request_id': 'req-16da503f-e22c-4062-adcc-f1a9fd027fa9'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:32.603731 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-16da503f-e22c-4062-adcc-f1a9fd027fa9 admin admin] The token cache is being invalidate because project 964f54a58d4147908f4e50e48cc0418e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:44:32.605383 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-16da503f-e22c-4062-adcc-f1a9fd027fa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:32.606202 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-16da503f-e22c-4062-adcc-f1a9fd027fa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:32.612336 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 981/1979] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:44:32 2022] DELETE /identity/v3/projects/964f54a58d4147908f4e50e48cc0418e => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:44:32.614235 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcf8f0-a17d-438a-9dfb-9b5225899fe3 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:32.614754 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcf8f0-a17d-438a-9dfb-9b5225899fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:32.615302 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcf8f0-a17d-438a-9dfb-9b5225899fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:32.647991 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-5bfcf8f0-a17d-438a-9dfb-9b5225899fe3 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:32.649270 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5bfcf8f0-a17d-438a-9dfb-9b5225899fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:32.711124 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da503f-e22c-4062-adcc-f1a9fd027fa9 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:32.724761 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-16da503f-e22c-4062-adcc-f1a9fd027fa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:32.832503 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 999/1980] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:32.833716 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c8b2d-affc-44b8-9506-823904281725 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:32.834019 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c8b2d-affc-44b8-9506-823904281725 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:32.834306 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c8b2d-affc-44b8-9506-823904281725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:32.892582 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b35c8b2d-affc-44b8-9506-823904281725 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:32.896000 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b35c8b2d-affc-44b8-9506-823904281725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:32.902196 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da503f-e22c-4062-adcc-f1a9fd027fa9 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:32.912594 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b6ac4-2460-4be5-baf3-b92102f9d06e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:32.913281 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b6ac4-2460-4be5-baf3-b92102f9d06e service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:32.914660 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b6ac4-2460-4be5-baf3-b92102f9d06e service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:32.915765 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b6ac4-2460-4be5-baf3-b92102f9d06e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:32.918375 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1000/1981] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:32.924741 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c69b6ac4-2460-4be5-baf3-b92102f9d06e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:32.925925 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c8b2d-affc-44b8-9506-823904281725 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:32.949327 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c8b2d-affc-44b8-9506-823904281725 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:32.961795 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de1a2a-5789-44b5-8fde-5ae09e499f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:32.962510 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de1a2a-5789-44b5-8fde-5ae09e499f67 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:32.967542 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de1a2a-5789-44b5-8fde-5ae09e499f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:32.967879 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de1a2a-5789-44b5-8fde-5ae09e499f67 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:32.968671 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90de1a2a-5789-44b5-8fde-5ae09e499f67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:44:32.968991 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90de1a2a-5789-44b5-8fde-5ae09e499f67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:32.986003 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90de1a2a-5789-44b5-8fde-5ae09e499f67 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:33.009506 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1001/1982] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:44:33.014792 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de1a2a-5789-44b5-8fde-5ae09e499f67 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:33.046673 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de1a2a-5789-44b5-8fde-5ae09e499f67 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:33.068728 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c0451-1a1b-466b-bae1-af0b4641c5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:33.069348 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c0451-1a1b-466b-bae1-af0b4641c5d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:33.069636 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c0451-1a1b-466b-bae1-af0b4641c5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:33.069918 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c0451-1a1b-466b-bae1-af0b4641c5d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:33.070658 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9c0451-1a1b-466b-bae1-af0b4641c5d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:33.085104 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9c0451-1a1b-466b-bae1-af0b4641c5d9 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:33.090194 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b6ac4-2460-4be5-baf3-b92102f9d06e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:33.093415 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69b6ac4-2460-4be5-baf3-b92102f9d06e service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:33.108141 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 982/1983] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:32 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:44:33.175646 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:33.202474 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1002/1984] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:44:33 2022] POST /identity/v3/projects => generated 373 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:33.207980 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b6ac4-2460-4be5-baf3-b92102f9d06e service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:33.243469 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b6ac4-2460-4be5-baf3-b92102f9d06e service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:33.390579 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace10221-5d74-463b-b298-10b8f6282151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:33.391392 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace10221-5d74-463b-b298-10b8f6282151 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:33.391684 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace10221-5d74-463b-b298-10b8f6282151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:33.391959 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace10221-5d74-463b-b298-10b8f6282151 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:33.392653 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace10221-5d74-463b-b298-10b8f6282151 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:33.396987 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace10221-5d74-463b-b298-10b8f6282151 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:33.464946 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 983/1985] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:44:33 2022] POST /identity/v3/users => generated 287 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:33.469032 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c0451-1a1b-466b-bae1-af0b4641c5d9 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:33.497124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c0451-1a1b-466b-bae1-af0b4641c5d9 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:33.513065 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa5a92-e2e3-42c9-87cd-bf2a845c6a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:33.514168 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa5a92-e2e3-42c9-87cd-bf2a845c6a53 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:33.514622 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa5a92-e2e3-42c9-87cd-bf2a845c6a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:33.515384 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa5a92-e2e3-42c9-87cd-bf2a845c6a53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:33.516662 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa5a92-e2e3-42c9-87cd-bf2a845c6a53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:33.525048 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa5a92-e2e3-42c9-87cd-bf2a845c6a53 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:33.547001 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace10221-5d74-463b-b298-10b8f6282151 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:33.557549 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1003/1986] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:33.569377 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace10221-5d74-463b-b298-10b8f6282151 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:33.590004 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ac34e-c4c3-4248-a311-6859a4dd9371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:33.590805 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ac34e-c4c3-4248-a311-6859a4dd9371 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:33.591131 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ac34e-c4c3-4248-a311-6859a4dd9371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:33.591411 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ac34e-c4c3-4248-a311-6859a4dd9371 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:33.592237 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66ac34e-c4c3-4248-a311-6859a4dd9371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:33.594233 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66ac34e-c4c3-4248-a311-6859a4dd9371 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:33.622428 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 984/1987] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:33.624055 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa5a92-e2e3-42c9-87cd-bf2a845c6a53 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:33.635082 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa5a92-e2e3-42c9-87cd-bf2a845c6a53 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:33.662471 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3105723-c023-4142-a97b-686baf348768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:33.664597 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3105723-c023-4142-a97b-686baf348768 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:33.666390 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3105723-c023-4142-a97b-686baf348768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:33.670577 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3105723-c023-4142-a97b-686baf348768 admin admin] PATH_INFO: `/v3/projects/7e6c531af05e45bc8e642737213b85d3/users/f81945ac9dfb470096f4141327d8841e/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:33.749789 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3105723-c023-4142-a97b-686baf348768 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e6c531af05e45bc8e642737213b85d3, user_id=f81945ac9dfb470096f4141327d8841e, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:33.754013 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3105723-c023-4142-a97b-686baf348768 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:33.790020 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1004/1988] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:44:33 2022] PUT /identity/v3/projects/7e6c531af05e45bc8e642737213b85d3/users/f81945ac9dfb470096f4141327d8841e/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:33.802211 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded6d0c-0e1e-4deb-bde1-b3070dae9d07 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:33.805779 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded6d0c-0e1e-4deb-bde1-b3070dae9d07 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:33.806283 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded6d0c-0e1e-4deb-bde1-b3070dae9d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:33.848912 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:33.871237 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-4ded6d0c-0e1e-4deb-bde1-b3070dae9d07 None None] MFA Rules not processed for user `f81945ac9dfb470096f4141327d8841e`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:33.874119 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4ded6d0c-0e1e-4deb-bde1-b3070dae9d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:34.035544 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 985/1989] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:34.049815 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3105723-c023-4142-a97b-686baf348768 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:34.055526 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d3105723-c023-4142-a97b-686baf348768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:34.121874 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3105723-c023-4142-a97b-686baf348768 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:34.125683 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb8186e-b627-47e0-ae51-1aba784d7c13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:34.126418 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8186e-b627-47e0-ae51-1aba784d7c13 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:34.126807 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8186e-b627-47e0-ae51-1aba784d7c13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:34.127162 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8186e-b627-47e0-ae51-1aba784d7c13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:34.137165 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb8186e-b627-47e0-ae51-1aba784d7c13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:34.138892 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb8186e-b627-47e0-ae51-1aba784d7c13 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:34.149941 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1005/1990] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:44:34.172402 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded6d0c-0e1e-4deb-bde1-b3070dae9d07 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:34.244922 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded6d0c-0e1e-4deb-bde1-b3070dae9d07 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:34.249912 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343bbad-16c8-4867-93dd-4186c2105f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:34.250831 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343bbad-16c8-4867-93dd-4186c2105f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:34.251117 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343bbad-16c8-4867-93dd-4186c2105f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:34.251395 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343bbad-16c8-4867-93dd-4186c2105f81 admin admin] PATH_INFO: `/v3/users/f81945ac9dfb470096f4141327d8841e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:34.252608 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343bbad-16c8-4867-93dd-4186c2105f81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f81945ac9dfb470096f4141327d8841e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:34.255137 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343bbad-16c8-4867-93dd-4186c2105f81 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:34.306727 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9343bbad-16c8-4867-93dd-4186c2105f81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f81945ac9dfb470096f4141327d8841e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:34.307356 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9343bbad-16c8-4867-93dd-4186c2105f81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f81945ac9dfb470096f4141327d8841e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:34.307970 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9343bbad-16c8-4867-93dd-4186c2105f81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f81945ac9dfb470096f4141327d8841e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:34.316148 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9343bbad-16c8-4867-93dd-4186c2105f81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f81945ac9dfb470096f4141327d8841e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:34.324101 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9343bbad-16c8-4867-93dd-4186c2105f81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f81945ac9dfb470096f4141327d8841e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:34.343297 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 986/1991] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:44:34 2022] DELETE /identity/v3/users/f81945ac9dfb470096f4141327d8841e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:34.348018 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1f4df-aa90-431f-bb2d-9125f88fe0de None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:34.348307 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1f4df-aa90-431f-bb2d-9125f88fe0de None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:34.348645 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1f4df-aa90-431f-bb2d-9125f88fe0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:34.368045 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-45d1f4df-aa90-431f-bb2d-9125f88fe0de None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:34.369967 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-45d1f4df-aa90-431f-bb2d-9125f88fe0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:34.433501 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1006/1992] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:34.443763 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343bbad-16c8-4867-93dd-4186c2105f81 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:34.445244 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9343bbad-16c8-4867-93dd-4186c2105f81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:34.467239 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:34.513198 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343bbad-16c8-4867-93dd-4186c2105f81 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:34.517139 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3115417-ee3d-4fca-a9b2-dbb794104bb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:34.517826 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3115417-ee3d-4fca-a9b2-dbb794104bb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:34.518130 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3115417-ee3d-4fca-a9b2-dbb794104bb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:34.518414 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3115417-ee3d-4fca-a9b2-dbb794104bb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:34.527965 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3115417-ee3d-4fca-a9b2-dbb794104bb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:34.529390 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3115417-ee3d-4fca-a9b2-dbb794104bb2 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:34.539144 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 987/1993] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:44:34.816583 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1f4df-aa90-431f-bb2d-9125f88fe0de None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:34.818021 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-45d1f4df-aa90-431f-bb2d-9125f88fe0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:34.831961 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1f4df-aa90-431f-bb2d-9125f88fe0de None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:34.838249 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef244c-4346-4597-ad79-2a092b04b0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:34.840288 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef244c-4346-4597-ad79-2a092b04b0a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:34.840510 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef244c-4346-4597-ad79-2a092b04b0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:34.840793 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef244c-4346-4597-ad79-2a092b04b0a3 admin admin] PATH_INFO: `/v3/projects/7e6c531af05e45bc8e642737213b85d3` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:34.842245 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef244c-4346-4597-ad79-2a092b04b0a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e6c531af05e45bc8e642737213b85d3)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:34.844237 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef244c-4346-4597-ad79-2a092b04b0a3 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:34.900816 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3aef244c-4346-4597-ad79-2a092b04b0a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e6c531af05e45bc8e642737213b85d3', 'request_id': 'req-3aef244c-4346-4597-ad79-2a092b04b0a3'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:34.908707 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3aef244c-4346-4597-ad79-2a092b04b0a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e6c531af05e45bc8e642737213b85d3', 'request_id': 'req-3aef244c-4346-4597-ad79-2a092b04b0a3'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:34.918886 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3aef244c-4346-4597-ad79-2a092b04b0a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e6c531af05e45bc8e642737213b85d3', 'request_id': 'req-3aef244c-4346-4597-ad79-2a092b04b0a3'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:34.921424 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:34.934538 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3aef244c-4346-4597-ad79-2a092b04b0a3 admin admin] The token cache is being invalidate because project 7e6c531af05e45bc8e642737213b85d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:44:34.934843 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3aef244c-4346-4597-ad79-2a092b04b0a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:34.943431 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3aef244c-4346-4597-ad79-2a092b04b0a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:34.945077 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1007/1994] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:44:34 2022] DELETE /identity/v3/projects/7e6c531af05e45bc8e642737213b85d3 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:34.950023 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea048d-19d6-4bdd-9bc5-645e2151befa None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:34.950386 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea048d-19d6-4bdd-9bc5-645e2151befa None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:34.950778 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea048d-19d6-4bdd-9bc5-645e2151befa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:34.970182 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-87ea048d-19d6-4bdd-9bc5-645e2151befa None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:34.971553 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-87ea048d-19d6-4bdd-9bc5-645e2151befa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:35.037057 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 988/1995] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:44:35.045584 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9287b-f7f3-44be-bcbd-dce01062eb0b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:35.045845 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9287b-f7f3-44be-bcbd-dce01062eb0b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:35.046143 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9287b-f7f3-44be-bcbd-dce01062eb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:35.072010 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-99b9287b-f7f3-44be-bcbd-dce01062eb0b None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:35.074036 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-99b9287b-f7f3-44be-bcbd-dce01062eb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:35.087165 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1008/1996] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:35.092080 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea048d-19d6-4bdd-9bc5-645e2151befa None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:35.103931 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea048d-19d6-4bdd-9bc5-645e2151befa None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:35.109054 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aada17f-1c23-4319-bcfc-18742dae53f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:35.109795 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aada17f-1c23-4319-bcfc-18742dae53f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:35.110080 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aada17f-1c23-4319-bcfc-18742dae53f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:35.110359 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aada17f-1c23-4319-bcfc-18742dae53f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:35.111244 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aada17f-1c23-4319-bcfc-18742dae53f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:44:35.111558 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aada17f-1c23-4319-bcfc-18742dae53f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:35.113894 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aada17f-1c23-4319-bcfc-18742dae53f2 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:35.126505 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 989/1997] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:44:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:44:35.130571 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9287b-f7f3-44be-bcbd-dce01062eb0b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:35.140385 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9287b-f7f3-44be-bcbd-dce01062eb0b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:35.147641 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91514ac7-8dd7-4a64-81ca-87ccc477965b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:35.148441 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91514ac7-8dd7-4a64-81ca-87ccc477965b admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:35.148842 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91514ac7-8dd7-4a64-81ca-87ccc477965b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:35.149190 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91514ac7-8dd7-4a64-81ca-87ccc477965b admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:35.149968 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91514ac7-8dd7-4a64-81ca-87ccc477965b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:35.151933 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91514ac7-8dd7-4a64-81ca-87ccc477965b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:35.183251 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1009/1998] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:44:35 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:35.184701 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aada17f-1c23-4319-bcfc-18742dae53f2 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:35.195070 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aada17f-1c23-4319-bcfc-18742dae53f2 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:35.252433 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6341ce7-db32-4168-8732-d80c24748932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:35.253143 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6341ce7-db32-4168-8732-d80c24748932 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:35.253433 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6341ce7-db32-4168-8732-d80c24748932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:35.253742 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6341ce7-db32-4168-8732-d80c24748932 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:35.254445 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6341ce7-db32-4168-8732-d80c24748932 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:35.256395 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6341ce7-db32-4168-8732-d80c24748932 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:35.278065 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 990/1999] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:44:35 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:35.282218 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91514ac7-8dd7-4a64-81ca-87ccc477965b admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:35.293776 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91514ac7-8dd7-4a64-81ca-87ccc477965b admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:35.298890 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e2f18-2273-4aa9-a67b-76f7dcc026af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:35.299567 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e2f18-2273-4aa9-a67b-76f7dcc026af admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:35.299861 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e2f18-2273-4aa9-a67b-76f7dcc026af admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:35.300151 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e2f18-2273-4aa9-a67b-76f7dcc026af admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:35.300879 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e2f18-2273-4aa9-a67b-76f7dcc026af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:35.302731 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e2f18-2273-4aa9-a67b-76f7dcc026af admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:35.337135 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1010/2000] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 03:44:35.339006 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6341ce7-db32-4168-8732-d80c24748932 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:35.354431 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6341ce7-db32-4168-8732-d80c24748932 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:35.361702 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f4abf-777d-4b9e-8144-d64696ab3501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:35.362529 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f4abf-777d-4b9e-8144-d64696ab3501 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:35.362823 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f4abf-777d-4b9e-8144-d64696ab3501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:35.363180 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f4abf-777d-4b9e-8144-d64696ab3501 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:35.364006 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f4abf-777d-4b9e-8144-d64696ab3501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:35.365646 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f4abf-777d-4b9e-8144-d64696ab3501 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:35.382757 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 991/2001] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:35.385054 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e2f18-2273-4aa9-a67b-76f7dcc026af admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:35.400443 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e2f18-2273-4aa9-a67b-76f7dcc026af admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:35.408311 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c085cb3-7ec9-45ec-a8f0-191a0444e990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:35.409988 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c085cb3-7ec9-45ec-a8f0-191a0444e990 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:35.410166 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c085cb3-7ec9-45ec-a8f0-191a0444e990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:35.410979 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c085cb3-7ec9-45ec-a8f0-191a0444e990 admin admin] PATH_INFO: `/v3/projects/629233f926c94533a17964b3c56d9884/users/8b5054e541e14a228e8d52ae585b20a5/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:35.431688 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c085cb3-7ec9-45ec-a8f0-191a0444e990 admin admin] RBAC: Authorizing `identity:create_grant(project_id=629233f926c94533a17964b3c56d9884, user_id=8b5054e541e14a228e8d52ae585b20a5, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:35.435418 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c085cb3-7ec9-45ec-a8f0-191a0444e990 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:35.453135 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1011/2002] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:44:35 2022] PUT /identity/v3/projects/629233f926c94533a17964b3c56d9884/users/8b5054e541e14a228e8d52ae585b20a5/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:44:35.464141 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed21439-7a6f-4b2f-8b59-7ff59463bdfb None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:35.464651 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed21439-7a6f-4b2f-8b59-7ff59463bdfb None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:35.464738 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed21439-7a6f-4b2f-8b59-7ff59463bdfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:35.491643 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-5ed21439-7a6f-4b2f-8b59-7ff59463bdfb None None] MFA Rules not processed for user `8b5054e541e14a228e8d52ae585b20a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:35.492898 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5ed21439-7a6f-4b2f-8b59-7ff59463bdfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:35.509158 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:35.607847 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 992/2003] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:35.620638 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c085cb3-7ec9-45ec-a8f0-191a0444e990 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:35.623011 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4c085cb3-7ec9-45ec-a8f0-191a0444e990 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:35.723707 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c085cb3-7ec9-45ec-a8f0-191a0444e990 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:35.727981 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3421bc2a-3a3c-43bd-b454-4ba283cbbf80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:35.728689 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421bc2a-3a3c-43bd-b454-4ba283cbbf80 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:35.728981 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421bc2a-3a3c-43bd-b454-4ba283cbbf80 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:35.729270 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3421bc2a-3a3c-43bd-b454-4ba283cbbf80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:35.742781 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421bc2a-3a3c-43bd-b454-4ba283cbbf80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:35.744920 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3421bc2a-3a3c-43bd-b454-4ba283cbbf80 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:35.760290 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1012/2004] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:44:37.639352 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed21439-7a6f-4b2f-8b59-7ff59463bdfb None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:37.640952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5ed21439-7a6f-4b2f-8b59-7ff59463bdfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:37.738533 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed21439-7a6f-4b2f-8b59-7ff59463bdfb None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:37.743767 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862eb772-01e2-48d7-85d8-351aaec489eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:37.744649 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862eb772-01e2-48d7-85d8-351aaec489eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:37.745111 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862eb772-01e2-48d7-85d8-351aaec489eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:37.745369 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862eb772-01e2-48d7-85d8-351aaec489eb admin admin] PATH_INFO: `/v3/users/3f1e019858a94793a363f9d2f8717e44` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:37.746624 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862eb772-01e2-48d7-85d8-351aaec489eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f1e019858a94793a363f9d2f8717e44)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:37.749042 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862eb772-01e2-48d7-85d8-351aaec489eb admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:37.798880 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-862eb772-01e2-48d7-85d8-351aaec489eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f1e019858a94793a363f9d2f8717e44'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:37.799437 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-862eb772-01e2-48d7-85d8-351aaec489eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f1e019858a94793a363f9d2f8717e44'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:37.800065 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-862eb772-01e2-48d7-85d8-351aaec489eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f1e019858a94793a363f9d2f8717e44'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:37.807491 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-862eb772-01e2-48d7-85d8-351aaec489eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f1e019858a94793a363f9d2f8717e44'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:37.817696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-862eb772-01e2-48d7-85d8-351aaec489eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f1e019858a94793a363f9d2f8717e44'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:37.839431 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 993/2005] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:44:37 2022] DELETE /identity/v3/users/3f1e019858a94793a363f9d2f8717e44 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:37.844093 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a997e0-5027-4abd-8bb4-f8b2078e6952 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:37.844568 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a997e0-5027-4abd-8bb4-f8b2078e6952 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:37.844657 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a997e0-5027-4abd-8bb4-f8b2078e6952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:37.861597 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-35a997e0-5027-4abd-8bb4-f8b2078e6952 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:37.862900 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-35a997e0-5027-4abd-8bb4-f8b2078e6952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:37.924703 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1013/2006] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:37.935299 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862eb772-01e2-48d7-85d8-351aaec489eb admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:37.936765 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-862eb772-01e2-48d7-85d8-351aaec489eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:37.980600 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:37.999729 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862eb772-01e2-48d7-85d8-351aaec489eb admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:38.003908 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a62241-a791-4a70-916e-2868d36b05a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:38.004554 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a62241-a791-4a70-916e-2868d36b05a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:38.004835 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a62241-a791-4a70-916e-2868d36b05a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:38.005110 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a62241-a791-4a70-916e-2868d36b05a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:38.016267 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a62241-a791-4a70-916e-2868d36b05a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:38.018118 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a62241-a791-4a70-916e-2868d36b05a7 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:38.028733 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 994/2007] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:44:38.484596 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a997e0-5027-4abd-8bb4-f8b2078e6952 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:38.486005 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-35a997e0-5027-4abd-8bb4-f8b2078e6952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:38.495010 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a62241-a791-4a70-916e-2868d36b05a7 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:38.496774 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-21a62241-a791-4a70-916e-2868d36b05a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:38.498295 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a997e0-5027-4abd-8bb4-f8b2078e6952 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:38.506047 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950218ca-c23f-4b70-86c8-4137a06326c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:38.506926 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950218ca-c23f-4b70-86c8-4137a06326c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:38.507129 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950218ca-c23f-4b70-86c8-4137a06326c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:38.507407 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950218ca-c23f-4b70-86c8-4137a06326c1 admin admin] PATH_INFO: `/v3/users/1ea3dd02344c4bc094b0d93884205aab` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:38.508607 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950218ca-c23f-4b70-86c8-4137a06326c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ea3dd02344c4bc094b0d93884205aab)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:38.511499 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950218ca-c23f-4b70-86c8-4137a06326c1 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:38.515165 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a62241-a791-4a70-916e-2868d36b05a7 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:38.521817 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c951499-3e53-49b7-9b04-5d3b81b73270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:38.522879 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c951499-3e53-49b7-9b04-5d3b81b73270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:38.523673 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c951499-3e53-49b7-9b04-5d3b81b73270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:38.524010 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c951499-3e53-49b7-9b04-5d3b81b73270 admin admin] PATH_INFO: `/v3/projects/f0bf721ef905433690003b0cc2fcbb4c` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:38.525519 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c951499-3e53-49b7-9b04-5d3b81b73270 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0bf721ef905433690003b0cc2fcbb4c)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:38.527816 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c951499-3e53-49b7-9b04-5d3b81b73270 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:38.541413 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:38.565058 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-950218ca-c23f-4b70-86c8-4137a06326c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ea3dd02344c4bc094b0d93884205aab'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:38.565754 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-950218ca-c23f-4b70-86c8-4137a06326c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ea3dd02344c4bc094b0d93884205aab'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:38.566583 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-950218ca-c23f-4b70-86c8-4137a06326c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ea3dd02344c4bc094b0d93884205aab'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:38.574507 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-950218ca-c23f-4b70-86c8-4137a06326c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ea3dd02344c4bc094b0d93884205aab'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:38.586022 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-950218ca-c23f-4b70-86c8-4137a06326c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ea3dd02344c4bc094b0d93884205aab'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:38.586130 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6c951499-3e53-49b7-9b04-5d3b81b73270 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0bf721ef905433690003b0cc2fcbb4c', 'request_id': 'req-6c951499-3e53-49b7-9b04-5d3b81b73270'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:38.592294 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6c951499-3e53-49b7-9b04-5d3b81b73270 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0bf721ef905433690003b0cc2fcbb4c', 'request_id': 'req-6c951499-3e53-49b7-9b04-5d3b81b73270'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:38.602674 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6c951499-3e53-49b7-9b04-5d3b81b73270 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0bf721ef905433690003b0cc2fcbb4c', 'request_id': 'req-6c951499-3e53-49b7-9b04-5d3b81b73270'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:38.607998 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1014/2008] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:44:38 2022] DELETE /identity/v3/users/1ea3dd02344c4bc094b0d93884205aab => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:38.612399 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd17d3-9ef6-4fbb-8deb-b22f978e66df None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:38.613195 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd17d3-9ef6-4fbb-8deb-b22f978e66df None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:38.613525 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd17d3-9ef6-4fbb-8deb-b22f978e66df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:38.619397 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6c951499-3e53-49b7-9b04-5d3b81b73270 admin admin] The token cache is being invalidate because project f0bf721ef905433690003b0cc2fcbb4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:44:38.619800 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6c951499-3e53-49b7-9b04-5d3b81b73270 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:38.621028 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6c951499-3e53-49b7-9b04-5d3b81b73270 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:38.623131 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 995/2009] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:44:38 2022] DELETE /identity/v3/projects/f0bf721ef905433690003b0cc2fcbb4c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:44:38.627386 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c951499-3e53-49b7-9b04-5d3b81b73270 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:38.629069 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6c951499-3e53-49b7-9b04-5d3b81b73270 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:38.636709 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d5bd17d3-9ef6-4fbb-8deb-b22f978e66df None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:38.638007 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d5bd17d3-9ef6-4fbb-8deb-b22f978e66df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:38.717047 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c951499-3e53-49b7-9b04-5d3b81b73270 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:38.731653 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1015/2010] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:38.742106 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd17d3-9ef6-4fbb-8deb-b22f978e66df None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:38.743758 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d5bd17d3-9ef6-4fbb-8deb-b22f978e66df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:38.791316 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b72451c-1402-4816-bcb6-42cb66ec0703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:38.792218 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72451c-1402-4816-bcb6-42cb66ec0703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:38.792514 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72451c-1402-4816-bcb6-42cb66ec0703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:38.792985 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b72451c-1402-4816-bcb6-42cb66ec0703 admin admin] PATH_INFO: `/v3/users/9ca644bbe7894fc09de244891b885d14` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:38.794589 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b72451c-1402-4816-bcb6-42cb66ec0703 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ca644bbe7894fc09de244891b885d14)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:38.796217 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b72451c-1402-4816-bcb6-42cb66ec0703 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:38.807993 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:38.829228 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd17d3-9ef6-4fbb-8deb-b22f978e66df None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:38.833656 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d7874-c6d7-4370-b237-83992462fc78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:38.834337 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d7874-c6d7-4370-b237-83992462fc78 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:38.834776 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d7874-c6d7-4370-b237-83992462fc78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:38.835056 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d7874-c6d7-4370-b237-83992462fc78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:38.845401 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d7874-c6d7-4370-b237-83992462fc78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:38.847670 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d7874-c6d7-4370-b237-83992462fc78 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:38.851028 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2b72451c-1402-4816-bcb6-42cb66ec0703 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ca644bbe7894fc09de244891b885d14'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:38.852105 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2b72451c-1402-4816-bcb6-42cb66ec0703 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ca644bbe7894fc09de244891b885d14'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:38.852972 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2b72451c-1402-4816-bcb6-42cb66ec0703 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ca644bbe7894fc09de244891b885d14'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:38.858965 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1016/2011] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 03:44:38.859719 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d7874-c6d7-4370-b237-83992462fc78 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:38.861015 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-789d7874-c6d7-4370-b237-83992462fc78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:38.863101 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2b72451c-1402-4816-bcb6-42cb66ec0703 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ca644bbe7894fc09de244891b885d14'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:38.873232 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2b72451c-1402-4816-bcb6-42cb66ec0703 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ca644bbe7894fc09de244891b885d14'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:38.876411 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d7874-c6d7-4370-b237-83992462fc78 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:38.882446 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f782569-e622-47a1-8844-48bf1003a4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:38.883523 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f782569-e622-47a1-8844-48bf1003a4fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:38.883818 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f782569-e622-47a1-8844-48bf1003a4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:38.884099 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f782569-e622-47a1-8844-48bf1003a4fc admin admin] PATH_INFO: `/v3/users/52edf23b28ee4121bd6484f7f765446f` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:38.886714 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f782569-e622-47a1-8844-48bf1003a4fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=52edf23b28ee4121bd6484f7f765446f)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:38.888893 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f782569-e622-47a1-8844-48bf1003a4fc admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:38.898700 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 996/2012] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:44:38 2022] DELETE /identity/v3/users/9ca644bbe7894fc09de244891b885d14 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:44:38.941744 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:38.948135 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-1f782569-e622-47a1-8844-48bf1003a4fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52edf23b28ee4121bd6484f7f765446f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:38.948993 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-1f782569-e622-47a1-8844-48bf1003a4fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52edf23b28ee4121bd6484f7f765446f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:38.949682 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-1f782569-e622-47a1-8844-48bf1003a4fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52edf23b28ee4121bd6484f7f765446f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:38.960078 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-1f782569-e622-47a1-8844-48bf1003a4fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52edf23b28ee4121bd6484f7f765446f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:38.968798 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-1f782569-e622-47a1-8844-48bf1003a4fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52edf23b28ee4121bd6484f7f765446f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:38.993355 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1017/2013] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:44:38 2022] DELETE /identity/v3/users/52edf23b28ee4121bd6484f7f765446f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:38.997712 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a756c5-c810-402c-bd5e-ec315379d782 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:38.997968 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a756c5-c810-402c-bd5e-ec315379d782 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:38.998228 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a756c5-c810-402c-bd5e-ec315379d782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:39.019956 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c7a756c5-c810-402c-bd5e-ec315379d782 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:39.021249 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c7a756c5-c810-402c-bd5e-ec315379d782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:39.085160 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 997/2014] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:39.095604 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f782569-e622-47a1-8844-48bf1003a4fc admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:39.098850 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1f782569-e622-47a1-8844-48bf1003a4fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:39.181983 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f782569-e622-47a1-8844-48bf1003a4fc admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:39.186839 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41815cc-a1c2-4f2f-b776-cdcf53698bd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:39.187983 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41815cc-a1c2-4f2f-b776-cdcf53698bd0 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:39.188609 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41815cc-a1c2-4f2f-b776-cdcf53698bd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:39.189164 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41815cc-a1c2-4f2f-b776-cdcf53698bd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:39.217777 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41815cc-a1c2-4f2f-b776-cdcf53698bd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:39.220159 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41815cc-a1c2-4f2f-b776-cdcf53698bd0 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:39.233407 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1018/2015] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:44:39.412636 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a756c5-c810-402c-bd5e-ec315379d782 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:39.414917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c7a756c5-c810-402c-bd5e-ec315379d782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:39.430077 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a756c5-c810-402c-bd5e-ec315379d782 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:39.436364 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c52175-6b7e-40ce-a587-1cdac575690d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:39.437651 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c52175-6b7e-40ce-a587-1cdac575690d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:39.438047 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c52175-6b7e-40ce-a587-1cdac575690d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:39.438435 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c52175-6b7e-40ce-a587-1cdac575690d admin admin] PATH_INFO: `/v3/projects/b9de162749904bbcbcb2acfbdc503331` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:39.441560 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c52175-6b7e-40ce-a587-1cdac575690d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9de162749904bbcbcb2acfbdc503331)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:39.444271 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c52175-6b7e-40ce-a587-1cdac575690d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:39.551411 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-52c52175-6b7e-40ce-a587-1cdac575690d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9de162749904bbcbcb2acfbdc503331', 'request_id': 'req-52c52175-6b7e-40ce-a587-1cdac575690d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:39.556488 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-52c52175-6b7e-40ce-a587-1cdac575690d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9de162749904bbcbcb2acfbdc503331', 'request_id': 'req-52c52175-6b7e-40ce-a587-1cdac575690d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:39.571477 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-52c52175-6b7e-40ce-a587-1cdac575690d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9de162749904bbcbcb2acfbdc503331', 'request_id': 'req-52c52175-6b7e-40ce-a587-1cdac575690d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:39.595641 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-52c52175-6b7e-40ce-a587-1cdac575690d admin admin] The token cache is being invalidate because project b9de162749904bbcbcb2acfbdc503331 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:44:39.595944 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-52c52175-6b7e-40ce-a587-1cdac575690d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:39.596852 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-52c52175-6b7e-40ce-a587-1cdac575690d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:39.598830 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 998/2016] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:44:39 2022] DELETE /identity/v3/projects/b9de162749904bbcbcb2acfbdc503331 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:39.602995 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41815cc-a1c2-4f2f-b776-cdcf53698bd0 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:39.614926 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41815cc-a1c2-4f2f-b776-cdcf53698bd0 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:39.618126 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c52175-6b7e-40ce-a587-1cdac575690d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:39.619834 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-52c52175-6b7e-40ce-a587-1cdac575690d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:39.640968 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:39.748838 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988aa624-7fb0-498e-9ba2-4a5fe49e01cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:39.750339 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988aa624-7fb0-498e-9ba2-4a5fe49e01cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:39.750908 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988aa624-7fb0-498e-9ba2-4a5fe49e01cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:39.751580 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988aa624-7fb0-498e-9ba2-4a5fe49e01cb admin admin] PATH_INFO: `/v3/users/2eb9364940e74cab89abd981c1ef9f05` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:39.752625 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988aa624-7fb0-498e-9ba2-4a5fe49e01cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eb9364940e74cab89abd981c1ef9f05)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:39.755299 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988aa624-7fb0-498e-9ba2-4a5fe49e01cb admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:39.759720 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c52175-6b7e-40ce-a587-1cdac575690d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:39.768685 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babf2b3-4687-4cb8-9819-bec13f0b3419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:39.769573 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babf2b3-4687-4cb8-9819-bec13f0b3419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:39.769865 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babf2b3-4687-4cb8-9819-bec13f0b3419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:39.770278 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babf2b3-4687-4cb8-9819-bec13f0b3419 admin admin] PATH_INFO: `/v3/projects/17a19a60db1842eebc9003094a5932f6` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:39.771544 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6babf2b3-4687-4cb8-9819-bec13f0b3419 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17a19a60db1842eebc9003094a5932f6)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:39.773484 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6babf2b3-4687-4cb8-9819-bec13f0b3419 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:39.812450 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-988aa624-7fb0-498e-9ba2-4a5fe49e01cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eb9364940e74cab89abd981c1ef9f05'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:39.813327 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-988aa624-7fb0-498e-9ba2-4a5fe49e01cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eb9364940e74cab89abd981c1ef9f05'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:39.814056 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-988aa624-7fb0-498e-9ba2-4a5fe49e01cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eb9364940e74cab89abd981c1ef9f05'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:39.823777 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-988aa624-7fb0-498e-9ba2-4a5fe49e01cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eb9364940e74cab89abd981c1ef9f05'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:39.832294 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6babf2b3-4687-4cb8-9819-bec13f0b3419 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17a19a60db1842eebc9003094a5932f6', 'request_id': 'req-6babf2b3-4687-4cb8-9819-bec13f0b3419'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:39.835569 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-988aa624-7fb0-498e-9ba2-4a5fe49e01cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eb9364940e74cab89abd981c1ef9f05'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:39.837283 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:39.843144 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6babf2b3-4687-4cb8-9819-bec13f0b3419 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17a19a60db1842eebc9003094a5932f6', 'request_id': 'req-6babf2b3-4687-4cb8-9819-bec13f0b3419'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:39.856448 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6babf2b3-4687-4cb8-9819-bec13f0b3419 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17a19a60db1842eebc9003094a5932f6', 'request_id': 'req-6babf2b3-4687-4cb8-9819-bec13f0b3419'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:39.871026 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6babf2b3-4687-4cb8-9819-bec13f0b3419 admin admin] The token cache is being invalidate because project 17a19a60db1842eebc9003094a5932f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:44:39.871328 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6babf2b3-4687-4cb8-9819-bec13f0b3419 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:39.872005 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6babf2b3-4687-4cb8-9819-bec13f0b3419 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:39.874052 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 999/2017] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:44:39 2022] DELETE /identity/v3/projects/17a19a60db1842eebc9003094a5932f6 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:39.879004 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babf2b3-4687-4cb8-9819-bec13f0b3419 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:39.879004 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6babf2b3-4687-4cb8-9819-bec13f0b3419 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:39.879964 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1019/2018] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:44:39 2022] DELETE /identity/v3/users/2eb9364940e74cab89abd981c1ef9f05 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:39.881818 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7efe0-cc36-49af-929b-557b826d9ee9 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:39.882245 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7efe0-cc36-49af-929b-557b826d9ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:39.882702 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7efe0-cc36-49af-929b-557b826d9ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:39.902373 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-22d7efe0-cc36-49af-929b-557b826d9ee9 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:39.903552 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-22d7efe0-cc36-49af-929b-557b826d9ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:39.950297 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babf2b3-4687-4cb8-9819-bec13f0b3419 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:39.985767 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1020/2019] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:39.995246 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7963864-9b2f-4ac1-9d88-fe2883739ea7 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:39.995545 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7963864-9b2f-4ac1-9d88-fe2883739ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:39.995826 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7963864-9b2f-4ac1-9d88-fe2883739ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:40.000773 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:40.016532 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f7963864-9b2f-4ac1-9d88-fe2883739ea7 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:40.017543 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f7963864-9b2f-4ac1-9d88-fe2883739ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:40.019574 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b042d46d-e8da-4768-a3ae-b2e9225f4c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:40.020776 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042d46d-e8da-4768-a3ae-b2e9225f4c96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:40.021067 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042d46d-e8da-4768-a3ae-b2e9225f4c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:40.021775 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b042d46d-e8da-4768-a3ae-b2e9225f4c96 admin admin] PATH_INFO: `/v3/projects/899397be9a0f49c492e9a41b9391036c` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:40.023767 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b042d46d-e8da-4768-a3ae-b2e9225f4c96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=899397be9a0f49c492e9a41b9391036c)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:40.029537 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b042d46d-e8da-4768-a3ae-b2e9225f4c96 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:40.029717 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1021/2020] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:40.030671 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7963864-9b2f-4ac1-9d88-fe2883739ea7 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:40.043616 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7963864-9b2f-4ac1-9d88-fe2883739ea7 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:40.054156 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17a7d9-f524-4955-a261-da81f605a77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:40.055097 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17a7d9-f524-4955-a261-da81f605a77a admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:40.055599 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17a7d9-f524-4955-a261-da81f605a77a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:40.055961 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f17a7d9-f524-4955-a261-da81f605a77a admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:40.056816 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f17a7d9-f524-4955-a261-da81f605a77a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:44:40.057210 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f17a7d9-f524-4955-a261-da81f605a77a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:40.068636 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f17a7d9-f524-4955-a261-da81f605a77a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:40.087726 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1022/2021] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:44:40.091957 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17a7d9-f524-4955-a261-da81f605a77a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:40.101804 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b042d46d-e8da-4768-a3ae-b2e9225f4c96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '899397be9a0f49c492e9a41b9391036c', 'request_id': 'req-b042d46d-e8da-4768-a3ae-b2e9225f4c96'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:40.103933 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f17a7d9-f524-4955-a261-da81f605a77a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:40.107720 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b042d46d-e8da-4768-a3ae-b2e9225f4c96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '899397be9a0f49c492e9a41b9391036c', 'request_id': 'req-b042d46d-e8da-4768-a3ae-b2e9225f4c96'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:40.120436 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b042d46d-e8da-4768-a3ae-b2e9225f4c96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '899397be9a0f49c492e9a41b9391036c', 'request_id': 'req-b042d46d-e8da-4768-a3ae-b2e9225f4c96'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:40.135856 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b042d46d-e8da-4768-a3ae-b2e9225f4c96 admin admin] The token cache is being invalidate because project 899397be9a0f49c492e9a41b9391036c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:44:40.136340 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b042d46d-e8da-4768-a3ae-b2e9225f4c96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:40.137229 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b042d46d-e8da-4768-a3ae-b2e9225f4c96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:40.141916 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1000/2022] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:44:39 2022] DELETE /identity/v3/projects/899397be9a0f49c492e9a41b9391036c => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:40.144522 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b042d46d-e8da-4768-a3ae-b2e9225f4c96 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:40.146650 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b042d46d-e8da-4768-a3ae-b2e9225f4c96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:40.182918 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a49f8f-04b4-4c5b-b6a8-d77639357154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:40.183756 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a49f8f-04b4-4c5b-b6a8-d77639357154 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:40.184179 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a49f8f-04b4-4c5b-b6a8-d77639357154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:40.184743 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a49f8f-04b4-4c5b-b6a8-d77639357154 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:40.185690 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a49f8f-04b4-4c5b-b6a8-d77639357154 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:40.188494 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a49f8f-04b4-4c5b-b6a8-d77639357154 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:40.246563 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1023/2023] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:44:40 2022] POST /identity/v3/projects => generated 377 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:44:40.247895 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a49f8f-04b4-4c5b-b6a8-d77639357154 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:40.252064 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-76a49f8f-04b4-4c5b-b6a8-d77639357154 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:40.285252 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b042d46d-e8da-4768-a3ae-b2e9225f4c96 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:40.345682 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:40.363285 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88391843-efa8-4840-bb13-3d0dbce11ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:40.364079 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88391843-efa8-4840-bb13-3d0dbce11ceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:40.364455 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88391843-efa8-4840-bb13-3d0dbce11ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:40.364737 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88391843-efa8-4840-bb13-3d0dbce11ceb admin admin] PATH_INFO: `/v3/users/c494795eaf79462e97290492f9c1454a` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:40.365966 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88391843-efa8-4840-bb13-3d0dbce11ceb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c494795eaf79462e97290492f9c1454a)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:40.368024 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88391843-efa8-4840-bb13-3d0dbce11ceb admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:40.368687 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a49f8f-04b4-4c5b-b6a8-d77639357154 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:40.379710 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b185cc-4144-4995-a364-2b5e831a4cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:40.380499 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b185cc-4144-4995-a364-2b5e831a4cec admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:40.381165 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b185cc-4144-4995-a364-2b5e831a4cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:40.381165 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b185cc-4144-4995-a364-2b5e831a4cec admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:40.382089 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b185cc-4144-4995-a364-2b5e831a4cec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:40.384340 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b185cc-4144-4995-a364-2b5e831a4cec admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:40.401757 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:40.411976 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1024/2024] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:44:40 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:40.411976 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b185cc-4144-4995-a364-2b5e831a4cec admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:40.413970 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-46b185cc-4144-4995-a364-2b5e831a4cec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:40.427694 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b185cc-4144-4995-a364-2b5e831a4cec admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:40.428851 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-88391843-efa8-4840-bb13-3d0dbce11ceb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c494795eaf79462e97290492f9c1454a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:40.429530 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-88391843-efa8-4840-bb13-3d0dbce11ceb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c494795eaf79462e97290492f9c1454a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:40.430171 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-88391843-efa8-4840-bb13-3d0dbce11ceb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c494795eaf79462e97290492f9c1454a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:40.432316 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d81721-2586-4b05-be44-dfa781deac51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:40.433209 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d81721-2586-4b05-be44-dfa781deac51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:40.433467 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d81721-2586-4b05-be44-dfa781deac51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:40.433748 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d81721-2586-4b05-be44-dfa781deac51 admin admin] PATH_INFO: `/v3/projects/898615ff19fc4702a83adf476625a393` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:40.434970 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d81721-2586-4b05-be44-dfa781deac51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=898615ff19fc4702a83adf476625a393)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:40.437017 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d81721-2586-4b05-be44-dfa781deac51 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:40.437202 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-88391843-efa8-4840-bb13-3d0dbce11ceb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c494795eaf79462e97290492f9c1454a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:40.445261 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-88391843-efa8-4840-bb13-3d0dbce11ceb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c494795eaf79462e97290492f9c1454a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:40.463522 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1001/2025] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:44:40 2022] DELETE /identity/v3/users/c494795eaf79462e97290492f9c1454a => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:40.464453 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88391843-efa8-4840-bb13-3d0dbce11ceb admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:40.465879 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-88391843-efa8-4840-bb13-3d0dbce11ceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:40.496033 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-27d81721-2586-4b05-be44-dfa781deac51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '898615ff19fc4702a83adf476625a393', 'request_id': 'req-27d81721-2586-4b05-be44-dfa781deac51'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:40.507655 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-27d81721-2586-4b05-be44-dfa781deac51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '898615ff19fc4702a83adf476625a393', 'request_id': 'req-27d81721-2586-4b05-be44-dfa781deac51'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:40.516878 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-27d81721-2586-4b05-be44-dfa781deac51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '898615ff19fc4702a83adf476625a393', 'request_id': 'req-27d81721-2586-4b05-be44-dfa781deac51'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:40.530739 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-27d81721-2586-4b05-be44-dfa781deac51 admin admin] The token cache is being invalidate because project 898615ff19fc4702a83adf476625a393 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:44:40.532042 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-27d81721-2586-4b05-be44-dfa781deac51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:40.532708 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-27d81721-2586-4b05-be44-dfa781deac51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:40.538545 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1025/2026] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:44:40 2022] DELETE /identity/v3/projects/898615ff19fc4702a83adf476625a393 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:40.540206 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94defe6e-eb46-4d6f-b145-3283521c6d9d None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:40.540494 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94defe6e-eb46-4d6f-b145-3283521c6d9d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:40.540767 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94defe6e-eb46-4d6f-b145-3283521c6d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:40.548762 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88391843-efa8-4840-bb13-3d0dbce11ceb admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:40.563471 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-94defe6e-eb46-4d6f-b145-3283521c6d9d None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:40.564721 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-94defe6e-eb46-4d6f-b145-3283521c6d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:40.624657 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41797924-ebbd-423a-8eba-cc0a1d2f50e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:40.625158 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41797924-ebbd-423a-8eba-cc0a1d2f50e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:40.625470 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41797924-ebbd-423a-8eba-cc0a1d2f50e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:40.625732 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41797924-ebbd-423a-8eba-cc0a1d2f50e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:40.626483 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41797924-ebbd-423a-8eba-cc0a1d2f50e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:40.629312 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41797924-ebbd-423a-8eba-cc0a1d2f50e6 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:40.640716 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1026/2027] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:40.645380 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1002/2028] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:40 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:40.651783 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41797924-ebbd-423a-8eba-cc0a1d2f50e6 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:40.652563 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05d20b-859b-49d6-844a-80d3ca9cd2b9 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:40.653947 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05d20b-859b-49d6-844a-80d3ca9cd2b9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:40.653947 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05d20b-859b-49d6-844a-80d3ca9cd2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:40.656789 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-41797924-ebbd-423a-8eba-cc0a1d2f50e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:40.673185 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41797924-ebbd-423a-8eba-cc0a1d2f50e6 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:40.674521 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-0b05d20b-859b-49d6-844a-80d3ca9cd2b9 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:40.676460 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0b05d20b-859b-49d6-844a-80d3ca9cd2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:40.679202 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415586e-6689-44e8-8030-3d1da0a72663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:40.679893 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415586e-6689-44e8-8030-3d1da0a72663 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:40.680188 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415586e-6689-44e8-8030-3d1da0a72663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:40.680493 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415586e-6689-44e8-8030-3d1da0a72663 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:40.681239 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415586e-6689-44e8-8030-3d1da0a72663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:40.682910 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415586e-6689-44e8-8030-3d1da0a72663 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:40.691185 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1027/2029] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:40.692256 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05d20b-859b-49d6-844a-80d3ca9cd2b9 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:40.694956 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1003/2030] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:40.701302 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415586e-6689-44e8-8030-3d1da0a72663 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:40.707139 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05d20b-859b-49d6-844a-80d3ca9cd2b9 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:40.712148 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415586e-6689-44e8-8030-3d1da0a72663 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:40.714974 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b41f6-7895-4578-860b-f81f6a072e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:40.717837 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b41f6-7895-4578-860b-f81f6a072e67 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:40.717929 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b41f6-7895-4578-860b-f81f6a072e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:40.718176 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b41f6-7895-4578-860b-f81f6a072e67 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:40.718833 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee06796-0fad-4e1f-b9f1-06e23069016c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:40.719023 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b41f6-7895-4578-860b-f81f6a072e67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:44:40.719344 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b41f6-7895-4578-860b-f81f6a072e67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:40.720041 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee06796-0fad-4e1f-b9f1-06e23069016c admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:40.720422 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee06796-0fad-4e1f-b9f1-06e23069016c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:40.720916 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee06796-0fad-4e1f-b9f1-06e23069016c admin admin] PATH_INFO: `/v3/projects/bdccfdf4facf48d681ff4337fbd6efe1/users/b296088d71fb4dae8b66eb644718367d/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:40.721497 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b41f6-7895-4578-860b-f81f6a072e67 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:40.738773 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1028/2031] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:44:40.743213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b41f6-7895-4578-860b-f81f6a072e67 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:40.745865 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee06796-0fad-4e1f-b9f1-06e23069016c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdccfdf4facf48d681ff4337fbd6efe1, user_id=b296088d71fb4dae8b66eb644718367d, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:40.749050 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee06796-0fad-4e1f-b9f1-06e23069016c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:40.770060 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b41f6-7895-4578-860b-f81f6a072e67 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:40.783980 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1004/2032] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:44:40 2022] PUT /identity/v3/projects/bdccfdf4facf48d681ff4337fbd6efe1/users/b296088d71fb4dae8b66eb644718367d/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:40.786434 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d3776-1d05-4f3c-b877-a5bd932cf358 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:40.786781 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d3776-1d05-4f3c-b877-a5bd932cf358 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:40.787066 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d3776-1d05-4f3c-b877-a5bd932cf358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:40.827114 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:40.831000 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-008d3776-1d05-4f3c-b877-a5bd932cf358 None None] MFA Rules not processed for user `b296088d71fb4dae8b66eb644718367d`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:40.833281 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-008d3776-1d05-4f3c-b877-a5bd932cf358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:40.843939 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:40.868069 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd8f48-7287-4169-b6b6-0386723c27c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:40.868935 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd8f48-7287-4169-b6b6-0386723c27c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:40.869344 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd8f48-7287-4169-b6b6-0386723c27c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:40.869829 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd8f48-7287-4169-b6b6-0386723c27c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:40.870977 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd8f48-7287-4169-b6b6-0386723c27c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:40.873629 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd8f48-7287-4169-b6b6-0386723c27c8 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:40.925750 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1029/2033] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:44:40 2022] POST /identity/v3/projects => generated 405 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:44:40.925750 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd8f48-7287-4169-b6b6-0386723c27c8 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:40.925750 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0fcd8f48-7287-4169-b6b6-0386723c27c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:40.928541 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1005/2034] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:40.929625 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d3776-1d05-4f3c-b877-a5bd932cf358 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:40.944460 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008d3776-1d05-4f3c-b877-a5bd932cf358 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:41.001820 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd8f48-7287-4169-b6b6-0386723c27c8 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:41.006779 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c041819d-a5e3-408c-827b-fed3133a1fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:41.007686 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041819d-a5e3-408c-827b-fed3133a1fdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:41.007975 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041819d-a5e3-408c-827b-fed3133a1fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:41.008288 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041819d-a5e3-408c-827b-fed3133a1fdc admin admin] PATH_INFO: `/v3/projects/dfeca6a7441f4e2d846ebc892c645d08` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:41.009482 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c041819d-a5e3-408c-827b-fed3133a1fdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfeca6a7441f4e2d846ebc892c645d08)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:41.010376 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e8d7b-2e8c-4ff9-bde9-af429664bbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:41.011189 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e8d7b-2e8c-4ff9-bde9-af429664bbcb admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:41.011438 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c041819d-a5e3-408c-827b-fed3133a1fdc admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:41.011543 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e8d7b-2e8c-4ff9-bde9-af429664bbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:41.011755 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e8d7b-2e8c-4ff9-bde9-af429664bbcb admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:41.012480 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e8d7b-2e8c-4ff9-bde9-af429664bbcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:41.014392 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1e8d7b-2e8c-4ff9-bde9-af429664bbcb admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:41.039566 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1006/2035] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:44:40 2022] POST /identity/v3/users => generated 303 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:41.039566 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e8d7b-2e8c-4ff9-bde9-af429664bbcb admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:41.047780 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e8d7b-2e8c-4ff9-bde9-af429664bbcb admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:41.063182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c041819d-a5e3-408c-827b-fed3133a1fdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfeca6a7441f4e2d846ebc892c645d08', 'request_id': 'req-c041819d-a5e3-408c-827b-fed3133a1fdc'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:41.070009 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c041819d-a5e3-408c-827b-fed3133a1fdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfeca6a7441f4e2d846ebc892c645d08', 'request_id': 'req-c041819d-a5e3-408c-827b-fed3133a1fdc'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:41.079175 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c041819d-a5e3-408c-827b-fed3133a1fdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfeca6a7441f4e2d846ebc892c645d08', 'request_id': 'req-c041819d-a5e3-408c-827b-fed3133a1fdc'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:41.093003 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c041819d-a5e3-408c-827b-fed3133a1fdc admin admin] The token cache is being invalidate because project dfeca6a7441f4e2d846ebc892c645d08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:44:41.093539 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c041819d-a5e3-408c-827b-fed3133a1fdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:41.094413 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c041819d-a5e3-408c-827b-fed3133a1fdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:41.098543 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1030/2036] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:44:40 2022] DELETE /identity/v3/projects/dfeca6a7441f4e2d846ebc892c645d08 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:41.099735 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c041819d-a5e3-408c-827b-fed3133a1fdc admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:41.101415 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c041819d-a5e3-408c-827b-fed3133a1fdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:41.113502 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f97ea-4804-477f-a688-ec95a1a62222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:41.114531 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f97ea-4804-477f-a688-ec95a1a62222 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:41.114878 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f97ea-4804-477f-a688-ec95a1a62222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:41.115141 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f97ea-4804-477f-a688-ec95a1a62222 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:41.116915 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f97ea-4804-477f-a688-ec95a1a62222 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:41.118863 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f97ea-4804-477f-a688-ec95a1a62222 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:41.156552 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1007/2037] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:44:41 2022] POST /identity/v3/projects => generated 377 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:41.159136 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c94fe-9c32-4969-9f99-49a3fe79f666 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:41.159972 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c94fe-9c32-4969-9f99-49a3fe79f666 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:41.160368 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c94fe-9c32-4969-9f99-49a3fe79f666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:41.180866 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-4f0c94fe-9c32-4969-9f99-49a3fe79f666 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:41.182192 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4f0c94fe-9c32-4969-9f99-49a3fe79f666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:41.197308 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:41.198182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:41.226800 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c041819d-a5e3-408c-827b-fed3133a1fdc admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:41.306040 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1008/2038] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:41.306040 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c94fe-9c32-4969-9f99-49a3fe79f666 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:41.306040 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4f0c94fe-9c32-4969-9f99-49a3fe79f666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:41.325573 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c94fe-9c32-4969-9f99-49a3fe79f666 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:41.332912 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6f666-58b3-4d3f-955f-2540860848eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:41.333899 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6f666-58b3-4d3f-955f-2540860848eb admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:41.334012 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6f666-58b3-4d3f-955f-2540860848eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:41.334308 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6f666-58b3-4d3f-955f-2540860848eb admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:41.335264 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a6f666-58b3-4d3f-955f-2540860848eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:41.337271 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a6f666-58b3-4d3f-955f-2540860848eb admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:41.339828 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3681ef-b032-4fe3-9d0c-add18fca2255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:41.340920 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3681ef-b032-4fe3-9d0c-add18fca2255 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:41.341310 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3681ef-b032-4fe3-9d0c-add18fca2255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:41.341772 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3681ef-b032-4fe3-9d0c-add18fca2255 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:41.342683 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3681ef-b032-4fe3-9d0c-add18fca2255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:41.345136 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3681ef-b032-4fe3-9d0c-add18fca2255 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:41.372149 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1031/2039] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:41.385379 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd910210-fa06-4596-a3fc-e9c2626a8f83 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:41.385793 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd910210-fa06-4596-a3fc-e9c2626a8f83 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:41.386838 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd910210-fa06-4596-a3fc-e9c2626a8f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:41.387326 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1009/2040] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:44:41 2022] POST /identity/v3/users => generated 289 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:41.388372 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6f666-58b3-4d3f-955f-2540860848eb admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:41.407650 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a6f666-58b3-4d3f-955f-2540860848eb admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:41.419846 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7196ac6-7e37-411a-9afe-4453dcdcd3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:41.420610 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7196ac6-7e37-411a-9afe-4453dcdcd3a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:41.420892 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7196ac6-7e37-411a-9afe-4453dcdcd3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:41.421173 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7196ac6-7e37-411a-9afe-4453dcdcd3a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:41.422086 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7196ac6-7e37-411a-9afe-4453dcdcd3a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:41.423831 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7196ac6-7e37-411a-9afe-4453dcdcd3a4 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:41.443457 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-bd910210-fa06-4596-a3fc-e9c2626a8f83 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:41.444342 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1010/2041] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:41.445093 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-bd910210-fa06-4596-a3fc-e9c2626a8f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:41.448513 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7196ac6-7e37-411a-9afe-4453dcdcd3a4 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:41.461072 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7196ac6-7e37-411a-9afe-4453dcdcd3a4 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:41.465106 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1032/2042] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:41.465106 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd910210-fa06-4596-a3fc-e9c2626a8f83 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:41.466438 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0381ced-ea46-43c5-a549-833e4b728f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:41.467148 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0381ced-ea46-43c5-a549-833e4b728f05 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:41.467426 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0381ced-ea46-43c5-a549-833e4b728f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:41.467843 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0381ced-ea46-43c5-a549-833e4b728f05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:41.468588 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0381ced-ea46-43c5-a549-833e4b728f05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:41.470384 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0381ced-ea46-43c5-a549-833e4b728f05 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:41.479825 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd910210-fa06-4596-a3fc-e9c2626a8f83 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:41.483920 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1011/2043] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:41.484865 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0381ced-ea46-43c5-a549-833e4b728f05 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:41.485595 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14377ef-ade0-4497-a78e-b34601121f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:41.490685 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14377ef-ade0-4497-a78e-b34601121f3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:41.491105 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14377ef-ade0-4497-a78e-b34601121f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:41.491389 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14377ef-ade0-4497-a78e-b34601121f3a admin admin] PATH_INFO: `/v3/projects/9f9a09482f994bdb98dc66efc83af3dd/users/bfde88c0f7164d1b94dc307a9c7277d3/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:41.513726 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0381ced-ea46-43c5-a549-833e4b728f05 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:41.525484 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee91908-dee7-4d4f-9244-19bb4e53523c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:41.526225 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee91908-dee7-4d4f-9244-19bb4e53523c admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:41.526449 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee91908-dee7-4d4f-9244-19bb4e53523c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:41.526752 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee91908-dee7-4d4f-9244-19bb4e53523c admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:41.527594 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee91908-dee7-4d4f-9244-19bb4e53523c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:44:41.527798 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee91908-dee7-4d4f-9244-19bb4e53523c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:41.529824 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14377ef-ade0-4497-a78e-b34601121f3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f9a09482f994bdb98dc66efc83af3dd, user_id=bfde88c0f7164d1b94dc307a9c7277d3, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:41.530719 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee91908-dee7-4d4f-9244-19bb4e53523c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:41.534750 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14377ef-ade0-4497-a78e-b34601121f3a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:41.560978 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1033/2044] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:44:41 2022] PUT /identity/v3/projects/9f9a09482f994bdb98dc66efc83af3dd/users/bfde88c0f7164d1b94dc307a9c7277d3/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:41.560978 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14377ef-ade0-4497-a78e-b34601121f3a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:41.562873 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1012/2045] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:44:41.564762 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee91908-dee7-4d4f-9244-19bb4e53523c admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:41.596667 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee91908-dee7-4d4f-9244-19bb4e53523c admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:41.673167 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14377ef-ade0-4497-a78e-b34601121f3a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:41.673440 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773a9dc-c5aa-4131-8444-b346f9d62e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:41.674291 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773a9dc-c5aa-4131-8444-b346f9d62e21 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:41.674666 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773a9dc-c5aa-4131-8444-b346f9d62e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:41.674926 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e773a9dc-c5aa-4131-8444-b346f9d62e21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:41.675751 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e773a9dc-c5aa-4131-8444-b346f9d62e21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:41.677694 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e773a9dc-c5aa-4131-8444-b346f9d62e21 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:41.678034 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb90f0-6af9-471d-8162-ce18e159b4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:41.678740 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb90f0-6af9-471d-8162-ce18e159b4ef admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:41.679022 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb90f0-6af9-471d-8162-ce18e159b4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:41.679298 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb90f0-6af9-471d-8162-ce18e159b4ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:41.680036 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeb90f0-6af9-471d-8162-ce18e159b4ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:41.681661 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeb90f0-6af9-471d-8162-ce18e159b4ef admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:41.698216 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1034/2046] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:41.698216 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef68ad3-ef15-4a49-b902-7da7cecc7abd None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:41.698216 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef68ad3-ef15-4a49-b902-7da7cecc7abd None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:41.698216 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef68ad3-ef15-4a49-b902-7da7cecc7abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:41.720871 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1013/2047] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:44:41 2022] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:41.720871 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773a9dc-c5aa-4131-8444-b346f9d62e21 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:41.735041 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-2ef68ad3-ef15-4a49-b902-7da7cecc7abd None None] MFA Rules not processed for user `bfde88c0f7164d1b94dc307a9c7277d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:41.737242 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2ef68ad3-ef15-4a49-b902-7da7cecc7abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:41.824264 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:41.837546 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:41.851008 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1035/2048] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:41 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:41.853303 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef68ad3-ef15-4a49-b902-7da7cecc7abd None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:41.868250 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e773a9dc-c5aa-4131-8444-b346f9d62e21 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:41.882616 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef68ad3-ef15-4a49-b902-7da7cecc7abd None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:41.891638 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c1f03-99b1-40de-8de0-7cf82d981a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:41.892564 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c1f03-99b1-40de-8de0-7cf82d981a62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:41.893378 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c1f03-99b1-40de-8de0-7cf82d981a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:41.894372 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c1f03-99b1-40de-8de0-7cf82d981a62 admin admin] PATH_INFO: `/v3/projects/1f61148955104208b519488a08668eb0/users/bb94c986f14344f5ae80136a0ddd4a28/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:41.895482 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42033c05-9ddf-4fab-b0ad-7d77bf43d0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:41.895851 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42033c05-9ddf-4fab-b0ad-7d77bf43d0dc admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:41.898799 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42033c05-9ddf-4fab-b0ad-7d77bf43d0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:41.899139 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42033c05-9ddf-4fab-b0ad-7d77bf43d0dc admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:41.900892 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42033c05-9ddf-4fab-b0ad-7d77bf43d0dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:41.907286 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42033c05-9ddf-4fab-b0ad-7d77bf43d0dc admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:41.935208 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119c1f03-99b1-40de-8de0-7cf82d981a62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f61148955104208b519488a08668eb0, user_id=bb94c986f14344f5ae80136a0ddd4a28, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:41.938625 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119c1f03-99b1-40de-8de0-7cf82d981a62 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:41.939580 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1036/2049] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:44:41 2022] POST /identity/v3/users => generated 293 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:41.941135 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42033c05-9ddf-4fab-b0ad-7d77bf43d0dc admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:41.952324 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42033c05-9ddf-4fab-b0ad-7d77bf43d0dc admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:41.958245 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60636e4-b734-4f0e-8770-44686d36aa94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:41.959192 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60636e4-b734-4f0e-8770-44686d36aa94 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:41.959573 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60636e4-b734-4f0e-8770-44686d36aa94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:41.959928 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60636e4-b734-4f0e-8770-44686d36aa94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:41.960705 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60636e4-b734-4f0e-8770-44686d36aa94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:41.963235 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60636e4-b734-4f0e-8770-44686d36aa94 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:41.975427 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1014/2050] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:44:41 2022] PUT /identity/v3/projects/1f61148955104208b519488a08668eb0/users/bb94c986f14344f5ae80136a0ddd4a28/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:41.976548 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c1f03-99b1-40de-8de0-7cf82d981a62 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:42.022443 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1037/2051] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:44:41 2022] POST /identity/v3/projects => generated 409 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:42.026411 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea63f5-8d0f-4b25-adc8-faaae8b8c50f None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:42.026556 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea63f5-8d0f-4b25-adc8-faaae8b8c50f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:42.026833 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fea63f5-8d0f-4b25-adc8-faaae8b8c50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:42.085242 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c1f03-99b1-40de-8de0-7cf82d981a62 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:42.088264 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-0fea63f5-8d0f-4b25-adc8-faaae8b8c50f None None] MFA Rules not processed for user `bb94c986f14344f5ae80136a0ddd4a28`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:42.089329 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0fea63f5-8d0f-4b25-adc8-faaae8b8c50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:42.164640 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2880cbda-7fb9-4c02-ba31-89f516bf28fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:42.165814 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880cbda-7fb9-4c02-ba31-89f516bf28fe admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:42.166299 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880cbda-7fb9-4c02-ba31-89f516bf28fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:42.166944 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2880cbda-7fb9-4c02-ba31-89f516bf28fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:42.167909 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2880cbda-7fb9-4c02-ba31-89f516bf28fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:42.169608 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1038/2052] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:42.170143 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2880cbda-7fb9-4c02-ba31-89f516bf28fe admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:42.170705 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea63f5-8d0f-4b25-adc8-faaae8b8c50f None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:42.181975 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1015/2053] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:42.183425 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2880cbda-7fb9-4c02-ba31-89f516bf28fe admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:42.188354 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fea63f5-8d0f-4b25-adc8-faaae8b8c50f None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:42.194748 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf4871-ad99-4d6a-badd-acde1d4bcae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:42.195444 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf4871-ad99-4d6a-badd-acde1d4bcae3 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:42.195861 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf4871-ad99-4d6a-badd-acde1d4bcae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:42.196014 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bf4871-ad99-4d6a-badd-acde1d4bcae3 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:42.196745 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf4871-ad99-4d6a-badd-acde1d4bcae3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:42.198867 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2880cbda-7fb9-4c02-ba31-89f516bf28fe admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:42.199173 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bf4871-ad99-4d6a-badd-acde1d4bcae3 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:42.203657 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c00ae-a559-4df3-a741-b8952a0df926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:42.204328 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c00ae-a559-4df3-a741-b8952a0df926 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:42.204612 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c00ae-a559-4df3-a741-b8952a0df926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:42.204885 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c00ae-a559-4df3-a741-b8952a0df926 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:42.205575 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c00ae-a559-4df3-a741-b8952a0df926 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:42.207694 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c00ae-a559-4df3-a741-b8952a0df926 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:42.222473 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1039/2054] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:44:42 2022] POST /identity/v3/users => generated 311 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:42.223612 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf4871-ad99-4d6a-badd-acde1d4bcae3 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:42.235193 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bf4871-ad99-4d6a-badd-acde1d4bcae3 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:42.243270 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1016/2055] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:44:42 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:42.243552 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6390e-dfec-4ed1-ba0d-9f92332a6cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:42.243655 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c00ae-a559-4df3-a741-b8952a0df926 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:42.243731 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6390e-dfec-4ed1-ba0d-9f92332a6cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:42.243731 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6390e-dfec-4ed1-ba0d-9f92332a6cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:42.243731 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f6390e-dfec-4ed1-ba0d-9f92332a6cd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:42.243731 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6390e-dfec-4ed1-ba0d-9f92332a6cd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:42.244630 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f6390e-dfec-4ed1-ba0d-9f92332a6cd6 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:42.258843 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1040/2056] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:42.259894 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6390e-dfec-4ed1-ba0d-9f92332a6cd6 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:42.271159 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f6390e-dfec-4ed1-ba0d-9f92332a6cd6 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:42.326632 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:42.331638 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c00ae-a559-4df3-a741-b8952a0df926 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:42.332908 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00699eab-78a2-4acb-a838-14d7c75851dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:42.333586 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00699eab-78a2-4acb-a838-14d7c75851dd admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:42.334494 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00699eab-78a2-4acb-a838-14d7c75851dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:42.334494 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00699eab-78a2-4acb-a838-14d7c75851dd admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:42.334952 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00699eab-78a2-4acb-a838-14d7c75851dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:42.337021 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00699eab-78a2-4acb-a838-14d7c75851dd admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:42.337974 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f40111-11c4-45da-b4b6-e7be174a95c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:42.338697 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f40111-11c4-45da-b4b6-e7be174a95c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:42.339031 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f40111-11c4-45da-b4b6-e7be174a95c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:42.339309 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f40111-11c4-45da-b4b6-e7be174a95c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:42.340104 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f40111-11c4-45da-b4b6-e7be174a95c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:42.341828 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f40111-11c4-45da-b4b6-e7be174a95c8 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:42.354839 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1017/2057] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:42.356242 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f40111-11c4-45da-b4b6-e7be174a95c8 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:42.361709 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1041/2058] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:44:42 2022] POST /identity/v3/users => generated 294 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:42.361709 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00699eab-78a2-4acb-a838-14d7c75851dd admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:42.366418 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:42.369253 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f40111-11c4-45da-b4b6-e7be174a95c8 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:42.370700 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00699eab-78a2-4acb-a838-14d7c75851dd admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:42.374917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35679cf0-1af8-4d25-afa7-4c84b1e0a753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:42.375822 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35679cf0-1af8-4d25-afa7-4c84b1e0a753 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:42.376133 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35679cf0-1af8-4d25-afa7-4c84b1e0a753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:42.376410 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35679cf0-1af8-4d25-afa7-4c84b1e0a753 admin admin] PATH_INFO: `/v3/projects/223bfa8e11a945ca99c40915f0b485ca/users/e400178102364699bc004dd31b5ad245/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:42.376542 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191efc33-745b-4c81-a713-301afc2b1551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:42.377485 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191efc33-745b-4c81-a713-301afc2b1551 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:42.377776 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191efc33-745b-4c81-a713-301afc2b1551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:42.378090 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191efc33-745b-4c81-a713-301afc2b1551 admin admin] PATH_INFO: `/v3/projects/1e59eb0238c844eca7a055a09606576c/users/a67c202d4f6a4661b6e23dd4b11bef83/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:42.407878 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35679cf0-1af8-4d25-afa7-4c84b1e0a753 admin admin] RBAC: Authorizing `identity:create_grant(project_id=223bfa8e11a945ca99c40915f0b485ca, user_id=e400178102364699bc004dd31b5ad245, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:42.408916 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191efc33-745b-4c81-a713-301afc2b1551 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e59eb0238c844eca7a055a09606576c, user_id=a67c202d4f6a4661b6e23dd4b11bef83, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:42.412128 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35679cf0-1af8-4d25-afa7-4c84b1e0a753 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:42.412465 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191efc33-745b-4c81-a713-301afc2b1551 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:42.429876 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1042/2059] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:44:42 2022] PUT /identity/v3/projects/1e59eb0238c844eca7a055a09606576c/users/a67c202d4f6a4661b6e23dd4b11bef83/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:42.431048 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191efc33-745b-4c81-a713-301afc2b1551 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:42.441731 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1018/2060] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:44:42 2022] PUT /identity/v3/projects/223bfa8e11a945ca99c40915f0b485ca/users/e400178102364699bc004dd31b5ad245/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:42.442818 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35679cf0-1af8-4d25-afa7-4c84b1e0a753 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:42.601542 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35679cf0-1af8-4d25-afa7-4c84b1e0a753 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:42.615997 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e687b711-c283-4abc-abc9-68008a6c374a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:42.616704 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687b711-c283-4abc-abc9-68008a6c374a admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:42.616988 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687b711-c283-4abc-abc9-68008a6c374a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:42.617265 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e687b711-c283-4abc-abc9-68008a6c374a admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:42.618233 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e687b711-c283-4abc-abc9-68008a6c374a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:42.623077 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e687b711-c283-4abc-abc9-68008a6c374a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:42.646592 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191efc33-745b-4c81-a713-301afc2b1551 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:42.654801 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1019/2061] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:42.654801 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038a49c-4dd3-4025-86ef-1c89b5455f19 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:42.654801 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038a49c-4dd3-4025-86ef-1c89b5455f19 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:42.654801 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038a49c-4dd3-4025-86ef-1c89b5455f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:42.661553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f75737-bd39-4aab-94e7-cabd7f13bc32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:42.662441 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f75737-bd39-4aab-94e7-cabd7f13bc32 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:42.662695 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f75737-bd39-4aab-94e7-cabd7f13bc32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:42.663349 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f75737-bd39-4aab-94e7-cabd7f13bc32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:42.663731 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f75737-bd39-4aab-94e7-cabd7f13bc32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:42.665487 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f75737-bd39-4aab-94e7-cabd7f13bc32 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:42.709379 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c038a49c-4dd3-4025-86ef-1c89b5455f19 None None] MFA Rules not processed for user `e400178102364699bc004dd31b5ad245`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:42.710681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c038a49c-4dd3-4025-86ef-1c89b5455f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:42.722917 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1043/2062] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:42.723798 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f75737-bd39-4aab-94e7-cabd7f13bc32 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:42.735164 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f75737-bd39-4aab-94e7-cabd7f13bc32 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:42.744550 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f88e6-0a25-4ff6-846a-c940412d3910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:42.749281 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f88e6-0a25-4ff6-846a-c940412d3910 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:42.749574 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f88e6-0a25-4ff6-846a-c940412d3910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:42.749881 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3f88e6-0a25-4ff6-846a-c940412d3910 admin admin] PATH_INFO: `/v3/projects/1e59eb0238c844eca7a055a09606576c/users/a67c202d4f6a4661b6e23dd4b11bef83/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:42.759903 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3f88e6-0a25-4ff6-846a-c940412d3910 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e59eb0238c844eca7a055a09606576c, user_id=a67c202d4f6a4661b6e23dd4b11bef83, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:42.779879 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3f88e6-0a25-4ff6-846a-c940412d3910 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:42.814865 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1044/2063] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:44:42 2022] PUT /identity/v3/projects/1e59eb0238c844eca7a055a09606576c/users/a67c202d4f6a4661b6e23dd4b11bef83/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:42.816640 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f88e6-0a25-4ff6-846a-c940412d3910 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:42.851112 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1020/2064] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:42.851112 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e244d4-b389-437b-938f-e5925b592c5b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:42.851112 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e244d4-b389-437b-938f-e5925b592c5b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:42.851112 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e244d4-b389-437b-938f-e5925b592c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:42.884545 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-f1e244d4-b389-437b-938f-e5925b592c5b None None] MFA Rules not processed for user `a67c202d4f6a4661b6e23dd4b11bef83`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:42.885943 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f1e244d4-b389-437b-938f-e5925b592c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:42.952474 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:42.989667 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3f88e6-0a25-4ff6-846a-c940412d3910 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:42.996175 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1550e6a9-b078-4180-b30a-0ffe39f2c844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:42.996322 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1021/2065] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:42 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:42.997172 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e244d4-b389-437b-938f-e5925b592c5b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:42.998574 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f1e244d4-b389-437b-938f-e5925b592c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:42.998911 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1550e6a9-b078-4180-b30a-0ffe39f2c844 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:42.999386 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1550e6a9-b078-4180-b30a-0ffe39f2c844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:42.999918 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1550e6a9-b078-4180-b30a-0ffe39f2c844 admin admin] PATH_INFO: `/v3/projects/bb7268293a70480f81d59f0cd770d082/users/1022ed731cb042be8f0ed2c830df437c/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:43.016678 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1550e6a9-b078-4180-b30a-0ffe39f2c844 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb7268293a70480f81d59f0cd770d082, user_id=1022ed731cb042be8f0ed2c830df437c, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:43.020030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1550e6a9-b078-4180-b30a-0ffe39f2c844 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:43.035740 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1045/2066] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:44:42 2022] PUT /identity/v3/projects/bb7268293a70480f81d59f0cd770d082/users/1022ed731cb042be8f0ed2c830df437c/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:43.039508 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1550e6a9-b078-4180-b30a-0ffe39f2c844 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:43.064299 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e244d4-b389-437b-938f-e5925b592c5b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:43.091896 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:43.108130 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1550e6a9-b078-4180-b30a-0ffe39f2c844 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:43.113035 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb8808-04ce-4e53-837d-8c799b26fb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:43.113708 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb8808-04ce-4e53-837d-8c799b26fb41 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:43.113998 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb8808-04ce-4e53-837d-8c799b26fb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:43.114282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb8808-04ce-4e53-837d-8c799b26fb41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:43.115052 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eb8808-04ce-4e53-837d-8c799b26fb41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:43.116711 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eb8808-04ce-4e53-837d-8c799b26fb41 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:43.123813 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea082c1c-200e-465a-8ad6-ad647374854c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:43.124528 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea082c1c-200e-465a-8ad6-ad647374854c service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:43.124856 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea082c1c-200e-465a-8ad6-ad647374854c service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:43.125154 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea082c1c-200e-465a-8ad6-ad647374854c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:43.131921 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1046/2067] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:43 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 03:44:43.133279 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb8808-04ce-4e53-837d-8c799b26fb41 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:43.144231 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb8808-04ce-4e53-837d-8c799b26fb41 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:43.149334 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27425f-8d88-412e-a551-208112eaf845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:43.150218 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27425f-8d88-412e-a551-208112eaf845 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:43.150534 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27425f-8d88-412e-a551-208112eaf845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:43.150819 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27425f-8d88-412e-a551-208112eaf845 admin admin] PATH_INFO: `/v3/projects/bb7268293a70480f81d59f0cd770d082/users/1022ed731cb042be8f0ed2c830df437c/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:43.152800 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f27425f-8d88-412e-a551-208112eaf845 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb7268293a70480f81d59f0cd770d082, user_id=1022ed731cb042be8f0ed2c830df437c, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:43.155465 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f27425f-8d88-412e-a551-208112eaf845 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:43.175867 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1047/2068] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:44:43 2022] PUT /identity/v3/projects/bb7268293a70480f81d59f0cd770d082/users/1022ed731cb042be8f0ed2c830df437c/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:43.175867 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27425f-8d88-412e-a551-208112eaf845 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:43.175867 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9f27425f-8d88-412e-a551-208112eaf845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:43.188390 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea082c1c-200e-465a-8ad6-ad647374854c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:43.189853 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea082c1c-200e-465a-8ad6-ad647374854c service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:43.199802 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1022/2069] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:44:43.201127 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83546ad2-b6ff-4f9a-ac12-ce4a52bd7346 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:43.201419 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83546ad2-b6ff-4f9a-ac12-ce4a52bd7346 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:43.201701 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83546ad2-b6ff-4f9a-ac12-ce4a52bd7346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:43.231700 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-83546ad2-b6ff-4f9a-ac12-ce4a52bd7346 None None] MFA Rules not processed for user `1022ed731cb042be8f0ed2c830df437c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:43.233101 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-83546ad2-b6ff-4f9a-ac12-ce4a52bd7346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:43.245422 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27425f-8d88-412e-a551-208112eaf845 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:43.249778 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b31e6-a663-41d8-bfec-75b14748f530 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:43.250430 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b31e6-a663-41d8-bfec-75b14748f530 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:43.250754 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b31e6-a663-41d8-bfec-75b14748f530 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:43.251037 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b31e6-a663-41d8-bfec-75b14748f530 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:43.279035 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:43.318994 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1023/2070] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:43 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:43.319852 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83546ad2-b6ff-4f9a-ac12-ce4a52bd7346 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:43.330180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b31e6-a663-41d8-bfec-75b14748f530 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:43.332493 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b31e6-a663-41d8-bfec-75b14748f530 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:43.351532 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1048/2071] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:43 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:44:43.352514 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b31e6-a663-41d8-bfec-75b14748f530 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:43.361314 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b31e6-a663-41d8-bfec-75b14748f530 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:43.365052 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375d5649-fce7-4fbf-adf8-49c4da1dd8e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:43.365696 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d5649-fce7-4fbf-adf8-49c4da1dd8e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:43.366006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d5649-fce7-4fbf-adf8-49c4da1dd8e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:43.366267 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375d5649-fce7-4fbf-adf8-49c4da1dd8e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:43.368150 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-375d5649-fce7-4fbf-adf8-49c4da1dd8e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:43.407523 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83546ad2-b6ff-4f9a-ac12-ce4a52bd7346 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:43.412451 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e623a-aaac-4337-9e69-0f6877d7921c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:43.413275 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e623a-aaac-4337-9e69-0f6877d7921c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:43.413563 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e623a-aaac-4337-9e69-0f6877d7921c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:43.413932 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e623a-aaac-4337-9e69-0f6877d7921c admin admin] PATH_INFO: `/v3/users/e400178102364699bc004dd31b5ad245` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:43.415102 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978e623a-aaac-4337-9e69-0f6877d7921c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e400178102364699bc004dd31b5ad245)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:43.417364 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978e623a-aaac-4337-9e69-0f6877d7921c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:43.455584 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d5649-fce7-4fbf-adf8-49c4da1dd8e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:43.457625 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375d5649-fce7-4fbf-adf8-49c4da1dd8e9 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:43.469996 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1049/2072] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:44:43.480164 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-978e623a-aaac-4337-9e69-0f6877d7921c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e400178102364699bc004dd31b5ad245'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:43.480985 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-978e623a-aaac-4337-9e69-0f6877d7921c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e400178102364699bc004dd31b5ad245'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:43.481872 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-978e623a-aaac-4337-9e69-0f6877d7921c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e400178102364699bc004dd31b5ad245'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:43.492132 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-978e623a-aaac-4337-9e69-0f6877d7921c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e400178102364699bc004dd31b5ad245'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:43.502320 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-978e623a-aaac-4337-9e69-0f6877d7921c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e400178102364699bc004dd31b5ad245'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:43.536197 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1024/2073] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:44:43 2022] DELETE /identity/v3/users/e400178102364699bc004dd31b5ad245 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:43.541717 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60667f7-a097-4f3b-8a71-162e9f92805c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:43.542568 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60667f7-a097-4f3b-8a71-162e9f92805c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:43.542763 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60667f7-a097-4f3b-8a71-162e9f92805c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:43.560291 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-a60667f7-a097-4f3b-8a71-162e9f92805c None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:43.561490 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a60667f7-a097-4f3b-8a71-162e9f92805c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:43.576180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:43.632437 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1050/2074] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:44:43.646893 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e623a-aaac-4337-9e69-0f6877d7921c admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:43.649069 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-978e623a-aaac-4337-9e69-0f6877d7921c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:43.749329 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e623a-aaac-4337-9e69-0f6877d7921c admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:43.755673 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387c096-c0fe-428f-8e64-f6cfd358d546 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:43.756551 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387c096-c0fe-428f-8e64-f6cfd358d546 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:43.756838 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387c096-c0fe-428f-8e64-f6cfd358d546 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:43.757454 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387c096-c0fe-428f-8e64-f6cfd358d546 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:43.773705 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:43.773705 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387c096-c0fe-428f-8e64-f6cfd358d546 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:43.773705 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5387c096-c0fe-428f-8e64-f6cfd358d546 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:43.789104 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1025/2075] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:44:43.857932 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60667f7-a097-4f3b-8a71-162e9f92805c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:43.860000 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a60667f7-a097-4f3b-8a71-162e9f92805c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:43.963812 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60667f7-a097-4f3b-8a71-162e9f92805c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:43.968634 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e11fc-a10d-4d3a-945b-1ec44c792337 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:43.969604 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e11fc-a10d-4d3a-945b-1ec44c792337 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:43.970080 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e11fc-a10d-4d3a-945b-1ec44c792337 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:43.970446 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e11fc-a10d-4d3a-945b-1ec44c792337 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:43.973347 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d45e11fc-a10d-4d3a-945b-1ec44c792337 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:44.127454 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e11fc-a10d-4d3a-945b-1ec44c792337 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:44.129011 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e11fc-a10d-4d3a-945b-1ec44c792337 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:44.140581 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1051/2076] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:43 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:44:44.248822 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387c096-c0fe-428f-8e64-f6cfd358d546 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:44.250141 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5387c096-c0fe-428f-8e64-f6cfd358d546 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:44.265644 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387c096-c0fe-428f-8e64-f6cfd358d546 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:44.271605 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48513a33-41a4-4ec0-9b8a-13a014af299a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:44.272564 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48513a33-41a4-4ec0-9b8a-13a014af299a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:44.272953 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48513a33-41a4-4ec0-9b8a-13a014af299a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:44.273517 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48513a33-41a4-4ec0-9b8a-13a014af299a admin admin] PATH_INFO: `/v3/projects/223bfa8e11a945ca99c40915f0b485ca` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:44.274639 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48513a33-41a4-4ec0-9b8a-13a014af299a admin admin] RBAC: Authorizing `identity:delete_project(project_id=223bfa8e11a945ca99c40915f0b485ca)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:44.277389 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48513a33-41a4-4ec0-9b8a-13a014af299a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:44.353917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-48513a33-41a4-4ec0-9b8a-13a014af299a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '223bfa8e11a945ca99c40915f0b485ca', 'request_id': 'req-48513a33-41a4-4ec0-9b8a-13a014af299a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:44.361034 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-48513a33-41a4-4ec0-9b8a-13a014af299a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '223bfa8e11a945ca99c40915f0b485ca', 'request_id': 'req-48513a33-41a4-4ec0-9b8a-13a014af299a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:44.369981 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-48513a33-41a4-4ec0-9b8a-13a014af299a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '223bfa8e11a945ca99c40915f0b485ca', 'request_id': 'req-48513a33-41a4-4ec0-9b8a-13a014af299a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:44.381841 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-48513a33-41a4-4ec0-9b8a-13a014af299a admin admin] The token cache is being invalidate because project 223bfa8e11a945ca99c40915f0b485ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:44:44.382202 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-48513a33-41a4-4ec0-9b8a-13a014af299a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:44.383009 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-48513a33-41a4-4ec0-9b8a-13a014af299a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:44.384546 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1026/2077] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:44:44 2022] DELETE /identity/v3/projects/223bfa8e11a945ca99c40915f0b485ca => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:44.390021 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e13050-b181-4c87-83f4-5ae51d40a1a4 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:44.390398 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e13050-b181-4c87-83f4-5ae51d40a1a4 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:44.390805 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e13050-b181-4c87-83f4-5ae51d40a1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:44.412336 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-65e13050-b181-4c87-83f4-5ae51d40a1a4 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:44.413710 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-65e13050-b181-4c87-83f4-5ae51d40a1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:44.526036 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1052/2078] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:44.536038 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e64c1a-e621-4b99-924e-a115a5cd8b6c None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:44.540564 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e64c1a-e621-4b99-924e-a115a5cd8b6c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:44.541032 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e64c1a-e621-4b99-924e-a115a5cd8b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:44.601004 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-e1e64c1a-e621-4b99-924e-a115a5cd8b6c None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:44.602278 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e1e64c1a-e621-4b99-924e-a115a5cd8b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:44.644860 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1027/2079] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:44.649674 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e13050-b181-4c87-83f4-5ae51d40a1a4 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:44.661352 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e13050-b181-4c87-83f4-5ae51d40a1a4 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:44.674148 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b40706-19ca-48c8-aea4-243493838d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:44.675071 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b40706-19ca-48c8-aea4-243493838d70 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:44.675430 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b40706-19ca-48c8-aea4-243493838d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:44.676069 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b40706-19ca-48c8-aea4-243493838d70 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:44.676832 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b40706-19ca-48c8-aea4-243493838d70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:44:44.677246 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b40706-19ca-48c8-aea4-243493838d70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:44.680368 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b40706-19ca-48c8-aea4-243493838d70 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:44.693125 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:44.716476 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1053/2080] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:44:44.721058 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e64c1a-e621-4b99-924e-a115a5cd8b6c None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:44.731940 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e64c1a-e621-4b99-924e-a115a5cd8b6c None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:44.743591 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda0b73-9044-4712-b13b-14bcd56707c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:44.744472 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda0b73-9044-4712-b13b-14bcd56707c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:44.745553 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda0b73-9044-4712-b13b-14bcd56707c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:44.745914 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda0b73-9044-4712-b13b-14bcd56707c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:44.746741 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fda0b73-9044-4712-b13b-14bcd56707c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:44.748783 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fda0b73-9044-4712-b13b-14bcd56707c5 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:44.781452 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1028/2081] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:44:44 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:44.782981 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b40706-19ca-48c8-aea4-243493838d70 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:44.793728 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b40706-19ca-48c8-aea4-243493838d70 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:44.862839 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb0317-4411-48e2-b827-5d3a804735bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:44.863624 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb0317-4411-48e2-b827-5d3a804735bf admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:44.864173 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb0317-4411-48e2-b827-5d3a804735bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:44.864555 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb0317-4411-48e2-b827-5d3a804735bf admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:44.865391 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb0317-4411-48e2-b827-5d3a804735bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:44.867727 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb0317-4411-48e2-b827-5d3a804735bf admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:44.890502 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1054/2082] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:44:44 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:44.894359 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda0b73-9044-4712-b13b-14bcd56707c5 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:44.908977 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda0b73-9044-4712-b13b-14bcd56707c5 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:44.915108 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54b95e-4121-42af-bde1-bea74a38a596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:44.916088 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54b95e-4121-42af-bde1-bea74a38a596 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:44.916801 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54b95e-4121-42af-bde1-bea74a38a596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:44.917184 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54b95e-4121-42af-bde1-bea74a38a596 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:44.918555 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e54b95e-4121-42af-bde1-bea74a38a596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:44.920662 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e54b95e-4121-42af-bde1-bea74a38a596 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:44.934293 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1029/2083] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:44.938738 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb0317-4411-48e2-b827-5d3a804735bf admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:44.950757 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb0317-4411-48e2-b827-5d3a804735bf admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:44.955722 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd90e0-bbf6-4529-9845-7d95d71bf18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:44.956428 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd90e0-bbf6-4529-9845-7d95d71bf18a admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:44.956722 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd90e0-bbf6-4529-9845-7d95d71bf18a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:44.956993 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd90e0-bbf6-4529-9845-7d95d71bf18a admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:44.957735 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd90e0-bbf6-4529-9845-7d95d71bf18a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:44.959382 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd90e0-bbf6-4529-9845-7d95d71bf18a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:44.974356 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1055/2084] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 03:44:44.975708 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54b95e-4121-42af-bde1-bea74a38a596 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:44.986411 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54b95e-4121-42af-bde1-bea74a38a596 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:44.992909 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dd2d52-173d-4f5c-96e8-4795bd06a880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:44.993865 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd2d52-173d-4f5c-96e8-4795bd06a880 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:44.994203 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd2d52-173d-4f5c-96e8-4795bd06a880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:44.994524 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd2d52-173d-4f5c-96e8-4795bd06a880 admin admin] PATH_INFO: `/v3/projects/0a27dd3f60ad424abc51b1477f3b12ed/users/8a4854f808eb4b4c907ae109119c4b3d/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:45.018952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dd2d52-173d-4f5c-96e8-4795bd06a880 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a27dd3f60ad424abc51b1477f3b12ed, user_id=8a4854f808eb4b4c907ae109119c4b3d, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:45.021866 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dd2d52-173d-4f5c-96e8-4795bd06a880 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:45.043319 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1030/2085] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:44:44 2022] PUT /identity/v3/projects/0a27dd3f60ad424abc51b1477f3b12ed/users/8a4854f808eb4b4c907ae109119c4b3d/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:45.062137 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029a965-1d4c-4326-821e-ab22d91a2b0a None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:45.062546 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029a965-1d4c-4326-821e-ab22d91a2b0a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:45.062851 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029a965-1d4c-4326-821e-ab22d91a2b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:45.102769 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-0029a965-1d4c-4326-821e-ab22d91a2b0a None None] MFA Rules not processed for user `8a4854f808eb4b4c907ae109119c4b3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:45.104173 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0029a965-1d4c-4326-821e-ab22d91a2b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:45.139231 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dd2d52-173d-4f5c-96e8-4795bd06a880 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:45.141007 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-89dd2d52-173d-4f5c-96e8-4795bd06a880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:45.172880 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1056/2086] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:45.188357 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029a965-1d4c-4326-821e-ab22d91a2b0a None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:45.189836 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0029a965-1d4c-4326-821e-ab22d91a2b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:45.202297 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dd2d52-173d-4f5c-96e8-4795bd06a880 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:45.206012 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98b8fd-73fa-493b-afe5-7264fc4518ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:45.206709 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98b8fd-73fa-493b-afe5-7264fc4518ba service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:45.206999 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98b8fd-73fa-493b-afe5-7264fc4518ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:45.207280 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98b8fd-73fa-493b-afe5-7264fc4518ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:45.209078 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-be98b8fd-73fa-493b-afe5-7264fc4518ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:45.246506 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:45.251007 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029a965-1d4c-4326-821e-ab22d91a2b0a None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:45.255355 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a29b0-771c-4680-a5e1-673e57a75cb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:45.256085 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a29b0-771c-4680-a5e1-673e57a75cb5 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:45.256353 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a29b0-771c-4680-a5e1-673e57a75cb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:45.256683 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a29b0-771c-4680-a5e1-673e57a75cb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:45.265511 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486a29b0-771c-4680-a5e1-673e57a75cb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:45.266994 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486a29b0-771c-4680-a5e1-673e57a75cb5 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:45.276378 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1057/2087] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 03:44:45.282272 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be98b8fd-73fa-493b-afe5-7264fc4518ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:45.283743 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be98b8fd-73fa-493b-afe5-7264fc4518ba service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:45.293366 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1031/2088] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:45 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 03:44:45.971367 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a29b0-771c-4680-a5e1-673e57a75cb5 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:45.984164 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a29b0-771c-4680-a5e1-673e57a75cb5 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:45.990261 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d2a4c-9060-42a7-bf39-8d06ee705bf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:45.990986 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d2a4c-9060-42a7-bf39-8d06ee705bf2 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:45.991278 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d2a4c-9060-42a7-bf39-8d06ee705bf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:45.994887 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d2a4c-9060-42a7-bf39-8d06ee705bf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:45.997073 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2e5d2a4c-9060-42a7-bf39-8d06ee705bf2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:46.010275 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:46.092417 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d2a4c-9060-42a7-bf39-8d06ee705bf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:46.093859 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d2a4c-9060-42a7-bf39-8d06ee705bf2 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:46.103969 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1058/2089] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:45 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:44:49.772965 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98b8fd-73fa-493b-afe5-7264fc4518ba service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:49.774577 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-be98b8fd-73fa-493b-afe5-7264fc4518ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:49.840012 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98b8fd-73fa-493b-afe5-7264fc4518ba service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:49.844428 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c636c4-da39-46a8-b40b-d6e580dc887d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:49.845296 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c636c4-da39-46a8-b40b-d6e580dc887d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:49.845579 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c636c4-da39-46a8-b40b-d6e580dc887d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:49.845848 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c636c4-da39-46a8-b40b-d6e580dc887d admin admin] PATH_INFO: `/v3/users/bfde88c0f7164d1b94dc307a9c7277d3` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:49.847548 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c636c4-da39-46a8-b40b-d6e580dc887d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfde88c0f7164d1b94dc307a9c7277d3)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:49.849468 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c636c4-da39-46a8-b40b-d6e580dc887d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:49.897707 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-60c636c4-da39-46a8-b40b-d6e580dc887d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfde88c0f7164d1b94dc307a9c7277d3'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:49.898500 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-60c636c4-da39-46a8-b40b-d6e580dc887d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfde88c0f7164d1b94dc307a9c7277d3'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:49.899198 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-60c636c4-da39-46a8-b40b-d6e580dc887d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfde88c0f7164d1b94dc307a9c7277d3'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:49.910172 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-60c636c4-da39-46a8-b40b-d6e580dc887d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfde88c0f7164d1b94dc307a9c7277d3'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:49.917485 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-60c636c4-da39-46a8-b40b-d6e580dc887d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfde88c0f7164d1b94dc307a9c7277d3'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:49.941874 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1032/2090] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:44:49 2022] DELETE /identity/v3/users/bfde88c0f7164d1b94dc307a9c7277d3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:49.946299 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d0712-021c-47c6-ab1c-adf9e2fdaee5 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:49.946832 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d0712-021c-47c6-ab1c-adf9e2fdaee5 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:49.946931 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d0712-021c-47c6-ab1c-adf9e2fdaee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:49.965644 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-ae7d0712-021c-47c6-ab1c-adf9e2fdaee5 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:49.966962 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ae7d0712-021c-47c6-ab1c-adf9e2fdaee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:50.045132 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1059/2091] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:44:50.056767 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c636c4-da39-46a8-b40b-d6e580dc887d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:50.059706 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-60c636c4-da39-46a8-b40b-d6e580dc887d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:50.066876 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d0712-021c-47c6-ab1c-adf9e2fdaee5 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:50.068979 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ae7d0712-021c-47c6-ab1c-adf9e2fdaee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:50.086005 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d0712-021c-47c6-ab1c-adf9e2fdaee5 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:50.093691 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0712e1-bea7-45a9-abca-05e9feff5e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:50.095101 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0712e1-bea7-45a9-abca-05e9feff5e11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:50.095585 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0712e1-bea7-45a9-abca-05e9feff5e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:50.095944 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0712e1-bea7-45a9-abca-05e9feff5e11 admin admin] PATH_INFO: `/v3/users/b296088d71fb4dae8b66eb644718367d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:50.097934 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0712e1-bea7-45a9-abca-05e9feff5e11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b296088d71fb4dae8b66eb644718367d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:50.100651 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0712e1-bea7-45a9-abca-05e9feff5e11 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:50.139969 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:50.145736 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c636c4-da39-46a8-b40b-d6e580dc887d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:50.162335 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-6e0712e1-bea7-45a9-abca-05e9feff5e11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b296088d71fb4dae8b66eb644718367d'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:50.163589 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-6e0712e1-bea7-45a9-abca-05e9feff5e11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b296088d71fb4dae8b66eb644718367d'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:50.164762 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-6e0712e1-bea7-45a9-abca-05e9feff5e11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b296088d71fb4dae8b66eb644718367d'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:50.169524 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d96f5-cb80-475e-ace5-b75311ffb622 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:50.170259 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d96f5-cb80-475e-ace5-b75311ffb622 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:50.179116 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d96f5-cb80-475e-ace5-b75311ffb622 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:50.179429 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d96f5-cb80-475e-ace5-b75311ffb622 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:50.181717 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-005d96f5-cb80-475e-ace5-b75311ffb622 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:50.181956 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-6e0712e1-bea7-45a9-abca-05e9feff5e11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b296088d71fb4dae8b66eb644718367d'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:50.192016 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-6e0712e1-bea7-45a9-abca-05e9feff5e11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b296088d71fb4dae8b66eb644718367d'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:50.201344 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d96f5-cb80-475e-ace5-b75311ffb622 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:50.203097 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d96f5-cb80-475e-ace5-b75311ffb622 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:50.217784 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1060/2092] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:44:50 2022] DELETE /identity/v3/users/b296088d71fb4dae8b66eb644718367d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:50.225253 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c1141-a219-4aab-bf82-8e18a75bcb4a None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:50.225253 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c1141-a219-4aab-bf82-8e18a75bcb4a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:50.225253 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c1141-a219-4aab-bf82-8e18a75bcb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:50.232882 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1033/2093] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:44:50.252758 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-aa3c1141-a219-4aab-bf82-8e18a75bcb4a None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:50.254370 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-aa3c1141-a219-4aab-bf82-8e18a75bcb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:50.269101 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:50.368194 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1061/2094] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:50.381099 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d96f5-cb80-475e-ace5-b75311ffb622 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:50.382548 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-005d96f5-cb80-475e-ace5-b75311ffb622 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:50.395324 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d96f5-cb80-475e-ace5-b75311ffb622 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:50.474717 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17168f2-69f0-4b8c-bf61-1e9bb0684c4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:50.475294 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17168f2-69f0-4b8c-bf61-1e9bb0684c4f service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:50.476107 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17168f2-69f0-4b8c-bf61-1e9bb0684c4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:50.476400 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17168f2-69f0-4b8c-bf61-1e9bb0684c4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:50.489060 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17168f2-69f0-4b8c-bf61-1e9bb0684c4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:50.490555 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17168f2-69f0-4b8c-bf61-1e9bb0684c4f service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:50.502205 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1034/2095] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:44:50.673946 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c1141-a219-4aab-bf82-8e18a75bcb4a None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:50.676214 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-aa3c1141-a219-4aab-bf82-8e18a75bcb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:50.695536 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c1141-a219-4aab-bf82-8e18a75bcb4a None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:50.705548 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976595ce-7ff3-4cac-b77b-7753e9111bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:50.706730 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976595ce-7ff3-4cac-b77b-7753e9111bd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:50.707086 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976595ce-7ff3-4cac-b77b-7753e9111bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:50.713605 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976595ce-7ff3-4cac-b77b-7753e9111bd5 admin admin] PATH_INFO: `/v3/users/8a4854f808eb4b4c907ae109119c4b3d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:50.713605 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976595ce-7ff3-4cac-b77b-7753e9111bd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a4854f808eb4b4c907ae109119c4b3d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:50.713605 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976595ce-7ff3-4cac-b77b-7753e9111bd5 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:50.716704 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17168f2-69f0-4b8c-bf61-1e9bb0684c4f service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:50.718307 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f17168f2-69f0-4b8c-bf61-1e9bb0684c4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:50.742780 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17168f2-69f0-4b8c-bf61-1e9bb0684c4f service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:50.749835 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ab7ca-974b-4e52-814a-4b6782a17a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:50.750877 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ab7ca-974b-4e52-814a-4b6782a17a5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:50.751216 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ab7ca-974b-4e52-814a-4b6782a17a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:50.751497 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ab7ca-974b-4e52-814a-4b6782a17a5a admin admin] PATH_INFO: `/v3/projects/9f9a09482f994bdb98dc66efc83af3dd` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:50.752866 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7ab7ca-974b-4e52-814a-4b6782a17a5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f9a09482f994bdb98dc66efc83af3dd)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:50.755493 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7ab7ca-974b-4e52-814a-4b6782a17a5a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:50.809424 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-976595ce-7ff3-4cac-b77b-7753e9111bd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a4854f808eb4b4c907ae109119c4b3d'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:50.810505 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-976595ce-7ff3-4cac-b77b-7753e9111bd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a4854f808eb4b4c907ae109119c4b3d'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:50.811414 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-976595ce-7ff3-4cac-b77b-7753e9111bd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a4854f808eb4b4c907ae109119c4b3d'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:50.821306 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-976595ce-7ff3-4cac-b77b-7753e9111bd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a4854f808eb4b4c907ae109119c4b3d'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:50.833534 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-976595ce-7ff3-4cac-b77b-7753e9111bd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a4854f808eb4b4c907ae109119c4b3d'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:50.864447 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ab7ab7ca-974b-4e52-814a-4b6782a17a5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f9a09482f994bdb98dc66efc83af3dd', 'request_id': 'req-ab7ab7ca-974b-4e52-814a-4b6782a17a5a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:50.877794 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ab7ab7ca-974b-4e52-814a-4b6782a17a5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f9a09482f994bdb98dc66efc83af3dd', 'request_id': 'req-ab7ab7ca-974b-4e52-814a-4b6782a17a5a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:50.884011 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1062/2096] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:44:50 2022] DELETE /identity/v3/users/8a4854f808eb4b4c907ae109119c4b3d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:50.886542 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc93e8a-6a2c-4dbf-a0ec-7494def62b99 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:50.886542 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc93e8a-6a2c-4dbf-a0ec-7494def62b99 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:50.886542 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc93e8a-6a2c-4dbf-a0ec-7494def62b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:50.897736 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ab7ab7ca-974b-4e52-814a-4b6782a17a5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f9a09482f994bdb98dc66efc83af3dd', 'request_id': 'req-ab7ab7ca-974b-4e52-814a-4b6782a17a5a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:50.916484 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-7fc93e8a-6a2c-4dbf-a0ec-7494def62b99 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:50.917724 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7fc93e8a-6a2c-4dbf-a0ec-7494def62b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:50.920809 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ab7ab7ca-974b-4e52-814a-4b6782a17a5a admin admin] The token cache is being invalidate because project 9f9a09482f994bdb98dc66efc83af3dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:44:50.921068 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ab7ab7ca-974b-4e52-814a-4b6782a17a5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:50.922345 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ab7ab7ca-974b-4e52-814a-4b6782a17a5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:50.927580 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1035/2097] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:44:50 2022] DELETE /identity/v3/projects/9f9a09482f994bdb98dc66efc83af3dd => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:44:50.939050 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ab7ca-974b-4e52-814a-4b6782a17a5a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:50.945631 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ab7ab7ca-974b-4e52-814a-4b6782a17a5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:51.026959 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1063/2098] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:51.037103 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc93e8a-6a2c-4dbf-a0ec-7494def62b99 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:51.038548 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7fc93e8a-6a2c-4dbf-a0ec-7494def62b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:51.079009 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ab7ca-974b-4e52-814a-4b6782a17a5a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:51.090303 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7af0b-05cd-40af-87f4-177f46edf844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:51.091409 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7af0b-05cd-40af-87f4-177f46edf844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:51.091695 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7af0b-05cd-40af-87f4-177f46edf844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:51.092146 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec7af0b-05cd-40af-87f4-177f46edf844 admin admin] PATH_INFO: `/v3/users/a67c202d4f6a4661b6e23dd4b11bef83` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:51.093517 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec7af0b-05cd-40af-87f4-177f46edf844 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a67c202d4f6a4661b6e23dd4b11bef83)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:51.095575 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec7af0b-05cd-40af-87f4-177f46edf844 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:51.096907 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:51.125075 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:51.136400 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc93e8a-6a2c-4dbf-a0ec-7494def62b99 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:51.143118 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59581f38-68d2-440f-80f6-313def740c18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:51.144432 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59581f38-68d2-440f-80f6-313def740c18 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:51.144727 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59581f38-68d2-440f-80f6-313def740c18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:51.145245 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59581f38-68d2-440f-80f6-313def740c18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:51.161078 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59581f38-68d2-440f-80f6-313def740c18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:51.163326 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59581f38-68d2-440f-80f6-313def740c18 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:51.167294 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-fec7af0b-05cd-40af-87f4-177f46edf844 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a67c202d4f6a4661b6e23dd4b11bef83'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:51.168219 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-fec7af0b-05cd-40af-87f4-177f46edf844 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a67c202d4f6a4661b6e23dd4b11bef83'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:51.169184 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-fec7af0b-05cd-40af-87f4-177f46edf844 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a67c202d4f6a4661b6e23dd4b11bef83'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:51.176247 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1064/2099] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 03:44:51.180478 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-fec7af0b-05cd-40af-87f4-177f46edf844 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a67c202d4f6a4661b6e23dd4b11bef83'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:51.195426 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-fec7af0b-05cd-40af-87f4-177f46edf844 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a67c202d4f6a4661b6e23dd4b11bef83'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:51.234806 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1036/2100] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:44:50 2022] DELETE /identity/v3/users/a67c202d4f6a4661b6e23dd4b11bef83 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:51.736458 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59581f38-68d2-440f-80f6-313def740c18 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:51.748494 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59581f38-68d2-440f-80f6-313def740c18 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:51.819893 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8af0a-f3c7-435f-ba18-a5968f990eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:51.820916 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8af0a-f3c7-435f-ba18-a5968f990eb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:51.821207 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8af0a-f3c7-435f-ba18-a5968f990eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:51.821519 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8af0a-f3c7-435f-ba18-a5968f990eb2 admin admin] PATH_INFO: `/v3/projects/1e59eb0238c844eca7a055a09606576c` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:51.822764 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f8af0a-f3c7-435f-ba18-a5968f990eb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e59eb0238c844eca7a055a09606576c)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:51.824774 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f8af0a-f3c7-435f-ba18-a5968f990eb2 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:51.830177 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7af0b-05cd-40af-87f4-177f46edf844 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:51.832934 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fec7af0b-05cd-40af-87f4-177f46edf844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:51.849649 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec7af0b-05cd-40af-87f4-177f46edf844 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:51.856171 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8afc3d9-705c-4c36-af24-0720dc84fc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:51.857182 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8afc3d9-705c-4c36-af24-0720dc84fc05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:51.857585 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8afc3d9-705c-4c36-af24-0720dc84fc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:51.857985 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8afc3d9-705c-4c36-af24-0720dc84fc05 admin admin] PATH_INFO: `/v3/projects/bdccfdf4facf48d681ff4337fbd6efe1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:51.859385 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8afc3d9-705c-4c36-af24-0720dc84fc05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdccfdf4facf48d681ff4337fbd6efe1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:51.861488 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8afc3d9-705c-4c36-af24-0720dc84fc05 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:51.909958 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a8f8af0a-f3c7-435f-ba18-a5968f990eb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e59eb0238c844eca7a055a09606576c', 'request_id': 'req-a8f8af0a-f3c7-435f-ba18-a5968f990eb2'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:51.919978 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a8f8af0a-f3c7-435f-ba18-a5968f990eb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e59eb0238c844eca7a055a09606576c', 'request_id': 'req-a8f8af0a-f3c7-435f-ba18-a5968f990eb2'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:51.928716 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a8f8af0a-f3c7-435f-ba18-a5968f990eb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e59eb0238c844eca7a055a09606576c', 'request_id': 'req-a8f8af0a-f3c7-435f-ba18-a5968f990eb2'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:51.934917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f8afc3d9-705c-4c36-af24-0720dc84fc05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdccfdf4facf48d681ff4337fbd6efe1', 'request_id': 'req-f8afc3d9-705c-4c36-af24-0720dc84fc05'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:51.942845 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f8afc3d9-705c-4c36-af24-0720dc84fc05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdccfdf4facf48d681ff4337fbd6efe1', 'request_id': 'req-f8afc3d9-705c-4c36-af24-0720dc84fc05'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:51.943043 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a8f8af0a-f3c7-435f-ba18-a5968f990eb2 admin admin] The token cache is being invalidate because project 1e59eb0238c844eca7a055a09606576c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:44:51.943323 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a8f8af0a-f3c7-435f-ba18-a5968f990eb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:51.944188 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a8f8af0a-f3c7-435f-ba18-a5968f990eb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:51.947412 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1065/2101] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:44:51 2022] DELETE /identity/v3/projects/1e59eb0238c844eca7a055a09606576c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:51.951924 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90586dcd-6580-438b-bbb5-245583253d26 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:51.952222 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90586dcd-6580-438b-bbb5-245583253d26 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:51.952784 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90586dcd-6580-438b-bbb5-245583253d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:51.973242 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f8afc3d9-705c-4c36-af24-0720dc84fc05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdccfdf4facf48d681ff4337fbd6efe1', 'request_id': 'req-f8afc3d9-705c-4c36-af24-0720dc84fc05'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:51.990965 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-90586dcd-6580-438b-bbb5-245583253d26 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:51.992451 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-90586dcd-6580-438b-bbb5-245583253d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:51.995270 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f8afc3d9-705c-4c36-af24-0720dc84fc05 admin admin] The token cache is being invalidate because project bdccfdf4facf48d681ff4337fbd6efe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:44:51.995995 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f8afc3d9-705c-4c36-af24-0720dc84fc05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:51.996991 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f8afc3d9-705c-4c36-af24-0720dc84fc05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:51.999089 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1037/2102] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:44:51 2022] DELETE /identity/v3/projects/bdccfdf4facf48d681ff4337fbd6efe1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:44:52.005918 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8afc3d9-705c-4c36-af24-0720dc84fc05 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:52.007671 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f8afc3d9-705c-4c36-af24-0720dc84fc05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:52.091322 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1066/2103] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:52.099569 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b9000-72ca-428d-836e-9d27b3d2956d None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:52.099860 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b9000-72ca-428d-836e-9d27b3d2956d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:52.100297 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719b9000-72ca-428d-836e-9d27b3d2956d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:52.106363 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8afc3d9-705c-4c36-af24-0720dc84fc05 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:52.111538 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dced285-aa19-4b25-a8a9-9e77342f325c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:52.112557 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dced285-aa19-4b25-a8a9-9e77342f325c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:52.112916 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dced285-aa19-4b25-a8a9-9e77342f325c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:52.113277 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dced285-aa19-4b25-a8a9-9e77342f325c admin admin] PATH_INFO: `/v3/users/bb94c986f14344f5ae80136a0ddd4a28` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:52.114631 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dced285-aa19-4b25-a8a9-9e77342f325c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb94c986f14344f5ae80136a0ddd4a28)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:52.117404 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:52.118247 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dced285-aa19-4b25-a8a9-9e77342f325c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:52.160530 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-719b9000-72ca-428d-836e-9d27b3d2956d None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:52.162321 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-719b9000-72ca-428d-836e-9d27b3d2956d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:52.173851 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:52.177076 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1067/2104] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:52.181455 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b9000-72ca-428d-836e-9d27b3d2956d None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:52.192236 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719b9000-72ca-428d-836e-9d27b3d2956d None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:52.198901 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224901d7-0541-4b2e-b48d-e0e90cf464ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:52.201219 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224901d7-0541-4b2e-b48d-e0e90cf464ba admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:52.201641 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224901d7-0541-4b2e-b48d-e0e90cf464ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:52.201998 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224901d7-0541-4b2e-b48d-e0e90cf464ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:52.202956 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224901d7-0541-4b2e-b48d-e0e90cf464ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:44:52.203306 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224901d7-0541-4b2e-b48d-e0e90cf464ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:52.205165 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224901d7-0541-4b2e-b48d-e0e90cf464ba admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:52.213623 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2dced285-aa19-4b25-a8a9-9e77342f325c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb94c986f14344f5ae80136a0ddd4a28'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:52.214888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2dced285-aa19-4b25-a8a9-9e77342f325c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb94c986f14344f5ae80136a0ddd4a28'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:52.215676 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2dced285-aa19-4b25-a8a9-9e77342f325c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb94c986f14344f5ae80136a0ddd4a28'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:52.223913 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1068/2105] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:44:52.228477 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224901d7-0541-4b2e-b48d-e0e90cf464ba admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:52.229337 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2dced285-aa19-4b25-a8a9-9e77342f325c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb94c986f14344f5ae80136a0ddd4a28'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:52.231570 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-224901d7-0541-4b2e-b48d-e0e90cf464ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:52.240883 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2dced285-aa19-4b25-a8a9-9e77342f325c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb94c986f14344f5ae80136a0ddd4a28'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:52.249656 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224901d7-0541-4b2e-b48d-e0e90cf464ba admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:52.258265 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c7d78-de14-4358-a146-45773b5de3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:52.259060 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c7d78-de14-4358-a146-45773b5de3e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:52.259423 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c7d78-de14-4358-a146-45773b5de3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:52.259776 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c7d78-de14-4358-a146-45773b5de3e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:52.260604 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c7d78-de14-4358-a146-45773b5de3e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:52.263288 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2c7d78-de14-4358-a146-45773b5de3e8 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:52.294311 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1038/2106] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:44:52 2022] DELETE /identity/v3/users/bb94c986f14344f5ae80136a0ddd4a28 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:52.295415 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dced285-aa19-4b25-a8a9-9e77342f325c admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:52.296911 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2dced285-aa19-4b25-a8a9-9e77342f325c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:52.309251 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1069/2107] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:44:52 2022] POST /identity/v3/projects => generated 367 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:44:52.313293 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c7d78-de14-4358-a146-45773b5de3e8 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:52.419056 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2c7d78-de14-4358-a146-45773b5de3e8 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:52.426176 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41659293-e997-406a-818f-267ce5edafca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:52.426904 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41659293-e997-406a-818f-267ce5edafca admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:52.427407 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41659293-e997-406a-818f-267ce5edafca admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:52.427775 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41659293-e997-406a-818f-267ce5edafca admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:52.428543 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41659293-e997-406a-818f-267ce5edafca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:52.430557 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41659293-e997-406a-818f-267ce5edafca admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:52.481456 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dced285-aa19-4b25-a8a9-9e77342f325c admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:52.488888 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1070/2108] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:44:52 2022] POST /identity/v3/users => generated 284 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:52.490991 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f47f4-a089-4b08-be8a-49605cf96cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:52.492354 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f47f4-a089-4b08-be8a-49605cf96cd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:52.493470 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41659293-e997-406a-818f-267ce5edafca admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:52.495053 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f47f4-a089-4b08-be8a-49605cf96cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:52.499319 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f47f4-a089-4b08-be8a-49605cf96cd2 admin admin] PATH_INFO: `/v3/projects/0a27dd3f60ad424abc51b1477f3b12ed` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:52.501466 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f47f4-a089-4b08-be8a-49605cf96cd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a27dd3f60ad424abc51b1477f3b12ed)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:52.505147 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f47f4-a089-4b08-be8a-49605cf96cd2 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:52.510239 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41659293-e997-406a-818f-267ce5edafca admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:52.515939 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245290c7-d36e-4181-b851-5341ef182216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:52.516655 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245290c7-d36e-4181-b851-5341ef182216 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:52.517518 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245290c7-d36e-4181-b851-5341ef182216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:52.517798 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245290c7-d36e-4181-b851-5341ef182216 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:52.518794 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245290c7-d36e-4181-b851-5341ef182216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:52.520655 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245290c7-d36e-4181-b851-5341ef182216 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:52.536343 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1071/2109] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:52 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:52.537238 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245290c7-d36e-4181-b851-5341ef182216 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:52.542961 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-245290c7-d36e-4181-b851-5341ef182216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:52.561588 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245290c7-d36e-4181-b851-5341ef182216 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:52.578172 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b20f47f4-a089-4b08-be8a-49605cf96cd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a27dd3f60ad424abc51b1477f3b12ed', 'request_id': 'req-b20f47f4-a089-4b08-be8a-49605cf96cd2'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:52.587415 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b20f47f4-a089-4b08-be8a-49605cf96cd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a27dd3f60ad424abc51b1477f3b12ed', 'request_id': 'req-b20f47f4-a089-4b08-be8a-49605cf96cd2'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:52.598145 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b20f47f4-a089-4b08-be8a-49605cf96cd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a27dd3f60ad424abc51b1477f3b12ed', 'request_id': 'req-b20f47f4-a089-4b08-be8a-49605cf96cd2'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:52.613636 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b20f47f4-a089-4b08-be8a-49605cf96cd2 admin admin] The token cache is being invalidate because project 0a27dd3f60ad424abc51b1477f3b12ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:44:52.614392 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b20f47f4-a089-4b08-be8a-49605cf96cd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:52.615252 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b20f47f4-a089-4b08-be8a-49605cf96cd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:52.621829 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1039/2110] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:44:52 2022] DELETE /identity/v3/projects/0a27dd3f60ad424abc51b1477f3b12ed => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:52.622759 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f47f4-a089-4b08-be8a-49605cf96cd2 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:52.625152 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b20f47f4-a089-4b08-be8a-49605cf96cd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:52.664927 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d268b-c1fc-46ad-a792-35f5a9890c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:52.666200 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d268b-c1fc-46ad-a792-35f5a9890c66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:52.666724 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d268b-c1fc-46ad-a792-35f5a9890c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:52.667202 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d268b-c1fc-46ad-a792-35f5a9890c66 admin admin] PATH_INFO: `/v3/users/8b5054e541e14a228e8d52ae585b20a5` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:52.669884 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:52.672104 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d268b-c1fc-46ad-a792-35f5a9890c66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b5054e541e14a228e8d52ae585b20a5)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:52.676973 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d268b-c1fc-46ad-a792-35f5a9890c66 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:52.749598 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f47f4-a089-4b08-be8a-49605cf96cd2 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:52.756270 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e59bcf-948c-4276-9922-9858076b53f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:52.757907 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e59bcf-948c-4276-9922-9858076b53f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:52.758715 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e59bcf-948c-4276-9922-9858076b53f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:52.758859 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e59bcf-948c-4276-9922-9858076b53f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:52.760044 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e59bcf-948c-4276-9922-9858076b53f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:52.762662 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e59bcf-948c-4276-9922-9858076b53f4 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:52.785714 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:52.789051 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1040/2111] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:52 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:52.790248 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fa3d268b-c1fc-46ad-a792-35f5a9890c66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b5054e541e14a228e8d52ae585b20a5'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:52.791521 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fa3d268b-c1fc-46ad-a792-35f5a9890c66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b5054e541e14a228e8d52ae585b20a5'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:52.792674 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fa3d268b-c1fc-46ad-a792-35f5a9890c66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b5054e541e14a228e8d52ae585b20a5'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:52.799164 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3375bb5-f1c6-413d-aa22-e8cc04727e04 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:52.800305 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3375bb5-f1c6-413d-aa22-e8cc04727e04 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:52.801720 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3375bb5-f1c6-413d-aa22-e8cc04727e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:52.808570 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fa3d268b-c1fc-46ad-a792-35f5a9890c66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b5054e541e14a228e8d52ae585b20a5'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:52.822770 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fa3d268b-c1fc-46ad-a792-35f5a9890c66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b5054e541e14a228e8d52ae585b20a5'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:52.830261 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c3375bb5-f1c6-413d-aa22-e8cc04727e04 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:52.834568 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c3375bb5-f1c6-413d-aa22-e8cc04727e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:52.854838 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1072/2112] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:44:52 2022] DELETE /identity/v3/users/8b5054e541e14a228e8d52ae585b20a5 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:52.855733 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1041/2113] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:52.856411 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d268b-c1fc-46ad-a792-35f5a9890c66 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:52.866959 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-fa3d268b-c1fc-46ad-a792-35f5a9890c66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:52.869916 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88544e-3606-4f69-a205-108acd1c7386 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:52.871114 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88544e-3606-4f69-a205-108acd1c7386 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:52.871836 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88544e-3606-4f69-a205-108acd1c7386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:52.921995 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ba88544e-3606-4f69-a205-108acd1c7386 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:52.923275 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ba88544e-3606-4f69-a205-108acd1c7386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:53.010395 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d268b-c1fc-46ad-a792-35f5a9890c66 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:53.016368 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc142b07-0fc2-4fc2-bdb8-0dc10706a0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:53.017107 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc142b07-0fc2-4fc2-bdb8-0dc10706a0c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:53.017464 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc142b07-0fc2-4fc2-bdb8-0dc10706a0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:53.017850 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc142b07-0fc2-4fc2-bdb8-0dc10706a0c0 admin admin] PATH_INFO: `/v3/projects/41b9a09f83de41f6b4a35f288849f391/users/883edde097a44e16846f89fa73eaf359/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:53.022490 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1042/2114] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:53.023941 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba88544e-3606-4f69-a205-108acd1c7386 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:53.025502 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ba88544e-3606-4f69-a205-108acd1c7386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:53.042413 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc142b07-0fc2-4fc2-bdb8-0dc10706a0c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41b9a09f83de41f6b4a35f288849f391, user_id=883edde097a44e16846f89fa73eaf359, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:53.042867 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba88544e-3606-4f69-a205-108acd1c7386 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:53.045571 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc142b07-0fc2-4fc2-bdb8-0dc10706a0c0 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:53.048786 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd1296-a7fc-406d-8bcb-8e0a8af0b63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:53.051752 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd1296-a7fc-406d-8bcb-8e0a8af0b63f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:53.052268 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd1296-a7fc-406d-8bcb-8e0a8af0b63f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:53.052810 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd1296-a7fc-406d-8bcb-8e0a8af0b63f admin admin] PATH_INFO: `/v3/projects/1f61148955104208b519488a08668eb0` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:53.054532 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd1296-a7fc-406d-8bcb-8e0a8af0b63f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f61148955104208b519488a08668eb0)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:53.056952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd1296-a7fc-406d-8bcb-8e0a8af0b63f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:53.084802 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1073/2115] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:44:52 2022] PUT /identity/v3/projects/41b9a09f83de41f6b4a35f288849f391/users/883edde097a44e16846f89fa73eaf359/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:53.084802 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0fab3-060a-43ac-98b3-46460545430a None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:53.084802 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0fab3-060a-43ac-98b3-46460545430a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:53.084802 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0fab3-060a-43ac-98b3-46460545430a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:53.107142 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-6ea0fab3-060a-43ac-98b3-46460545430a None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:53.109576 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6ea0fab3-060a-43ac-98b3-46460545430a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:53.154828 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-95bd1296-a7fc-406d-8bcb-8e0a8af0b63f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f61148955104208b519488a08668eb0', 'request_id': 'req-95bd1296-a7fc-406d-8bcb-8e0a8af0b63f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:53.178086 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-95bd1296-a7fc-406d-8bcb-8e0a8af0b63f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f61148955104208b519488a08668eb0', 'request_id': 'req-95bd1296-a7fc-406d-8bcb-8e0a8af0b63f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:53.193294 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-95bd1296-a7fc-406d-8bcb-8e0a8af0b63f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f61148955104208b519488a08668eb0', 'request_id': 'req-95bd1296-a7fc-406d-8bcb-8e0a8af0b63f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:53.204104 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1074/2116] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:53.205117 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0fab3-060a-43ac-98b3-46460545430a None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:53.209916 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6ea0fab3-060a-43ac-98b3-46460545430a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:53.215389 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-95bd1296-a7fc-406d-8bcb-8e0a8af0b63f admin admin] The token cache is being invalidate because project 1f61148955104208b519488a08668eb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:44:53.215689 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-95bd1296-a7fc-406d-8bcb-8e0a8af0b63f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:53.217107 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-95bd1296-a7fc-406d-8bcb-8e0a8af0b63f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:53.219077 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1043/2117] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:44:53 2022] DELETE /identity/v3/projects/1f61148955104208b519488a08668eb0 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:53.220132 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de9048-4373-4b76-8864-f790f972f62d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:53.220422 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de9048-4373-4b76-8864-f790f972f62d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:53.220703 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de9048-4373-4b76-8864-f790f972f62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:53.253972 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-82de9048-4373-4b76-8864-f790f972f62d None None] MFA Rules not processed for user `883edde097a44e16846f89fa73eaf359`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:53.255286 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-82de9048-4373-4b76-8864-f790f972f62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:53.287307 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:53.304238 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:53.311277 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0fab3-060a-43ac-98b3-46460545430a None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:53.371393 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1044/2118] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:53 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:53.372592 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de9048-4373-4b76-8864-f790f972f62d None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:53.374156 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-82de9048-4373-4b76-8864-f790f972f62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:53.390479 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e56d0f-b507-4514-b557-c1266a12e10b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:53.391503 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e56d0f-b507-4514-b557-c1266a12e10b service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:53.391957 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e56d0f-b507-4514-b557-c1266a12e10b service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:53.392418 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e56d0f-b507-4514-b557-c1266a12e10b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:53.395108 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-34e56d0f-b507-4514-b557-c1266a12e10b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:53.510635 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e56d0f-b507-4514-b557-c1266a12e10b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:53.513162 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e56d0f-b507-4514-b557-c1266a12e10b service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:53.540536 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1075/2119] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:44:53.541723 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e56d0f-b507-4514-b557-c1266a12e10b service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:53.545853 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-34e56d0f-b507-4514-b557-c1266a12e10b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:53.554324 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de9048-4373-4b76-8864-f790f972f62d None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:53.565299 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb774c-40c2-449f-ac6f-db4def90dcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:53.566342 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e56d0f-b507-4514-b557-c1266a12e10b service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:53.566981 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb774c-40c2-449f-ac6f-db4def90dcae admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:53.567821 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb774c-40c2-449f-ac6f-db4def90dcae admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:53.568312 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb774c-40c2-449f-ac6f-db4def90dcae admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:53.569548 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fb774c-40c2-449f-ac6f-db4def90dcae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:44:53.570099 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fb774c-40c2-449f-ac6f-db4def90dcae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:53.571422 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc55df0-af93-4409-8b18-5d4723253787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:53.572454 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc55df0-af93-4409-8b18-5d4723253787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:53.572741 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc55df0-af93-4409-8b18-5d4723253787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:53.572860 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fb774c-40c2-449f-ac6f-db4def90dcae admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:53.573021 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc55df0-af93-4409-8b18-5d4723253787 admin admin] PATH_INFO: `/v3/users/1022ed731cb042be8f0ed2c830df437c` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:53.574301 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc55df0-af93-4409-8b18-5d4723253787 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1022ed731cb042be8f0ed2c830df437c)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:53.576931 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc55df0-af93-4409-8b18-5d4723253787 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:53.623589 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1045/2120] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:44:53.623589 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb774c-40c2-449f-ac6f-db4def90dcae admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:53.623589 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e2fb774c-40c2-449f-ac6f-db4def90dcae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:53.662552 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb774c-40c2-449f-ac6f-db4def90dcae admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:53.675875 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-adc55df0-af93-4409-8b18-5d4723253787 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1022ed731cb042be8f0ed2c830df437c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:53.676711 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42983f5e-8d3e-47d9-925a-19ba256a01c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:53.677114 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-adc55df0-af93-4409-8b18-5d4723253787 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1022ed731cb042be8f0ed2c830df437c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:53.678144 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-adc55df0-af93-4409-8b18-5d4723253787 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1022ed731cb042be8f0ed2c830df437c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:53.679833 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42983f5e-8d3e-47d9-925a-19ba256a01c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:53.680186 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42983f5e-8d3e-47d9-925a-19ba256a01c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:53.680621 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42983f5e-8d3e-47d9-925a-19ba256a01c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:53.681642 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42983f5e-8d3e-47d9-925a-19ba256a01c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:53.686573 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42983f5e-8d3e-47d9-925a-19ba256a01c7 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:53.694895 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-adc55df0-af93-4409-8b18-5d4723253787 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1022ed731cb042be8f0ed2c830df437c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:53.714104 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-adc55df0-af93-4409-8b18-5d4723253787 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1022ed731cb042be8f0ed2c830df437c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:53.771248 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1046/2121] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:44:53 2022] POST /identity/v3/projects => generated 367 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:53.772333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42983f5e-8d3e-47d9-925a-19ba256a01c7 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:53.778732 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1076/2122] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:44:53 2022] DELETE /identity/v3/users/1022ed731cb042be8f0ed2c830df437c => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:53.778732 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc55df0-af93-4409-8b18-5d4723253787 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:53.780093 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-adc55df0-af93-4409-8b18-5d4723253787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:53.780446 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-42983f5e-8d3e-47d9-925a-19ba256a01c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:53.851710 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:53.940308 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc55df0-af93-4409-8b18-5d4723253787 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:53.952159 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e856aa-8cb8-4c6a-832f-2f575e5165ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:53.953521 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42983f5e-8d3e-47d9-925a-19ba256a01c7 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:53.954149 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e856aa-8cb8-4c6a-832f-2f575e5165ca admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:53.955016 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e856aa-8cb8-4c6a-832f-2f575e5165ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:53.955293 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e856aa-8cb8-4c6a-832f-2f575e5165ca admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:53.957614 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e856aa-8cb8-4c6a-832f-2f575e5165ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:53.961696 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e856aa-8cb8-4c6a-832f-2f575e5165ca admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:53.969926 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e705f9fa-87e9-4437-9e46-7b543816404b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:53.972404 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705f9fa-87e9-4437-9e46-7b543816404b admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:53.972694 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705f9fa-87e9-4437-9e46-7b543816404b admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:53.972969 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705f9fa-87e9-4437-9e46-7b543816404b admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:53.974845 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e705f9fa-87e9-4437-9e46-7b543816404b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:53.981167 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e705f9fa-87e9-4437-9e46-7b543816404b admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:54.017003 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1077/2123] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:44:53 2022] POST /identity/v3/users => generated 290 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:54.019737 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e856aa-8cb8-4c6a-832f-2f575e5165ca admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:54.038702 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e856aa-8cb8-4c6a-832f-2f575e5165ca admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:54.045257 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d1ebd-dbe1-4a73-9e5b-607320ccfb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:54.046106 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d1ebd-dbe1-4a73-9e5b-607320ccfb37 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:54.046482 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d1ebd-dbe1-4a73-9e5b-607320ccfb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:54.047009 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7d1ebd-dbe1-4a73-9e5b-607320ccfb37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:54.048094 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1047/2124] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:44:53 2022] POST /identity/v3/projects => generated 373 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:54.051636 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7d1ebd-dbe1-4a73-9e5b-607320ccfb37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:54.052249 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e705f9fa-87e9-4437-9e46-7b543816404b admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:54.053589 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7d1ebd-dbe1-4a73-9e5b-607320ccfb37 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:54.072720 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1078/2125] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:54.074400 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d1ebd-dbe1-4a73-9e5b-607320ccfb37 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:54.098104 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7d1ebd-dbe1-4a73-9e5b-607320ccfb37 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:54.111924 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:54.180409 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e705f9fa-87e9-4437-9e46-7b543816404b admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:54.199136 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586d735-e38f-4998-9765-d87080482b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:54.199789 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586d735-e38f-4998-9765-d87080482b4b admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:54.200119 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586d735-e38f-4998-9765-d87080482b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:54.200359 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586d735-e38f-4998-9765-d87080482b4b admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:54.201073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e586d735-e38f-4998-9765-d87080482b4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:54.203215 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e586d735-e38f-4998-9765-d87080482b4b admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:54.230955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00b38d-50bf-4c8d-b25e-fa27ff10edda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:54.233954 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00b38d-50bf-4c8d-b25e-fa27ff10edda admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:54.236071 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00b38d-50bf-4c8d-b25e-fa27ff10edda admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:54.236272 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad00b38d-50bf-4c8d-b25e-fa27ff10edda admin admin] PATH_INFO: `/v3/projects/fc79593965564c9a8ddabea2a67fc287/users/b11566dd305f4153bf952cac7dcdd61d/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:54.244399 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1048/2126] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:44:54 2022] POST /identity/v3/users => generated 287 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:44:54.249030 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586d735-e38f-4998-9765-d87080482b4b admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:54.264710 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad00b38d-50bf-4c8d-b25e-fa27ff10edda admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc79593965564c9a8ddabea2a67fc287, user_id=b11566dd305f4153bf952cac7dcdd61d, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:54.272865 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586d735-e38f-4998-9765-d87080482b4b admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:54.278861 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6e2b8-1cea-4701-aedb-e18eb5556966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:54.279557 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6e2b8-1cea-4701-aedb-e18eb5556966 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:54.279843 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6e2b8-1cea-4701-aedb-e18eb5556966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:54.280126 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6e2b8-1cea-4701-aedb-e18eb5556966 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:54.280888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6e2b8-1cea-4701-aedb-e18eb5556966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:54.283420 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6e2b8-1cea-4701-aedb-e18eb5556966 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:54.283749 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad00b38d-50bf-4c8d-b25e-fa27ff10edda admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:54.307189 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1049/2127] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 03:44:54.308306 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6e2b8-1cea-4701-aedb-e18eb5556966 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:54.323289 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6e2b8-1cea-4701-aedb-e18eb5556966 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:54.328489 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1079/2128] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:44:54 2022] PUT /identity/v3/projects/fc79593965564c9a8ddabea2a67fc287/users/b11566dd305f4153bf952cac7dcdd61d/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:44:54.329485 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00b38d-50bf-4c8d-b25e-fa27ff10edda admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:54.452128 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad00b38d-50bf-4c8d-b25e-fa27ff10edda admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:54.458910 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b01b169-87f6-4425-ae51-780bd7250118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:54.459605 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01b169-87f6-4425-ae51-780bd7250118 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:54.459885 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01b169-87f6-4425-ae51-780bd7250118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:54.460167 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01b169-87f6-4425-ae51-780bd7250118 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:54.460914 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b01b169-87f6-4425-ae51-780bd7250118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:54.464595 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b01b169-87f6-4425-ae51-780bd7250118 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:54.476482 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1080/2129] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:54.481008 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b01b169-87f6-4425-ae51-780bd7250118 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:54.481323 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedadc0c-8b49-47a5-940c-7d85ed198bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:54.482530 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedadc0c-8b49-47a5-940c-7d85ed198bee admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:54.483053 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedadc0c-8b49-47a5-940c-7d85ed198bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:54.483549 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedadc0c-8b49-47a5-940c-7d85ed198bee admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:54.484510 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedadc0c-8b49-47a5-940c-7d85ed198bee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:54.486360 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedadc0c-8b49-47a5-940c-7d85ed198bee admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:54.494527 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b01b169-87f6-4425-ae51-780bd7250118 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:54.500517 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc00161-5ec2-4e8e-910e-16c0426b32ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:54.501600 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc00161-5ec2-4e8e-910e-16c0426b32ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:54.502055 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc00161-5ec2-4e8e-910e-16c0426b32ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:54.502490 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc00161-5ec2-4e8e-910e-16c0426b32ab admin admin] PATH_INFO: `/v3/projects/fc79593965564c9a8ddabea2a67fc287/users/b11566dd305f4153bf952cac7dcdd61d/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:54.505844 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc00161-5ec2-4e8e-910e-16c0426b32ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc79593965564c9a8ddabea2a67fc287, user_id=b11566dd305f4153bf952cac7dcdd61d, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:54.509543 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc00161-5ec2-4e8e-910e-16c0426b32ab admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:54.530162 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1050/2131] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:54 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:54.537871 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1081/2131] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:44:54 2022] PUT /identity/v3/projects/fc79593965564c9a8ddabea2a67fc287/users/b11566dd305f4153bf952cac7dcdd61d/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:54.538421 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82127832-9a88-4773-9c15-cc24f3876839 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:54.538750 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82127832-9a88-4773-9c15-cc24f3876839 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:54.538858 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc00161-5ec2-4e8e-910e-16c0426b32ab admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:54.539080 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82127832-9a88-4773-9c15-cc24f3876839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:54.552001 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:54.585374 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-82127832-9a88-4773-9c15-cc24f3876839 None None] MFA Rules not processed for user `b11566dd305f4153bf952cac7dcdd61d`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:54.586784 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-82127832-9a88-4773-9c15-cc24f3876839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:54.671554 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc00161-5ec2-4e8e-910e-16c0426b32ab admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:54.684343 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027fab2-bbbe-433b-b817-88d259d7d0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:54.686231 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027fab2-bbbe-433b-b817-88d259d7d0c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:54.687112 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027fab2-bbbe-433b-b817-88d259d7d0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:54.687486 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027fab2-bbbe-433b-b817-88d259d7d0c8 admin admin] PATH_INFO: `/v3/projects/578f033403fb47b28ba60507e45f91fc/users/fd6b6962b0444de29047dbdbdc49ab7f/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:54.702077 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1051/2132] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:54 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:44:54.719618 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8027fab2-bbbe-433b-b817-88d259d7d0c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=578f033403fb47b28ba60507e45f91fc, user_id=fd6b6962b0444de29047dbdbdc49ab7f, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:54.722505 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8027fab2-bbbe-433b-b817-88d259d7d0c8 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:54.723565 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82127832-9a88-4773-9c15-cc24f3876839 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:54.724986 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-82127832-9a88-4773-9c15-cc24f3876839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:54.750742 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1082/2133] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:44:54 2022] PUT /identity/v3/projects/578f033403fb47b28ba60507e45f91fc/users/fd6b6962b0444de29047dbdbdc49ab7f/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:54.765269 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0569ed5-a0cf-4e2f-985f-e3c9339c31b6 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:54.765618 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0569ed5-a0cf-4e2f-985f-e3c9339c31b6 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:54.765909 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0569ed5-a0cf-4e2f-985f-e3c9339c31b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:54.834943 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:54.852738 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d0569ed5-a0cf-4e2f-985f-e3c9339c31b6 None None] MFA Rules not processed for user `fd6b6962b0444de29047dbdbdc49ab7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:54.854002 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d0569ed5-a0cf-4e2f-985f-e3c9339c31b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:54.882581 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82127832-9a88-4773-9c15-cc24f3876839 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:54.978598 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca21ce-1afb-4e95-b5e1-18c4914c7d49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:54.981211 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca21ce-1afb-4e95-b5e1-18c4914c7d49 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:54.982246 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca21ce-1afb-4e95-b5e1-18c4914c7d49 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:54.983644 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca21ce-1afb-4e95-b5e1-18c4914c7d49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:55.003860 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1083/2134] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:55.004796 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0569ed5-a0cf-4e2f-985f-e3c9339c31b6 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:55.006808 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d0569ed5-a0cf-4e2f-985f-e3c9339c31b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:55.139971 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca21ce-1afb-4e95-b5e1-18c4914c7d49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:55.141773 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca21ce-1afb-4e95-b5e1-18c4914c7d49 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:55.142044 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0569ed5-a0cf-4e2f-985f-e3c9339c31b6 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:55.156574 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80271e0d-baf1-44a7-8fc3-0e70435023b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:55.157834 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80271e0d-baf1-44a7-8fc3-0e70435023b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:55.158014 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80271e0d-baf1-44a7-8fc3-0e70435023b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:55.158226 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1052/2135] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:54 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 03:44:55.159640 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca21ce-1afb-4e95-b5e1-18c4914c7d49 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:55.161201 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3cca21ce-1afb-4e95-b5e1-18c4914c7d49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:55.167561 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80271e0d-baf1-44a7-8fc3-0e70435023b6 admin admin] PATH_INFO: `/v3/projects/629233f926c94533a17964b3c56d9884` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:55.169960 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80271e0d-baf1-44a7-8fc3-0e70435023b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=629233f926c94533a17964b3c56d9884)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:55.174004 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80271e0d-baf1-44a7-8fc3-0e70435023b6 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:55.183028 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca21ce-1afb-4e95-b5e1-18c4914c7d49 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:55.195934 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d1ba4-81a4-4dbd-b2ac-46caba23262c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:55.196886 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d1ba4-81a4-4dbd-b2ac-46caba23262c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:55.197323 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d1ba4-81a4-4dbd-b2ac-46caba23262c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:55.197688 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5d1ba4-81a4-4dbd-b2ac-46caba23262c admin admin] PATH_INFO: `/v3/projects/bb7268293a70480f81d59f0cd770d082` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:55.199157 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d1ba4-81a4-4dbd-b2ac-46caba23262c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb7268293a70480f81d59f0cd770d082)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:55.202016 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5d1ba4-81a4-4dbd-b2ac-46caba23262c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:55.235330 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:55.277044 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-80271e0d-baf1-44a7-8fc3-0e70435023b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '629233f926c94533a17964b3c56d9884', 'request_id': 'req-80271e0d-baf1-44a7-8fc3-0e70435023b6'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:55.280432 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9b5d1ba4-81a4-4dbd-b2ac-46caba23262c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb7268293a70480f81d59f0cd770d082', 'request_id': 'req-9b5d1ba4-81a4-4dbd-b2ac-46caba23262c'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:55.285860 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-80271e0d-baf1-44a7-8fc3-0e70435023b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '629233f926c94533a17964b3c56d9884', 'request_id': 'req-80271e0d-baf1-44a7-8fc3-0e70435023b6'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:55.289061 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9b5d1ba4-81a4-4dbd-b2ac-46caba23262c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb7268293a70480f81d59f0cd770d082', 'request_id': 'req-9b5d1ba4-81a4-4dbd-b2ac-46caba23262c'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:55.300374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-80271e0d-baf1-44a7-8fc3-0e70435023b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '629233f926c94533a17964b3c56d9884', 'request_id': 'req-80271e0d-baf1-44a7-8fc3-0e70435023b6'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:55.304211 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9b5d1ba4-81a4-4dbd-b2ac-46caba23262c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb7268293a70480f81d59f0cd770d082', 'request_id': 'req-9b5d1ba4-81a4-4dbd-b2ac-46caba23262c'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:55.325626 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9b5d1ba4-81a4-4dbd-b2ac-46caba23262c admin admin] The token cache is being invalidate because project bb7268293a70480f81d59f0cd770d082 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:44:55.325936 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9b5d1ba4-81a4-4dbd-b2ac-46caba23262c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:55.327749 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9b5d1ba4-81a4-4dbd-b2ac-46caba23262c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:55.337732 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-80271e0d-baf1-44a7-8fc3-0e70435023b6 admin admin] The token cache is being invalidate because project 629233f926c94533a17964b3c56d9884 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:44:55.338079 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1053/2136] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:44:55 2022] DELETE /identity/v3/projects/bb7268293a70480f81d59f0cd770d082 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:55.339342 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d1ba4-81a4-4dbd-b2ac-46caba23262c admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:55.342289 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9b5d1ba4-81a4-4dbd-b2ac-46caba23262c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:55.343248 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-80271e0d-baf1-44a7-8fc3-0e70435023b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:55.345306 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-80271e0d-baf1-44a7-8fc3-0e70435023b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:55.352970 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1084/2137] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:44:55 2022] DELETE /identity/v3/projects/629233f926c94533a17964b3c56d9884 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:55.356897 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80271e0d-baf1-44a7-8fc3-0e70435023b6 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:55.358244 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-80271e0d-baf1-44a7-8fc3-0e70435023b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:55.377093 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:55.437948 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5d1ba4-81a4-4dbd-b2ac-46caba23262c admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:55.443204 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff6b6e6-6c89-4cad-a597-fc35daff08ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:55.445358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6b6e6-6c89-4cad-a597-fc35daff08ef service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:55.445685 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6b6e6-6c89-4cad-a597-fc35daff08ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:55.446033 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff6b6e6-6c89-4cad-a597-fc35daff08ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:55.459245 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4ff6b6e6-6c89-4cad-a597-fc35daff08ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:55.547591 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff6b6e6-6c89-4cad-a597-fc35daff08ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:55.549173 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff6b6e6-6c89-4cad-a597-fc35daff08ef service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:55.560499 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80271e0d-baf1-44a7-8fc3-0e70435023b6 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:55.566840 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1054/2138] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:44:55.568657 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068127c6-0493-40ff-a1b2-0bd930a04b7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:55.572829 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068127c6-0493-40ff-a1b2-0bd930a04b7d service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:55.572829 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068127c6-0493-40ff-a1b2-0bd930a04b7d service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:55.572829 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068127c6-0493-40ff-a1b2-0bd930a04b7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:55.576261 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-068127c6-0493-40ff-a1b2-0bd930a04b7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:55.577773 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3f294-2c44-4446-98ec-11d9db19a2a9 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:55.578610 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3f294-2c44-4446-98ec-11d9db19a2a9 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:55.583019 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3f294-2c44-4446-98ec-11d9db19a2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:55.620679 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-9dd3f294-2c44-4446-98ec-11d9db19a2a9 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:55.629227 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9dd3f294-2c44-4446-98ec-11d9db19a2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:55.719385 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068127c6-0493-40ff-a1b2-0bd930a04b7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:55.720859 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068127c6-0493-40ff-a1b2-0bd930a04b7d service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:55.743331 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1085/2139] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:55 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:44:55.757907 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6920e0-8b3f-45d9-b8be-e251cdc67d93 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:55.758217 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6920e0-8b3f-45d9-b8be-e251cdc67d93 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:55.758531 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6920e0-8b3f-45d9-b8be-e251cdc67d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:55.793218 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-2b6920e0-8b3f-45d9-b8be-e251cdc67d93 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:55.794740 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2b6920e0-8b3f-45d9-b8be-e251cdc67d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:55.799341 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1055/2140] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:55.800432 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3f294-2c44-4446-98ec-11d9db19a2a9 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:55.807511 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9dd3f294-2c44-4446-98ec-11d9db19a2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:55.817645 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1086/2141] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:55.819481 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792bda7-d901-4c11-becf-d890d745d130 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:55.819780 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792bda7-d901-4c11-becf-d890d745d130 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:55.820066 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792bda7-d901-4c11-becf-d890d745d130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:55.839482 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3f294-2c44-4446-98ec-11d9db19a2a9 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:55.854181 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad79538-0ad5-4095-94f6-9306dcf167ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:55.855776 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad79538-0ad5-4095-94f6-9306dcf167ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:55.856248 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad79538-0ad5-4095-94f6-9306dcf167ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:55.856704 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad79538-0ad5-4095-94f6-9306dcf167ca admin admin] PATH_INFO: `/v3/users/fd6b6962b0444de29047dbdbdc49ab7f` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:55.860153 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad79538-0ad5-4095-94f6-9306dcf167ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd6b6962b0444de29047dbdbdc49ab7f)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:55.862356 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad79538-0ad5-4095-94f6-9306dcf167ca admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:55.864936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-5792bda7-d901-4c11-becf-d890d745d130 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:55.869804 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5792bda7-d901-4c11-becf-d890d745d130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:55.902701 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1087/2142] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:55.902701 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36c98b-ceb2-4622-b1a5-68d9fbccd676 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:55.902701 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36c98b-ceb2-4622-b1a5-68d9fbccd676 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:55.902701 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a36c98b-ceb2-4622-b1a5-68d9fbccd676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:55.943129 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-0a36c98b-ceb2-4622-b1a5-68d9fbccd676 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:55.944435 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0a36c98b-ceb2-4622-b1a5-68d9fbccd676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:55.964199 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1088/2143] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:55.965144 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a36c98b-ceb2-4622-b1a5-68d9fbccd676 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:55.985457 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a36c98b-ceb2-4622-b1a5-68d9fbccd676 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:55.987919 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8ad79538-0ad5-4095-94f6-9306dcf167ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd6b6962b0444de29047dbdbdc49ab7f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:55.989107 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8ad79538-0ad5-4095-94f6-9306dcf167ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd6b6962b0444de29047dbdbdc49ab7f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:55.990936 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8ad79538-0ad5-4095-94f6-9306dcf167ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd6b6962b0444de29047dbdbdc49ab7f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:55.992470 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f113c-d37b-4dab-ad81-ed27de9bbad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:55.993323 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f113c-d37b-4dab-ad81-ed27de9bbad1 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:55.993609 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f113c-d37b-4dab-ad81-ed27de9bbad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:55.993936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57f113c-d37b-4dab-ad81-ed27de9bbad1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:55.994740 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f113c-d37b-4dab-ad81-ed27de9bbad1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:44:55.995056 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f113c-d37b-4dab-ad81-ed27de9bbad1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:55.996724 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57f113c-d37b-4dab-ad81-ed27de9bbad1 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:56.014528 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8ad79538-0ad5-4095-94f6-9306dcf167ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd6b6962b0444de29047dbdbdc49ab7f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:56.020281 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1089/2144] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:44:56.020281 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f113c-d37b-4dab-ad81-ed27de9bbad1 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:56.020281 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c57f113c-d37b-4dab-ad81-ed27de9bbad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:56.035107 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8ad79538-0ad5-4095-94f6-9306dcf167ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd6b6962b0444de29047dbdbdc49ab7f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:56.037538 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57f113c-d37b-4dab-ad81-ed27de9bbad1 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:56.044777 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9482f8-91eb-46f8-ad81-f8e62b790176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:56.045890 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9482f8-91eb-46f8-ad81-f8e62b790176 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:56.046182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9482f8-91eb-46f8-ad81-f8e62b790176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:56.046503 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9482f8-91eb-46f8-ad81-f8e62b790176 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:56.047444 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:56.048795 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9482f8-91eb-46f8-ad81-f8e62b790176 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:44:56.049111 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9482f8-91eb-46f8-ad81-f8e62b790176 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:56.052738 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9482f8-91eb-46f8-ad81-f8e62b790176 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:56.072758 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1090/2145] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:44:56.074092 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9482f8-91eb-46f8-ad81-f8e62b790176 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:56.076710 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ed9482f8-91eb-46f8-ad81-f8e62b790176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:56.083487 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1056/2146] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:44:55 2022] DELETE /identity/v3/users/fd6b6962b0444de29047dbdbdc49ab7f => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:56.086218 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad79538-0ad5-4095-94f6-9306dcf167ca admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:56.110688 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9482f8-91eb-46f8-ad81-f8e62b790176 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:56.137391 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:56.211009 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d875de5-0a8d-479a-96d9-4c2886d9eb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:56.212254 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d875de5-0a8d-479a-96d9-4c2886d9eb7d admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:56.212799 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d875de5-0a8d-479a-96d9-4c2886d9eb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:56.213823 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d875de5-0a8d-479a-96d9-4c2886d9eb7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:56.215224 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d875de5-0a8d-479a-96d9-4c2886d9eb7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:56.218594 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d875de5-0a8d-479a-96d9-4c2886d9eb7d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:56.240893 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad79538-0ad5-4095-94f6-9306dcf167ca admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:56.249560 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ac632-f5c7-452d-b6d1-659e8f587e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:56.250551 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ac632-f5c7-452d-b6d1-659e8f587e5e admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:56.250819 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ac632-f5c7-452d-b6d1-659e8f587e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:56.251107 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ac632-f5c7-452d-b6d1-659e8f587e5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:56.253288 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ac632-f5c7-452d-b6d1-659e8f587e5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:56.256062 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ac632-f5c7-452d-b6d1-659e8f587e5e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:56.274912 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1091/2147] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:44:56 2022] POST /identity/v3/projects => generated 375 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:56.275937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5c44b-e981-4655-a852-4089e19b57c5 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:56.276312 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5c44b-e981-4655-a852-4089e19b57c5 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:56.276602 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e5c44b-e981-4655-a852-4089e19b57c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:56.300852 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1057/2148] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:44:56 2022] POST /identity/v3/projects => generated 369 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:56.302706 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ac632-f5c7-452d-b6d1-659e8f587e5e admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:56.322770 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-80e5c44b-e981-4655-a852-4089e19b57c5 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:56.325779 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-80e5c44b-e981-4655-a852-4089e19b57c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:56.419920 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ac632-f5c7-452d-b6d1-659e8f587e5e admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:56.426568 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e2ea3-ef4b-43ce-a677-78fd08c1172f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:56.427302 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e2ea3-ef4b-43ce-a677-78fd08c1172f admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:56.427593 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e2ea3-ef4b-43ce-a677-78fd08c1172f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:56.427871 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e2ea3-ef4b-43ce-a677-78fd08c1172f admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:56.428569 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e2ea3-ef4b-43ce-a677-78fd08c1172f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:56.431247 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e2ea3-ef4b-43ce-a677-78fd08c1172f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:56.433529 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1092/2149] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:56.434351 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5c44b-e981-4655-a852-4089e19b57c5 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:56.451841 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e5c44b-e981-4655-a852-4089e19b57c5 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:56.458559 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1058/2150] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:44:56 2022] POST /identity/v3/users => generated 288 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:56.458559 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e2ea3-ef4b-43ce-a677-78fd08c1172f admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:56.458559 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-241e2ea3-ef4b-43ce-a677-78fd08c1172f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:56.462196 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53e46c-1097-4294-a3a2-f214102859b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:56.463125 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53e46c-1097-4294-a3a2-f214102859b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:56.464108 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53e46c-1097-4294-a3a2-f214102859b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:56.464478 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53e46c-1097-4294-a3a2-f214102859b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:56.465267 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de53e46c-1097-4294-a3a2-f214102859b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:56.467819 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de53e46c-1097-4294-a3a2-f214102859b7 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:56.500609 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1093/2151] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:44:56 2022] POST /identity/v3/users => generated 285 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:56.505854 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53e46c-1097-4294-a3a2-f214102859b7 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:56.518665 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53e46c-1097-4294-a3a2-f214102859b7 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:56.525820 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3cb11-a612-4edb-ad02-813f6b48e22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:56.526826 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3cb11-a612-4edb-ad02-813f6b48e22c admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:56.527296 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3cb11-a612-4edb-ad02-813f6b48e22c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:56.527432 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e2ea3-ef4b-43ce-a677-78fd08c1172f admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:56.527887 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f3cb11-a612-4edb-ad02-813f6b48e22c admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:56.528820 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3cb11-a612-4edb-ad02-813f6b48e22c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:56.530719 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f3cb11-a612-4edb-ad02-813f6b48e22c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:56.531748 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719f699-2154-4a1b-999d-e13c04c10e57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:56.532836 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719f699-2154-4a1b-999d-e13c04c10e57 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:56.533437 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719f699-2154-4a1b-999d-e13c04c10e57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:56.535019 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719f699-2154-4a1b-999d-e13c04c10e57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:56.545142 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1094/2152] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:56.546372 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3cb11-a612-4edb-ad02-813f6b48e22c admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:56.551185 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8719f699-2154-4a1b-999d-e13c04c10e57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:56.552659 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8719f699-2154-4a1b-999d-e13c04c10e57 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:56.558136 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f3cb11-a612-4edb-ad02-813f6b48e22c admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:56.563030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455e837-e4b3-4214-a88d-b718b363d1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:56.564181 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455e837-e4b3-4214-a88d-b718b363d1ad admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:56.564181 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455e837-e4b3-4214-a88d-b718b363d1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:56.564395 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455e837-e4b3-4214-a88d-b718b363d1ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:56.565162 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4455e837-e4b3-4214-a88d-b718b363d1ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:56.567266 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4455e837-e4b3-4214-a88d-b718b363d1ad admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:56.579397 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1095/2153] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:56.580468 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455e837-e4b3-4214-a88d-b718b363d1ad admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:56.581392 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1059/2154] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:44:56.587241 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719f699-2154-4a1b-999d-e13c04c10e57 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:56.593476 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455e837-e4b3-4214-a88d-b718b363d1ad admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:56.594969 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:56.604344 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065fe763-f27b-4255-a171-d2041e55ea96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:56.605399 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fe763-f27b-4255-a171-d2041e55ea96 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:56.605848 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fe763-f27b-4255-a171-d2041e55ea96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:56.606490 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fe763-f27b-4255-a171-d2041e55ea96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:56.607399 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065fe763-f27b-4255-a171-d2041e55ea96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:56.609174 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065fe763-f27b-4255-a171-d2041e55ea96 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:56.611688 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719f699-2154-4a1b-999d-e13c04c10e57 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:56.619988 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51de664-ff47-4f67-bcaa-a883d9a1fa3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:56.620678 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51de664-ff47-4f67-bcaa-a883d9a1fa3a admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:56.620967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51de664-ff47-4f67-bcaa-a883d9a1fa3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:56.621250 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51de664-ff47-4f67-bcaa-a883d9a1fa3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:56.622238 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1096/2155] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:56.623192 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51de664-ff47-4f67-bcaa-a883d9a1fa3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:56.624852 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51de664-ff47-4f67-bcaa-a883d9a1fa3a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:56.626172 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065fe763-f27b-4255-a171-d2041e55ea96 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:56.638714 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065fe763-f27b-4255-a171-d2041e55ea96 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:56.639879 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1060/2156] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:56.645732 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51de664-ff47-4f67-bcaa-a883d9a1fa3a admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:56.648666 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa96693-7341-4c40-9461-cd1136472f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:56.649967 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa96693-7341-4c40-9461-cd1136472f3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:56.650261 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa96693-7341-4c40-9461-cd1136472f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:56.650676 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa96693-7341-4c40-9461-cd1136472f3f admin admin] PATH_INFO: `/v3/projects/18d5b2d4479246ca8b39373083e74f1f/users/acfa21eed9eb42459e0c9d5ed10a449d/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:56.671015 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51de664-ff47-4f67-bcaa-a883d9a1fa3a admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:56.673879 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa96693-7341-4c40-9461-cd1136472f3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=18d5b2d4479246ca8b39373083e74f1f, user_id=acfa21eed9eb42459e0c9d5ed10a449d, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:56.678045 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa96693-7341-4c40-9461-cd1136472f3f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:56.689110 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d334b-e7a6-4e0d-bcb8-46bc50af33e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:56.690003 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d334b-e7a6-4e0d-bcb8-46bc50af33e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:56.690346 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d334b-e7a6-4e0d-bcb8-46bc50af33e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:56.690822 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d334b-e7a6-4e0d-bcb8-46bc50af33e1 admin admin] PATH_INFO: `/v3/projects/08f6efc703bb486785bf550a8dbc2749/users/49b051839fd74ab0a2feffae10f81b48/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:56.700248 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1097/2157] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:44:56 2022] PUT /identity/v3/projects/18d5b2d4479246ca8b39373083e74f1f/users/acfa21eed9eb42459e0c9d5ed10a449d/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:56.714302 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ed302-e069-4265-a3c9-d26a8a8d3ebe None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:56.714632 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ed302-e069-4265-a3c9-d26a8a8d3ebe None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:56.714885 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ed302-e069-4265-a3c9-d26a8a8d3ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:56.719816 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d334b-e7a6-4e0d-bcb8-46bc50af33e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08f6efc703bb486785bf550a8dbc2749, user_id=49b051839fd74ab0a2feffae10f81b48, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:56.724558 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d334b-e7a6-4e0d-bcb8-46bc50af33e1 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:56.746605 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1061/2158] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:44:56 2022] PUT /identity/v3/projects/08f6efc703bb486785bf550a8dbc2749/users/49b051839fd74ab0a2feffae10f81b48/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:56.758687 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3600c0-e3d6-4bb5-9580-27cf35154e6f None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:56.758687 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3600c0-e3d6-4bb5-9580-27cf35154e6f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:56.758687 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3600c0-e3d6-4bb5-9580-27cf35154e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:56.764906 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-888ed302-e069-4265-a3c9-d26a8a8d3ebe None None] MFA Rules not processed for user `acfa21eed9eb42459e0c9d5ed10a449d`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:56.766033 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-888ed302-e069-4265-a3c9-d26a8a8d3ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:56.802945 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:56.807014 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-cc3600c0-e3d6-4bb5-9580-27cf35154e6f None None] MFA Rules not processed for user `49b051839fd74ab0a2feffae10f81b48`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:56.808530 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-cc3600c0-e3d6-4bb5-9580-27cf35154e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:56.898266 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1098/2159] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:56.903484 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1062/2160] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:56 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:56.903842 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ed302-e069-4265-a3c9-d26a8a8d3ebe None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:56.907383 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-888ed302-e069-4265-a3c9-d26a8a8d3ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:56.914010 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3600c0-e3d6-4bb5-9580-27cf35154e6f None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:56.916482 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-cc3600c0-e3d6-4bb5-9580-27cf35154e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:56.982499 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ed302-e069-4265-a3c9-d26a8a8d3ebe None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:56.987297 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3f2ad-e1b3-4a41-9aad-125fed016ec9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:56.988113 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3f2ad-e1b3-4a41-9aad-125fed016ec9 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:56.988536 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3f2ad-e1b3-4a41-9aad-125fed016ec9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:56.988937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3f2ad-e1b3-4a41-9aad-125fed016ec9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:56.999691 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3f2ad-e1b3-4a41-9aad-125fed016ec9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:57.001977 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3f2ad-e1b3-4a41-9aad-125fed016ec9 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:57.012646 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1099/2161] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:44:57.013790 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3f2ad-e1b3-4a41-9aad-125fed016ec9 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:57.015442 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-45a3f2ad-e1b3-4a41-9aad-125fed016ec9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:57.071248 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3600c0-e3d6-4bb5-9580-27cf35154e6f None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:57.077059 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92258da1-ff26-44bf-a1ac-65c7c38a390b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a567cddc98164bd39317a245626d0f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:57.077862 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92258da1-ff26-44bf-a1ac-65c7c38a390b service glance] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:57.078260 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92258da1-ff26-44bf-a1ac-65c7c38a390b service glance] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:57.078812 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92258da1-ff26-44bf-a1ac-65c7c38a390b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:57.095293 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92258da1-ff26-44bf-a1ac-65c7c38a390b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:57.097473 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92258da1-ff26-44bf-a1ac-65c7c38a390b service glance] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:57.107695 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1063/2162] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:56 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 03:44:57.113373 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3f2ad-e1b3-4a41-9aad-125fed016ec9 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:57.137773 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b782be1f-7bd5-42f7-9678-90d149dc27d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:57.139069 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782be1f-7bd5-42f7-9678-90d149dc27d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:57.139362 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782be1f-7bd5-42f7-9678-90d149dc27d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:57.139638 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b782be1f-7bd5-42f7-9678-90d149dc27d8 admin admin] PATH_INFO: `/v3/projects/578f033403fb47b28ba60507e45f91fc` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:57.141115 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b782be1f-7bd5-42f7-9678-90d149dc27d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=578f033403fb47b28ba60507e45f91fc)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:57.144020 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b782be1f-7bd5-42f7-9678-90d149dc27d8 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:57.213382 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b782be1f-7bd5-42f7-9678-90d149dc27d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '578f033403fb47b28ba60507e45f91fc', 'request_id': 'req-b782be1f-7bd5-42f7-9678-90d149dc27d8'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:57.221184 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b782be1f-7bd5-42f7-9678-90d149dc27d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '578f033403fb47b28ba60507e45f91fc', 'request_id': 'req-b782be1f-7bd5-42f7-9678-90d149dc27d8'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:57.235610 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b782be1f-7bd5-42f7-9678-90d149dc27d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '578f033403fb47b28ba60507e45f91fc', 'request_id': 'req-b782be1f-7bd5-42f7-9678-90d149dc27d8'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:57.238911 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:57.253408 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b782be1f-7bd5-42f7-9678-90d149dc27d8 admin admin] The token cache is being invalidate because project 578f033403fb47b28ba60507e45f91fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:44:57.253829 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b782be1f-7bd5-42f7-9678-90d149dc27d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:57.255458 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b782be1f-7bd5-42f7-9678-90d149dc27d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:44:57.258234 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1100/2163] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:44:57 2022] DELETE /identity/v3/projects/578f033403fb47b28ba60507e45f91fc => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:44:57.263773 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd04cb-8f58-445b-9481-b1804fb60563 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:57.264265 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd04cb-8f58-445b-9481-b1804fb60563 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:57.264265 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bd04cb-8f58-445b-9481-b1804fb60563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:57.301273 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-99bd04cb-8f58-445b-9481-b1804fb60563 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:57.302528 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-99bd04cb-8f58-445b-9481-b1804fb60563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:57.372605 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:44:57.425419 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1064/2164] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:44:57.433598 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afd690-7917-4b7e-a874-c9dcce83e3a1 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:57.434059 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afd690-7917-4b7e-a874-c9dcce83e3a1 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:57.434195 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afd690-7917-4b7e-a874-c9dcce83e3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:57.460880 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b7afd690-7917-4b7e-a874-c9dcce83e3a1 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:57.462162 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b7afd690-7917-4b7e-a874-c9dcce83e3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:57.472928 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1101/2165] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:44:57.478139 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd04cb-8f58-445b-9481-b1804fb60563 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:57.499397 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bd04cb-8f58-445b-9481-b1804fb60563 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:57.508383 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98f510-202d-4456-a895-3179d66aa8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:57.509790 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98f510-202d-4456-a895-3179d66aa8b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:57.510083 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98f510-202d-4456-a895-3179d66aa8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:57.510579 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98f510-202d-4456-a895-3179d66aa8b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:57.511769 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98f510-202d-4456-a895-3179d66aa8b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:44:57.512492 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98f510-202d-4456-a895-3179d66aa8b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:57.515086 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98f510-202d-4456-a895-3179d66aa8b5 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:57.534948 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1065/2166] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:44:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:44:57.536659 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7afd690-7917-4b7e-a874-c9dcce83e3a1 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:57.564821 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7afd690-7917-4b7e-a874-c9dcce83e3a1 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:57.571943 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7bd1b2-6ff0-4ca0-9d2e-57322a10b98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:57.572711 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7bd1b2-6ff0-4ca0-9d2e-57322a10b98d admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:57.573001 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7bd1b2-6ff0-4ca0-9d2e-57322a10b98d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:57.573326 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7bd1b2-6ff0-4ca0-9d2e-57322a10b98d admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:57.575652 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7bd1b2-6ff0-4ca0-9d2e-57322a10b98d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:57.583752 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7bd1b2-6ff0-4ca0-9d2e-57322a10b98d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:57.638749 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1102/2167] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:44:57 2022] POST /identity/v3/projects => generated 371 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:44:57.644111 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98f510-202d-4456-a895-3179d66aa8b5 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:57.656314 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98f510-202d-4456-a895-3179d66aa8b5 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:57.728215 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea99122-7de3-4d86-8204-ac2db1985d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:57.728904 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea99122-7de3-4d86-8204-ac2db1985d57 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:57.729236 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea99122-7de3-4d86-8204-ac2db1985d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:57.730069 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea99122-7de3-4d86-8204-ac2db1985d57 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:57.730885 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea99122-7de3-4d86-8204-ac2db1985d57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:57.733942 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea99122-7de3-4d86-8204-ac2db1985d57 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:57.777612 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1066/2168] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:44:57 2022] POST /identity/v3/users => generated 286 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:44:57.781530 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7bd1b2-6ff0-4ca0-9d2e-57322a10b98d admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:57.796672 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7bd1b2-6ff0-4ca0-9d2e-57322a10b98d admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:57.802945 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08605f-ad65-4d48-8f24-47f3ececeb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:57.803673 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08605f-ad65-4d48-8f24-47f3ececeb14 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:57.804049 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08605f-ad65-4d48-8f24-47f3ececeb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:57.807156 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08605f-ad65-4d48-8f24-47f3ececeb14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:57.807156 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa08605f-ad65-4d48-8f24-47f3ececeb14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:57.807156 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa08605f-ad65-4d48-8f24-47f3ececeb14 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:57.836221 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1103/2169] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:57.838038 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea99122-7de3-4d86-8204-ac2db1985d57 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:57.854809 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea99122-7de3-4d86-8204-ac2db1985d57 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:57.863406 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab70e4-506d-4e04-870c-2261f2dc3054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:57.864634 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab70e4-506d-4e04-870c-2261f2dc3054 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:57.865681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab70e4-506d-4e04-870c-2261f2dc3054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:57.866852 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab70e4-506d-4e04-870c-2261f2dc3054 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:57.867656 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab70e4-506d-4e04-870c-2261f2dc3054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:57.869656 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab70e4-506d-4e04-870c-2261f2dc3054 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:57.911144 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1067/2170] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:44:57.913212 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08605f-ad65-4d48-8f24-47f3ececeb14 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:57.925524 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08605f-ad65-4d48-8f24-47f3ececeb14 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:57.931091 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8fc0c0-689a-4eac-8fea-9136f8781a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:57.932127 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8fc0c0-689a-4eac-8fea-9136f8781a0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:57.932486 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8fc0c0-689a-4eac-8fea-9136f8781a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:57.932840 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8fc0c0-689a-4eac-8fea-9136f8781a0a admin admin] PATH_INFO: `/v3/projects/d53f2cf71221415e91213e447497f38d/users/a14245daf0a34f93a1ed94a33798e051/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:57.950770 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8fc0c0-689a-4eac-8fea-9136f8781a0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d53f2cf71221415e91213e447497f38d, user_id=a14245daf0a34f93a1ed94a33798e051, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:57.953609 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8fc0c0-689a-4eac-8fea-9136f8781a0a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:57.968816 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1104/2171] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:44:57 2022] PUT /identity/v3/projects/d53f2cf71221415e91213e447497f38d/users/a14245daf0a34f93a1ed94a33798e051/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:44:57.973665 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec213b2-8452-432e-917c-e6686fcc9fd8 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:57.973959 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec213b2-8452-432e-917c-e6686fcc9fd8 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:57.974238 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec213b2-8452-432e-917c-e6686fcc9fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:57.992635 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-5ec213b2-8452-432e-917c-e6686fcc9fd8 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:44:57.993837 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5ec213b2-8452-432e-917c-e6686fcc9fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:58.070677 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1068/2172] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:44:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:44:58.080097 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8fc0c0-689a-4eac-8fea-9136f8781a0a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:44:58.081928 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ad8fc0c0-689a-4eac-8fea-9136f8781a0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:44:58.141745 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8fc0c0-689a-4eac-8fea-9136f8781a0a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:44:58.145784 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447294f8-c42a-41f9-b147-586b9fffefad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:44:58.146515 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447294f8-c42a-41f9-b147-586b9fffefad service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:44:58.146811 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447294f8-c42a-41f9-b147-586b9fffefad service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:44:58.147095 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447294f8-c42a-41f9-b147-586b9fffefad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:44:58.157510 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447294f8-c42a-41f9-b147-586b9fffefad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:44:58.159495 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447294f8-c42a-41f9-b147-586b9fffefad service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:44:58.169985 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1105/2173] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:44:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:45:02.361327 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec213b2-8452-432e-917c-e6686fcc9fd8 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:02.363555 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5ec213b2-8452-432e-917c-e6686fcc9fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:02.389643 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec213b2-8452-432e-917c-e6686fcc9fd8 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:02.435652 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb91bb-37de-4a26-bffa-23f2b29a0be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:02.436310 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb91bb-37de-4a26-bffa-23f2b29a0be0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:02.436637 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb91bb-37de-4a26-bffa-23f2b29a0be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:02.436919 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb91bb-37de-4a26-bffa-23f2b29a0be0 admin admin] PATH_INFO: `/v3/users/883edde097a44e16846f89fa73eaf359` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:02.439870 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fb91bb-37de-4a26-bffa-23f2b29a0be0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=883edde097a44e16846f89fa73eaf359)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:02.441923 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fb91bb-37de-4a26-bffa-23f2b29a0be0 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:02.534750 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:45:02.543278 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-72fb91bb-37de-4a26-bffa-23f2b29a0be0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '883edde097a44e16846f89fa73eaf359'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:02.544323 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-72fb91bb-37de-4a26-bffa-23f2b29a0be0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '883edde097a44e16846f89fa73eaf359'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:02.545215 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-72fb91bb-37de-4a26-bffa-23f2b29a0be0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '883edde097a44e16846f89fa73eaf359'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:02.555354 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-72fb91bb-37de-4a26-bffa-23f2b29a0be0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '883edde097a44e16846f89fa73eaf359'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:02.568421 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-72fb91bb-37de-4a26-bffa-23f2b29a0be0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '883edde097a44e16846f89fa73eaf359'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:02.597042 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1069/2174] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:45:02 2022] DELETE /identity/v3/users/883edde097a44e16846f89fa73eaf359 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:45:02.601692 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d9eae-9123-4eca-804d-56bfc780f7f7 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:02.602882 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d9eae-9123-4eca-804d-56bfc780f7f7 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:02.603428 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d9eae-9123-4eca-804d-56bfc780f7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:02.652978 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-400d9eae-9123-4eca-804d-56bfc780f7f7 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:45:02.654350 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-400d9eae-9123-4eca-804d-56bfc780f7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:02.776261 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1106/2175] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:45:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:45:02.791280 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb91bb-37de-4a26-bffa-23f2b29a0be0 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:02.796797 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-72fb91bb-37de-4a26-bffa-23f2b29a0be0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:02.952772 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb91bb-37de-4a26-bffa-23f2b29a0be0 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:02.962734 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12162d8c-a46f-46e5-bbb2-4417c701580b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:02.963753 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12162d8c-a46f-46e5-bbb2-4417c701580b service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:02.966238 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12162d8c-a46f-46e5-bbb2-4417c701580b service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:02.968200 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12162d8c-a46f-46e5-bbb2-4417c701580b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:02.993262 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12162d8c-a46f-46e5-bbb2-4417c701580b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:02.996470 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12162d8c-a46f-46e5-bbb2-4417c701580b service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:03.036892 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1070/2176] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:45:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:45:03.152845 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d9eae-9123-4eca-804d-56bfc780f7f7 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:03.154148 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-400d9eae-9123-4eca-804d-56bfc780f7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:03.187594 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d9eae-9123-4eca-804d-56bfc780f7f7 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:03.212066 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681856a4-656a-44a3-b52f-4e5d0e573fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:03.212960 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681856a4-656a-44a3-b52f-4e5d0e573fb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:03.213247 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681856a4-656a-44a3-b52f-4e5d0e573fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:03.213548 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681856a4-656a-44a3-b52f-4e5d0e573fb9 admin admin] PATH_INFO: `/v3/users/e0f4a87a467643ae90d5de771ff01d50` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:03.215175 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681856a4-656a-44a3-b52f-4e5d0e573fb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0f4a87a467643ae90d5de771ff01d50)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:03.217104 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681856a4-656a-44a3-b52f-4e5d0e573fb9 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:03.275798 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:45:03.329932 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-681856a4-656a-44a3-b52f-4e5d0e573fb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0f4a87a467643ae90d5de771ff01d50'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:03.332468 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-681856a4-656a-44a3-b52f-4e5d0e573fb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0f4a87a467643ae90d5de771ff01d50'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:03.334662 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-681856a4-656a-44a3-b52f-4e5d0e573fb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0f4a87a467643ae90d5de771ff01d50'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:03.357421 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-681856a4-656a-44a3-b52f-4e5d0e573fb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0f4a87a467643ae90d5de771ff01d50'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:03.373747 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-681856a4-656a-44a3-b52f-4e5d0e573fb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0f4a87a467643ae90d5de771ff01d50'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:03.441953 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1107/2177] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:45:03 2022] DELETE /identity/v3/users/e0f4a87a467643ae90d5de771ff01d50 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:45:03.696765 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12162d8c-a46f-46e5-bbb2-4417c701580b service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:03.699108 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-12162d8c-a46f-46e5-bbb2-4417c701580b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:03.746213 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12162d8c-a46f-46e5-bbb2-4417c701580b service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:03.818262 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681856a4-656a-44a3-b52f-4e5d0e573fb9 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:03.820836 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-681856a4-656a-44a3-b52f-4e5d0e573fb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:03.911699 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98130b4a-92f0-4aea-be0a-476744320dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:03.912551 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98130b4a-92f0-4aea-be0a-476744320dd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:03.912835 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98130b4a-92f0-4aea-be0a-476744320dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:03.913115 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98130b4a-92f0-4aea-be0a-476744320dd3 admin admin] PATH_INFO: `/v3/projects/41b9a09f83de41f6b4a35f288849f391` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:03.916500 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98130b4a-92f0-4aea-be0a-476744320dd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41b9a09f83de41f6b4a35f288849f391)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:03.918479 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98130b4a-92f0-4aea-be0a-476744320dd3 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:03.946055 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681856a4-656a-44a3-b52f-4e5d0e573fb9 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:03.951408 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5a240-9cb9-4678-a080-6896a1e658a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:03.952586 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5a240-9cb9-4678-a080-6896a1e658a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:03.953159 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5a240-9cb9-4678-a080-6896a1e658a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:03.953619 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5a240-9cb9-4678-a080-6896a1e658a9 admin admin] PATH_INFO: `/v3/projects/9a9039acaf0340f4859da953e7b1e97f` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:03.955372 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b5a240-9cb9-4678-a080-6896a1e658a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a9039acaf0340f4859da953e7b1e97f)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:03.959339 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b5a240-9cb9-4678-a080-6896a1e658a9 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:03.999786 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-98130b4a-92f0-4aea-be0a-476744320dd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41b9a09f83de41f6b4a35f288849f391', 'request_id': 'req-98130b4a-92f0-4aea-be0a-476744320dd3'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:04.008457 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-98130b4a-92f0-4aea-be0a-476744320dd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41b9a09f83de41f6b4a35f288849f391', 'request_id': 'req-98130b4a-92f0-4aea-be0a-476744320dd3'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:04.020785 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-98130b4a-92f0-4aea-be0a-476744320dd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41b9a09f83de41f6b4a35f288849f391', 'request_id': 'req-98130b4a-92f0-4aea-be0a-476744320dd3'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:04.022931 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:45:04.040359 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-98130b4a-92f0-4aea-be0a-476744320dd3 admin admin] The token cache is being invalidate because project 41b9a09f83de41f6b4a35f288849f391 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:45:04.040729 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-98130b4a-92f0-4aea-be0a-476744320dd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:04.041646 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-98130b4a-92f0-4aea-be0a-476744320dd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:04.044156 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1071/2178] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:45:03 2022] DELETE /identity/v3/projects/41b9a09f83de41f6b4a35f288849f391 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:45:04.049112 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98130b4a-92f0-4aea-be0a-476744320dd3 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:04.050674 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-98130b4a-92f0-4aea-be0a-476744320dd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:04.081269 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-13b5a240-9cb9-4678-a080-6896a1e658a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a9039acaf0340f4859da953e7b1e97f', 'request_id': 'req-13b5a240-9cb9-4678-a080-6896a1e658a9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:04.089480 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-13b5a240-9cb9-4678-a080-6896a1e658a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a9039acaf0340f4859da953e7b1e97f', 'request_id': 'req-13b5a240-9cb9-4678-a080-6896a1e658a9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:04.109279 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-13b5a240-9cb9-4678-a080-6896a1e658a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a9039acaf0340f4859da953e7b1e97f', 'request_id': 'req-13b5a240-9cb9-4678-a080-6896a1e658a9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:04.125273 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-13b5a240-9cb9-4678-a080-6896a1e658a9 admin admin] The token cache is being invalidate because project 9a9039acaf0340f4859da953e7b1e97f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:45:04.125732 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-13b5a240-9cb9-4678-a080-6896a1e658a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:04.126910 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-13b5a240-9cb9-4678-a080-6896a1e658a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:04.137430 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1108/2179] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:45:03 2022] DELETE /identity/v3/projects/9a9039acaf0340f4859da953e7b1e97f => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:45:04.139214 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac2190-a618-4310-a1cd-0ba09e06f340 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:04.139515 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac2190-a618-4310-a1cd-0ba09e06f340 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:04.139805 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac2190-a618-4310-a1cd-0ba09e06f340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:04.145712 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98130b4a-92f0-4aea-be0a-476744320dd3 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:04.165402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e0ac2190-a618-4310-a1cd-0ba09e06f340 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:45:04.166743 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e0ac2190-a618-4310-a1cd-0ba09e06f340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:04.209792 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:45:04.253082 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e3393-1898-49ce-9bb8-e2a2672bf845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:04.254261 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e3393-1898-49ce-9bb8-e2a2672bf845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:04.255944 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e3393-1898-49ce-9bb8-e2a2672bf845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:04.256701 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e3393-1898-49ce-9bb8-e2a2672bf845 admin admin] PATH_INFO: `/v3/users/b11566dd305f4153bf952cac7dcdd61d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:04.259356 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3e3393-1898-49ce-9bb8-e2a2672bf845 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b11566dd305f4153bf952cac7dcdd61d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:04.262378 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1109/2180] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:45:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:45:04.265134 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3e3393-1898-49ce-9bb8-e2a2672bf845 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:04.270821 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341e60f-76e4-48bc-9b8f-05aaa0dc889e None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:04.271526 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341e60f-76e4-48bc-9b8f-05aaa0dc889e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:04.271635 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341e60f-76e4-48bc-9b8f-05aaa0dc889e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:04.317575 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f341e60f-76e4-48bc-9b8f-05aaa0dc889e None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:45:04.319197 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f341e60f-76e4-48bc-9b8f-05aaa0dc889e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:04.339471 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1110/2181] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:45:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:45:04.351946 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341e60f-76e4-48bc-9b8f-05aaa0dc889e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:04.376123 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-aa3e3393-1898-49ce-9bb8-e2a2672bf845 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b11566dd305f4153bf952cac7dcdd61d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:04.378619 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-aa3e3393-1898-49ce-9bb8-e2a2672bf845 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b11566dd305f4153bf952cac7dcdd61d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:04.386827 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-aa3e3393-1898-49ce-9bb8-e2a2672bf845 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b11566dd305f4153bf952cac7dcdd61d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:04.391329 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341e60f-76e4-48bc-9b8f-05aaa0dc889e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:04.402691 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91ead0-10d0-4dd0-94f6-2a9a12cc9b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:04.403374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91ead0-10d0-4dd0-94f6-2a9a12cc9b0c admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:04.403663 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91ead0-10d0-4dd0-94f6-2a9a12cc9b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:04.403941 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91ead0-10d0-4dd0-94f6-2a9a12cc9b0c admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:04.406795 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-aa3e3393-1898-49ce-9bb8-e2a2672bf845 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b11566dd305f4153bf952cac7dcdd61d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:04.409687 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91ead0-10d0-4dd0-94f6-2a9a12cc9b0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:45:04.410151 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91ead0-10d0-4dd0-94f6-2a9a12cc9b0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:04.412671 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91ead0-10d0-4dd0-94f6-2a9a12cc9b0c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:04.427720 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-aa3e3393-1898-49ce-9bb8-e2a2672bf845 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b11566dd305f4153bf952cac7dcdd61d'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:04.436445 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1111/2182] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:45:04.437782 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91ead0-10d0-4dd0-94f6-2a9a12cc9b0c admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:04.440861 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2f91ead0-10d0-4dd0-94f6-2a9a12cc9b0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:04.459012 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1072/2183] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:45:04 2022] DELETE /identity/v3/users/b11566dd305f4153bf952cac7dcdd61d => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:45:04.462695 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91ead0-10d0-4dd0-94f6-2a9a12cc9b0c admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:04.569946 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f92b49-6441-414d-90d3-c44871db3b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:04.569946 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f92b49-6441-414d-90d3-c44871db3b77 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:04.569946 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f92b49-6441-414d-90d3-c44871db3b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:04.569946 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f92b49-6441-414d-90d3-c44871db3b77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:04.570361 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f92b49-6441-414d-90d3-c44871db3b77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:04.570361 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f92b49-6441-414d-90d3-c44871db3b77 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:04.634915 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1112/2184] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:45:04 2022] POST /identity/v3/projects => generated 389 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:45:04.635675 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e3393-1898-49ce-9bb8-e2a2672bf845 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:04.651188 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e3393-1898-49ce-9bb8-e2a2672bf845 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:04.690003 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:45:04.776510 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0bb7c3-95b3-43b4-890d-e65e7efc868b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:04.777804 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0bb7c3-95b3-43b4-890d-e65e7efc868b admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:04.778199 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0bb7c3-95b3-43b4-890d-e65e7efc868b admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:04.778648 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0bb7c3-95b3-43b4-890d-e65e7efc868b admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:04.779625 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0bb7c3-95b3-43b4-890d-e65e7efc868b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:04.789472 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0bb7c3-95b3-43b4-890d-e65e7efc868b admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:04.831267 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1073/2185] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:45:04 2022] POST /identity/v3/users => generated 295 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:45:04.831485 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f92b49-6441-414d-90d3-c44871db3b77 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:04.842549 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f92b49-6441-414d-90d3-c44871db3b77 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:04.858831 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d6bf4-4bc4-49c9-bb0a-71b64f9b91a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:04.859569 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d6bf4-4bc4-49c9-bb0a-71b64f9b91a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:04.863114 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d6bf4-4bc4-49c9-bb0a-71b64f9b91a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:04.863412 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d6bf4-4bc4-49c9-bb0a-71b64f9b91a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:04.864188 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d6bf4-4bc4-49c9-bb0a-71b64f9b91a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:04.865826 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0d6bf4-4bc4-49c9-bb0a-71b64f9b91a3 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:04.892242 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1113/2186] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 03:45:04.900787 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0bb7c3-95b3-43b4-890d-e65e7efc868b admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:04.912308 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0bb7c3-95b3-43b4-890d-e65e7efc868b admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:04.916981 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e293603-643c-46b0-aabf-d7df04ba725e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:04.917935 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e293603-643c-46b0-aabf-d7df04ba725e admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:04.918665 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e293603-643c-46b0-aabf-d7df04ba725e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:04.918665 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e293603-643c-46b0-aabf-d7df04ba725e admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:04.919474 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e293603-643c-46b0-aabf-d7df04ba725e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:04.921214 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e293603-643c-46b0-aabf-d7df04ba725e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:04.938770 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1074/2187] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:45:04.939564 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d6bf4-4bc4-49c9-bb0a-71b64f9b91a3 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:04.950225 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d6bf4-4bc4-49c9-bb0a-71b64f9b91a3 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:04.971650 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0522f-2931-4879-9f1c-f8322b29f378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:04.973132 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0522f-2931-4879-9f1c-f8322b29f378 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:04.973422 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0522f-2931-4879-9f1c-f8322b29f378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:04.973704 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0522f-2931-4879-9f1c-f8322b29f378 admin admin] PATH_INFO: `/v3/projects/2225bec556df4bf8bdbc315dc9888cb2/users/80ed200a0cd740e8a0b857690584404e/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:05.024041 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e0522f-2931-4879-9f1c-f8322b29f378 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2225bec556df4bf8bdbc315dc9888cb2, user_id=80ed200a0cd740e8a0b857690584404e, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:05.029335 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e0522f-2931-4879-9f1c-f8322b29f378 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:05.038248 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e293603-643c-46b0-aabf-d7df04ba725e admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:05.047439 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2e293603-643c-46b0-aabf-d7df04ba725e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:05.085897 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e293603-643c-46b0-aabf-d7df04ba725e admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:05.116125 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1114/2188] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:45:04 2022] PUT /identity/v3/projects/2225bec556df4bf8bdbc315dc9888cb2/users/80ed200a0cd740e8a0b857690584404e/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:45:05.118114 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc9807-ac6e-4b35-87a1-0549fadd3bd1 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:05.119528 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc9807-ac6e-4b35-87a1-0549fadd3bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:05.119887 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc9807-ac6e-4b35-87a1-0549fadd3bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:05.159330 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-c9bc9807-ac6e-4b35-87a1-0549fadd3bd1 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:45:05.160576 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c9bc9807-ac6e-4b35-87a1-0549fadd3bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:05.245096 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62936bf-8717-4328-9b7c-0689a9dd9f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:05.252134 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62936bf-8717-4328-9b7c-0689a9dd9f21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:05.252690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62936bf-8717-4328-9b7c-0689a9dd9f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:05.253055 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62936bf-8717-4328-9b7c-0689a9dd9f21 admin admin] PATH_INFO: `/v3/projects/fc79593965564c9a8ddabea2a67fc287` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:05.265859 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62936bf-8717-4328-9b7c-0689a9dd9f21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc79593965564c9a8ddabea2a67fc287)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:05.269217 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62936bf-8717-4328-9b7c-0689a9dd9f21 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:05.311288 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1115/2189] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:45:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:45:05.320072 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc9807-ac6e-4b35-87a1-0549fadd3bd1 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:05.323287 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c9bc9807-ac6e-4b35-87a1-0549fadd3bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:05.332289 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:45:05.370430 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c62936bf-8717-4328-9b7c-0689a9dd9f21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc79593965564c9a8ddabea2a67fc287', 'request_id': 'req-c62936bf-8717-4328-9b7c-0689a9dd9f21'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:05.390642 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c62936bf-8717-4328-9b7c-0689a9dd9f21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc79593965564c9a8ddabea2a67fc287', 'request_id': 'req-c62936bf-8717-4328-9b7c-0689a9dd9f21'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:05.405219 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c62936bf-8717-4328-9b7c-0689a9dd9f21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc79593965564c9a8ddabea2a67fc287', 'request_id': 'req-c62936bf-8717-4328-9b7c-0689a9dd9f21'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:05.426258 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c62936bf-8717-4328-9b7c-0689a9dd9f21 admin admin] The token cache is being invalidate because project fc79593965564c9a8ddabea2a67fc287 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:45:05.426606 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c62936bf-8717-4328-9b7c-0689a9dd9f21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:05.427328 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c62936bf-8717-4328-9b7c-0689a9dd9f21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:05.430496 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1075/2190] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:45:05 2022] DELETE /identity/v3/projects/fc79593965564c9a8ddabea2a67fc287 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:45:05.434362 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a49d3a-012e-4c7e-b5aa-2d30ee8653f4 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:05.434704 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a49d3a-012e-4c7e-b5aa-2d30ee8653f4 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:05.434985 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a49d3a-012e-4c7e-b5aa-2d30ee8653f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:05.446345 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc9807-ac6e-4b35-87a1-0549fadd3bd1 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:05.467139 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-88a49d3a-012e-4c7e-b5aa-2d30ee8653f4 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:45:05.468399 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-88a49d3a-012e-4c7e-b5aa-2d30ee8653f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:05.532663 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:45:05.548077 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807046f-effd-4f4a-82e5-5219c544db94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:05.548904 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807046f-effd-4f4a-82e5-5219c544db94 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:05.549643 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807046f-effd-4f4a-82e5-5219c544db94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:05.550319 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807046f-effd-4f4a-82e5-5219c544db94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:05.552033 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c807046f-effd-4f4a-82e5-5219c544db94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:05.620826 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1076/2191] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:45:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:45:05.631131 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac54240-3599-4fe8-b604-97a891df266f None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:05.631405 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac54240-3599-4fe8-b604-97a891df266f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:05.631994 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac54240-3599-4fe8-b604-97a891df266f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:05.652989 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-9ac54240-3599-4fe8-b604-97a891df266f None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:45:05.654195 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9ac54240-3599-4fe8-b604-97a891df266f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:05.665826 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c807046f-effd-4f4a-82e5-5219c544db94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:05.667773 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c807046f-effd-4f4a-82e5-5219c544db94 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:05.677678 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1077/2192] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:45:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:45:05.682958 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac54240-3599-4fe8-b604-97a891df266f None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:05.694078 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1116/2193] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:45:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 03:45:05.704301 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac54240-3599-4fe8-b604-97a891df266f None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:05.711024 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890af5f-7d11-44a4-a69e-afa4db54655b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:05.711937 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890af5f-7d11-44a4-a69e-afa4db54655b admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:05.712130 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890af5f-7d11-44a4-a69e-afa4db54655b admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:05.712455 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3890af5f-7d11-44a4-a69e-afa4db54655b admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:05.713423 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3890af5f-7d11-44a4-a69e-afa4db54655b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:45:05.713897 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3890af5f-7d11-44a4-a69e-afa4db54655b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:05.716849 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3890af5f-7d11-44a4-a69e-afa4db54655b admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:05.749388 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1078/2194] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:45:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:45:05.753766 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807046f-effd-4f4a-82e5-5219c544db94 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:05.767726 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807046f-effd-4f4a-82e5-5219c544db94 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:05.782293 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81bacd8-253c-43d6-abe3-6926fda706ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:05.783065 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81bacd8-253c-43d6-abe3-6926fda706ce admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:05.783418 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81bacd8-253c-43d6-abe3-6926fda706ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:05.783817 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81bacd8-253c-43d6-abe3-6926fda706ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:05.784596 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81bacd8-253c-43d6-abe3-6926fda706ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:05.788609 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81bacd8-253c-43d6-abe3-6926fda706ce admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:05.851733 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1117/2195] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:45:05 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:45:05.855041 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890af5f-7d11-44a4-a69e-afa4db54655b admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:05.870010 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3890af5f-7d11-44a4-a69e-afa4db54655b admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:05.895226 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2e817-a27f-424d-8b19-1851257ec168 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:05.895226 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2e817-a27f-424d-8b19-1851257ec168 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:05.895226 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2e817-a27f-424d-8b19-1851257ec168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:05.944741 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-afe2e817-a27f-424d-8b19-1851257ec168 None None] MFA Rules not processed for user `a14245daf0a34f93a1ed94a33798e051`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:45:05.946081 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-afe2e817-a27f-424d-8b19-1851257ec168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:06.014247 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959c973-efd1-43c3-bc4c-df9cfee8bc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:06.015417 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959c973-efd1-43c3-bc4c-df9cfee8bc8e admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:06.015887 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959c973-efd1-43c3-bc4c-df9cfee8bc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:06.017401 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959c973-efd1-43c3-bc4c-df9cfee8bc8e admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:06.018936 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0959c973-efd1-43c3-bc4c-df9cfee8bc8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:06.021237 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0959c973-efd1-43c3-bc4c-df9cfee8bc8e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:06.022932 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:45:06.069604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1079/2196] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:45:05 2022] POST /identity/v3/users => generated 292 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:45:06.071107 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959c973-efd1-43c3-bc4c-df9cfee8bc8e admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:06.079801 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1118/2197] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:45:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:45:06.083376 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959c973-efd1-43c3-bc4c-df9cfee8bc8e admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:06.084445 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2e817-a27f-424d-8b19-1851257ec168 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:06.088957 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-afe2e817-a27f-424d-8b19-1851257ec168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:06.091812 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299f6bb-8a71-49a7-b71a-e4364a28c401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:06.092819 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299f6bb-8a71-49a7-b71a-e4364a28c401 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:06.093466 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299f6bb-8a71-49a7-b71a-e4364a28c401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:06.093972 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299f6bb-8a71-49a7-b71a-e4364a28c401 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:06.094987 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d299f6bb-8a71-49a7-b71a-e4364a28c401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:06.097054 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d299f6bb-8a71-49a7-b71a-e4364a28c401 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:06.111539 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2e817-a27f-424d-8b19-1851257ec168 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:06.113576 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1080/2198] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:45:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:45:06.118270 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299f6bb-8a71-49a7-b71a-e4364a28c401 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:06.121791 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0e818-21c8-4115-8ee1-9c9fb457dc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:06.122536 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0e818-21c8-4115-8ee1-9c9fb457dc45 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:06.122826 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0e818-21c8-4115-8ee1-9c9fb457dc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:06.123161 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0e818-21c8-4115-8ee1-9c9fb457dc45 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:06.123932 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee0e818-21c8-4115-8ee1-9c9fb457dc45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:06.135182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee0e818-21c8-4115-8ee1-9c9fb457dc45 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:06.152735 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299f6bb-8a71-49a7-b71a-e4364a28c401 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:06.171404 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede56a35-226d-44f2-9612-68ee1b28ba9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:06.172898 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede56a35-226d-44f2-9612-68ee1b28ba9d admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:06.173014 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1119/2199] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:45:06 2022] POST /identity/v3/projects => generated 373 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:45:06.173117 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede56a35-226d-44f2-9612-68ee1b28ba9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:06.173787 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede56a35-226d-44f2-9612-68ee1b28ba9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:06.175453 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede56a35-226d-44f2-9612-68ee1b28ba9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:06.177436 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0e818-21c8-4115-8ee1-9c9fb457dc45 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:06.177766 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede56a35-226d-44f2-9612-68ee1b28ba9d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:06.194501 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1081/2200] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:45:06 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:45:06.199685 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede56a35-226d-44f2-9612-68ee1b28ba9d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:06.213208 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede56a35-226d-44f2-9612-68ee1b28ba9d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:06.304174 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0e818-21c8-4115-8ee1-9c9fb457dc45 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:06.311950 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8c1b0-a20f-4f0d-933e-a9fee9a0e007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:06.313016 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8c1b0-a20f-4f0d-933e-a9fee9a0e007 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:06.313374 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8c1b0-a20f-4f0d-933e-a9fee9a0e007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:06.313723 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8c1b0-a20f-4f0d-933e-a9fee9a0e007 admin admin] PATH_INFO: `/v3/projects/2bbf68f79ae6492ca57a2baeeb40b034/users/1de6983ab55c407283dbf78eb341ec97/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:06.315023 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc5a09-651a-43d6-abc3-3ee2394e2591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:06.315722 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc5a09-651a-43d6-abc3-3ee2394e2591 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:06.316012 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc5a09-651a-43d6-abc3-3ee2394e2591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:06.316296 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc5a09-651a-43d6-abc3-3ee2394e2591 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:06.317009 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc5a09-651a-43d6-abc3-3ee2394e2591 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:06.319123 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc5a09-651a-43d6-abc3-3ee2394e2591 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:06.336545 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc8c1b0-a20f-4f0d-933e-a9fee9a0e007 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bbf68f79ae6492ca57a2baeeb40b034, user_id=1de6983ab55c407283dbf78eb341ec97, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:06.341845 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc8c1b0-a20f-4f0d-933e-a9fee9a0e007 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:06.363390 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:45:06.375214 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1082/2201] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:45:06 2022] PUT /identity/v3/projects/2bbf68f79ae6492ca57a2baeeb40b034/users/1de6983ab55c407283dbf78eb341ec97/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:45:06.387055 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce512b6e-d957-4698-af29-171d68ee6a25 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:06.387273 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce512b6e-d957-4698-af29-171d68ee6a25 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:06.387592 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce512b6e-d957-4698-af29-171d68ee6a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:06.392090 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1120/2202] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:45:06 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:45:06.393364 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc5a09-651a-43d6-abc3-3ee2394e2591 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:06.407872 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc5a09-651a-43d6-abc3-3ee2394e2591 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:06.435463 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ce512b6e-d957-4698-af29-171d68ee6a25 None None] MFA Rules not processed for user `1de6983ab55c407283dbf78eb341ec97`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:45:06.436925 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ce512b6e-d957-4698-af29-171d68ee6a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:06.501352 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22745d1c-e9e1-42a2-84f6-d5032f4e42ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:06.502251 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22745d1c-e9e1-42a2-84f6-d5032f4e42ff admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:06.504067 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22745d1c-e9e1-42a2-84f6-d5032f4e42ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:06.504546 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22745d1c-e9e1-42a2-84f6-d5032f4e42ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:06.506046 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22745d1c-e9e1-42a2-84f6-d5032f4e42ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:06.508320 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22745d1c-e9e1-42a2-84f6-d5032f4e42ff admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:06.531815 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1121/2203] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:45:06 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:45:06.539469 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22745d1c-e9e1-42a2-84f6-d5032f4e42ff admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:06.550731 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1083/2204] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:45:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:45:06.552292 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce512b6e-d957-4698-af29-171d68ee6a25 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:06.578642 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22745d1c-e9e1-42a2-84f6-d5032f4e42ff admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:06.585260 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f3261-4850-492d-9991-7eff271615e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:06.586518 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f3261-4850-492d-9991-7eff271615e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:06.586823 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f3261-4850-492d-9991-7eff271615e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:06.587104 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f3261-4850-492d-9991-7eff271615e2 admin admin] PATH_INFO: `/v3/projects/4242a04d93a3461db06bcd331cdb0d50/users/1797ca9a94b144cfad94a45ef2d612f3/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:06.590976 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce512b6e-d957-4698-af29-171d68ee6a25 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:06.601868 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a7d90-8f63-497e-9d31-a66d5890301e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:06.602499 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a7d90-8f63-497e-9d31-a66d5890301e admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:06.602888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a7d90-8f63-497e-9d31-a66d5890301e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:06.603170 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a7d90-8f63-497e-9d31-a66d5890301e admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:06.603982 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a7d90-8f63-497e-9d31-a66d5890301e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:06.605941 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a7d90-8f63-497e-9d31-a66d5890301e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:06.608464 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f3261-4850-492d-9991-7eff271615e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4242a04d93a3461db06bcd331cdb0d50, user_id=1797ca9a94b144cfad94a45ef2d612f3, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:06.611642 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f3261-4850-492d-9991-7eff271615e2 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:06.637574 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1122/2205] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:45:06 2022] PUT /identity/v3/projects/4242a04d93a3461db06bcd331cdb0d50/users/1797ca9a94b144cfad94a45ef2d612f3/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:45:06.641989 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f3261-4850-492d-9991-7eff271615e2 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:06.652034 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1084/2206] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:45:06 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:45:06.661419 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a7d90-8f63-497e-9d31-a66d5890301e admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:06.675497 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:45:06.747972 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f3261-4850-492d-9991-7eff271615e2 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:06.791672 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a7d90-8f63-497e-9d31-a66d5890301e admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:06.798862 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc94d64-60a7-4aa6-a762-b13f00e059ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:06.800934 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc94d64-60a7-4aa6-a762-b13f00e059ac admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:06.801480 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc94d64-60a7-4aa6-a762-b13f00e059ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:06.801980 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc94d64-60a7-4aa6-a762-b13f00e059ac admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:06.802947 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc94d64-60a7-4aa6-a762-b13f00e059ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:06.805608 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc94d64-60a7-4aa6-a762-b13f00e059ac admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:06.848470 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1085/2207] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:45:06 2022] POST /identity/v3/users => generated 297 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:45:06.853291 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc94d64-60a7-4aa6-a762-b13f00e059ac admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:06.865400 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc94d64-60a7-4aa6-a762-b13f00e059ac admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:06.871452 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c042f-733a-410c-830b-6c9567f4e7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:06.872412 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c042f-733a-410c-830b-6c9567f4e7a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:06.873025 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c042f-733a-410c-830b-6c9567f4e7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:06.873479 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c042f-733a-410c-830b-6c9567f4e7a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:06.874323 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c042f-733a-410c-830b-6c9567f4e7a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:06.876476 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c042f-733a-410c-830b-6c9567f4e7a8 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:06.876834 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0cdaa8-4fa9-4816-8e1c-ff4d46dee324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:06.877707 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cdaa8-4fa9-4816-8e1c-ff4d46dee324 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:06.878174 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cdaa8-4fa9-4816-8e1c-ff4d46dee324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:06.878497 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cdaa8-4fa9-4816-8e1c-ff4d46dee324 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:06.880760 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0cdaa8-4fa9-4816-8e1c-ff4d46dee324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:06.891608 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0cdaa8-4fa9-4816-8e1c-ff4d46dee324 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:06.897930 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1086/2208] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:45:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:45:06.899028 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c042f-733a-410c-830b-6c9567f4e7a8 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:06.906644 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1123/2209] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:45:06 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 03:45:06.909663 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0cdaa8-4fa9-4816-8e1c-ff4d46dee324 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:06.913118 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c042f-733a-410c-830b-6c9567f4e7a8 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:06.929190 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0cdaa8-4fa9-4816-8e1c-ff4d46dee324 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:06.935187 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91efb493-1e79-401a-afc1-6296b1154b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:06.935358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ed21a-c217-41b2-aed1-edd215809a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:06.936087 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efb493-1e79-401a-afc1-6296b1154b31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:06.936368 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efb493-1e79-401a-afc1-6296b1154b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:06.936764 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efb493-1e79-401a-afc1-6296b1154b31 admin admin] PATH_INFO: `/v3/projects/4242a04d93a3461db06bcd331cdb0d50/users/1797ca9a94b144cfad94a45ef2d612f3/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:06.937380 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ed21a-c217-41b2-aed1-edd215809a03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:06.938354 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ed21a-c217-41b2-aed1-edd215809a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:06.938881 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ed21a-c217-41b2-aed1-edd215809a03 admin admin] PATH_INFO: `/v3/projects/9241af50bd814cf0abdd0e452b82d361/users/44e40a95be5949528c7b206b2e5f1f25/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:06.939439 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91efb493-1e79-401a-afc1-6296b1154b31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4242a04d93a3461db06bcd331cdb0d50, user_id=1797ca9a94b144cfad94a45ef2d612f3, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:06.942426 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91efb493-1e79-401a-afc1-6296b1154b31 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:06.961444 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1124/2210] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:45:06 2022] PUT /identity/v3/projects/4242a04d93a3461db06bcd331cdb0d50/users/1797ca9a94b144cfad94a45ef2d612f3/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:45:06.970566 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ed21a-c217-41b2-aed1-edd215809a03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9241af50bd814cf0abdd0e452b82d361, user_id=44e40a95be5949528c7b206b2e5f1f25, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:06.975802 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ed21a-c217-41b2-aed1-edd215809a03 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:06.997575 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1087/2211] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:45:06 2022] PUT /identity/v3/projects/9241af50bd814cf0abdd0e452b82d361/users/44e40a95be5949528c7b206b2e5f1f25/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:45:07.003123 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91efb493-1e79-401a-afc1-6296b1154b31 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:07.141446 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91efb493-1e79-401a-afc1-6296b1154b31 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:07.271629 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:45:07.297937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a67d0-b227-4b3a-8166-367e018635d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:07.298678 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a67d0-b227-4b3a-8166-367e018635d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:07.299035 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a67d0-b227-4b3a-8166-367e018635d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:07.299285 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a67d0-b227-4b3a-8166-367e018635d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:07.300038 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a67d0-b227-4b3a-8166-367e018635d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:07.314773 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a67d0-b227-4b3a-8166-367e018635d3 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:07.332736 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1125/2212] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:45:07 2022] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:45:07.334382 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ed21a-c217-41b2-aed1-edd215809a03 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:07.345871 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ed21a-c217-41b2-aed1-edd215809a03 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:07.351254 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca0fdd-8667-41d0-be7c-ab7a2676d60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:07.352153 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca0fdd-8667-41d0-be7c-ab7a2676d60d admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:07.352437 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca0fdd-8667-41d0-be7c-ab7a2676d60d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:07.352732 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fca0fdd-8667-41d0-be7c-ab7a2676d60d admin admin] PATH_INFO: `/v3/projects/9241af50bd814cf0abdd0e452b82d361/users/44e40a95be5949528c7b206b2e5f1f25/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:07.354815 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca0fdd-8667-41d0-be7c-ab7a2676d60d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9241af50bd814cf0abdd0e452b82d361, user_id=44e40a95be5949528c7b206b2e5f1f25, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:07.357551 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fca0fdd-8667-41d0-be7c-ab7a2676d60d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:07.387634 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1088/2213] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:45:07 2022] PUT /identity/v3/projects/9241af50bd814cf0abdd0e452b82d361/users/44e40a95be5949528c7b206b2e5f1f25/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:45:07.389965 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c6205-996e-42b9-9b1c-c6c88b065d46 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:07.390781 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c6205-996e-42b9-9b1c-c6c88b065d46 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:07.390781 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c6205-996e-42b9-9b1c-c6c88b065d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:07.437467 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-ad3c6205-996e-42b9-9b1c-c6c88b065d46 None None] MFA Rules not processed for user `44e40a95be5949528c7b206b2e5f1f25`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:45:07.440646 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ad3c6205-996e-42b9-9b1c-c6c88b065d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:07.578165 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1126/2214] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:45:07 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:45:07.596792 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca0fdd-8667-41d0-be7c-ab7a2676d60d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:07.598763 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8fca0fdd-8667-41d0-be7c-ab7a2676d60d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:07.610081 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:45:07.710536 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fca0fdd-8667-41d0-be7c-ab7a2676d60d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:07.715243 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2318bae8-b165-4e5c-8ff7-8b27040883cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:07.716458 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318bae8-b165-4e5c-8ff7-8b27040883cd service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:07.717008 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318bae8-b165-4e5c-8ff7-8b27040883cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:07.717454 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318bae8-b165-4e5c-8ff7-8b27040883cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:07.733497 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2318bae8-b165-4e5c-8ff7-8b27040883cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:07.736256 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2318bae8-b165-4e5c-8ff7-8b27040883cd service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:07.749895 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1089/2215] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:45:07 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:45:07.889999 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c6205-996e-42b9-9b1c-c6c88b065d46 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:07.903198 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c6205-996e-42b9-9b1c-c6c88b065d46 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:07.912073 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59455db-ec87-47a9-b25c-87f905c7b2ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:07.913407 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59455db-ec87-47a9-b25c-87f905c7b2ca service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:07.913695 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59455db-ec87-47a9-b25c-87f905c7b2ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:07.914915 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59455db-ec87-47a9-b25c-87f905c7b2ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:08.076137 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59455db-ec87-47a9-b25c-87f905c7b2ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:08.076137 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59455db-ec87-47a9-b25c-87f905c7b2ca service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:08.081160 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1127/2216] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:45:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:45:08.588667 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2318bae8-b165-4e5c-8ff7-8b27040883cd service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:08.711181 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2318bae8-b165-4e5c-8ff7-8b27040883cd service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:08.722918 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff9304-49e8-4277-b5f0-60170e54e03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:08.724805 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff9304-49e8-4277-b5f0-60170e54e03c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:08.727295 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff9304-49e8-4277-b5f0-60170e54e03c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:08.727742 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff9304-49e8-4277-b5f0-60170e54e03c admin admin] PATH_INFO: `/v3/users/1de6983ab55c407283dbf78eb341ec97` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:08.730121 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff9304-49e8-4277-b5f0-60170e54e03c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1de6983ab55c407283dbf78eb341ec97)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:08.735331 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff9304-49e8-4277-b5f0-60170e54e03c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:08.825572 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4dff9304-49e8-4277-b5f0-60170e54e03c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1de6983ab55c407283dbf78eb341ec97'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:08.826267 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4dff9304-49e8-4277-b5f0-60170e54e03c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1de6983ab55c407283dbf78eb341ec97'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:08.827801 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4dff9304-49e8-4277-b5f0-60170e54e03c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1de6983ab55c407283dbf78eb341ec97'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:08.839500 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4dff9304-49e8-4277-b5f0-60170e54e03c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1de6983ab55c407283dbf78eb341ec97'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:08.850640 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4dff9304-49e8-4277-b5f0-60170e54e03c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1de6983ab55c407283dbf78eb341ec97'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:08.882855 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1090/2217] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:45:08 2022] DELETE /identity/v3/users/1de6983ab55c407283dbf78eb341ec97 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:45:08.888543 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288feed8-cf13-42a5-8b21-648eed6c4d20 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:08.890250 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288feed8-cf13-42a5-8b21-648eed6c4d20 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:08.891175 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288feed8-cf13-42a5-8b21-648eed6c4d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:08.918545 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-288feed8-cf13-42a5-8b21-648eed6c4d20 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:45:08.922128 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-288feed8-cf13-42a5-8b21-648eed6c4d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:09.056738 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1128/2218] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:45:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:45:09.252137 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff9304-49e8-4277-b5f0-60170e54e03c admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:09.254157 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4dff9304-49e8-4277-b5f0-60170e54e03c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:09.363772 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:45:09.432197 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff9304-49e8-4277-b5f0-60170e54e03c admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:09.441617 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4157f9-5456-460c-bc40-2a681e27e838 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:09.442283 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4157f9-5456-460c-bc40-2a681e27e838 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:09.442590 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4157f9-5456-460c-bc40-2a681e27e838 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:09.442884 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4157f9-5456-460c-bc40-2a681e27e838 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:09.465797 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4157f9-5456-460c-bc40-2a681e27e838 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:09.467767 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4157f9-5456-460c-bc40-2a681e27e838 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:09.485976 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1091/2219] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:45:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:45:09.599340 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288feed8-cf13-42a5-8b21-648eed6c4d20 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:09.601147 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-288feed8-cf13-42a5-8b21-648eed6c4d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:09.631944 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288feed8-cf13-42a5-8b21-648eed6c4d20 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:09.644097 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4485811-b6b1-404e-b8f9-d154425aed10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:09.645635 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4485811-b6b1-404e-b8f9-d154425aed10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:09.646661 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4485811-b6b1-404e-b8f9-d154425aed10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:09.647144 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4485811-b6b1-404e-b8f9-d154425aed10 admin admin] PATH_INFO: `/v3/users/acfa21eed9eb42459e0c9d5ed10a449d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:09.653037 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4485811-b6b1-404e-b8f9-d154425aed10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acfa21eed9eb42459e0c9d5ed10a449d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:09.655246 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4485811-b6b1-404e-b8f9-d154425aed10 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:09.684199 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:45:09.776591 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e4485811-b6b1-404e-b8f9-d154425aed10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acfa21eed9eb42459e0c9d5ed10a449d'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:09.777348 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e4485811-b6b1-404e-b8f9-d154425aed10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acfa21eed9eb42459e0c9d5ed10a449d'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:09.777974 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e4485811-b6b1-404e-b8f9-d154425aed10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acfa21eed9eb42459e0c9d5ed10a449d'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:09.786549 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e4485811-b6b1-404e-b8f9-d154425aed10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acfa21eed9eb42459e0c9d5ed10a449d'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:09.800756 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e4485811-b6b1-404e-b8f9-d154425aed10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acfa21eed9eb42459e0c9d5ed10a449d'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:09.847390 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1129/2220] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:45:09 2022] DELETE /identity/v3/users/acfa21eed9eb42459e0c9d5ed10a449d => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:45:09.851548 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ce70b-63d1-4154-b47f-dcd53b5533bc None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:09.852000 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ce70b-63d1-4154-b47f-dcd53b5533bc None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:09.852107 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ce70b-63d1-4154-b47f-dcd53b5533bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:09.885280 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ea0ce70b-63d1-4154-b47f-dcd53b5533bc None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:45:09.886565 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ea0ce70b-63d1-4154-b47f-dcd53b5533bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:10.016593 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1092/2221] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:45:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:45:10.065607 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4485811-b6b1-404e-b8f9-d154425aed10 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:10.072067 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e4485811-b6b1-404e-b8f9-d154425aed10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:10.279063 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4485811-b6b1-404e-b8f9-d154425aed10 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:10.324600 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a953d-c0d3-44ae-b4cd-8695395440a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:10.325578 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a953d-c0d3-44ae-b4cd-8695395440a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:10.331729 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a953d-c0d3-44ae-b4cd-8695395440a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:10.333284 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a953d-c0d3-44ae-b4cd-8695395440a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:10.357350 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a953d-c0d3-44ae-b4cd-8695395440a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:10.359008 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07a953d-c0d3-44ae-b4cd-8695395440a4 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:10.398846 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1130/2222] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:45:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:45:10.654665 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ce70b-63d1-4154-b47f-dcd53b5533bc None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:10.656335 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ea0ce70b-63d1-4154-b47f-dcd53b5533bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:10.691603 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ce70b-63d1-4154-b47f-dcd53b5533bc None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:10.710704 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dec1bf-f482-4fcf-a601-41c9cd19a442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:10.711891 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dec1bf-f482-4fcf-a601-41c9cd19a442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:10.715289 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dec1bf-f482-4fcf-a601-41c9cd19a442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:10.719611 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dec1bf-f482-4fcf-a601-41c9cd19a442 admin admin] PATH_INFO: `/v3/projects/2bbf68f79ae6492ca57a2baeeb40b034` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:10.732165 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dec1bf-f482-4fcf-a601-41c9cd19a442 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bbf68f79ae6492ca57a2baeeb40b034)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:10.734319 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dec1bf-f482-4fcf-a601-41c9cd19a442 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:10.856624 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-60dec1bf-f482-4fcf-a601-41c9cd19a442 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bbf68f79ae6492ca57a2baeeb40b034', 'request_id': 'req-60dec1bf-f482-4fcf-a601-41c9cd19a442'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:10.871891 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-60dec1bf-f482-4fcf-a601-41c9cd19a442 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bbf68f79ae6492ca57a2baeeb40b034', 'request_id': 'req-60dec1bf-f482-4fcf-a601-41c9cd19a442'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:10.891904 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-60dec1bf-f482-4fcf-a601-41c9cd19a442 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bbf68f79ae6492ca57a2baeeb40b034', 'request_id': 'req-60dec1bf-f482-4fcf-a601-41c9cd19a442'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:10.915921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-60dec1bf-f482-4fcf-a601-41c9cd19a442 admin admin] The token cache is being invalidate because project 2bbf68f79ae6492ca57a2baeeb40b034 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:45:10.916264 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-60dec1bf-f482-4fcf-a601-41c9cd19a442 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:10.917403 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-60dec1bf-f482-4fcf-a601-41c9cd19a442 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:10.922357 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1093/2223] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:45:10 2022] DELETE /identity/v3/projects/2bbf68f79ae6492ca57a2baeeb40b034 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:45:10.926061 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a953d-c0d3-44ae-b4cd-8695395440a4 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:10.938113 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a953d-c0d3-44ae-b4cd-8695395440a4 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:11.059099 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27779235-4d89-45b8-8ac2-dff08acae452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:11.060016 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27779235-4d89-45b8-8ac2-dff08acae452 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:11.061294 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27779235-4d89-45b8-8ac2-dff08acae452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:11.061727 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27779235-4d89-45b8-8ac2-dff08acae452 admin admin] PATH_INFO: `/v3/users/44e40a95be5949528c7b206b2e5f1f25` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:11.066158 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27779235-4d89-45b8-8ac2-dff08acae452 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44e40a95be5949528c7b206b2e5f1f25)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:11.095456 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27779235-4d89-45b8-8ac2-dff08acae452 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:11.152912 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:45:11.178108 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-27779235-4d89-45b8-8ac2-dff08acae452 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44e40a95be5949528c7b206b2e5f1f25'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:11.179414 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-27779235-4d89-45b8-8ac2-dff08acae452 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44e40a95be5949528c7b206b2e5f1f25'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:11.180447 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-27779235-4d89-45b8-8ac2-dff08acae452 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44e40a95be5949528c7b206b2e5f1f25'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:11.190729 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-27779235-4d89-45b8-8ac2-dff08acae452 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44e40a95be5949528c7b206b2e5f1f25'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:11.200299 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-27779235-4d89-45b8-8ac2-dff08acae452 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44e40a95be5949528c7b206b2e5f1f25'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:11.243861 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1131/2224] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:45:10 2022] DELETE /identity/v3/users/44e40a95be5949528c7b206b2e5f1f25 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:45:11.778661 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dec1bf-f482-4fcf-a601-41c9cd19a442 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:11.784321 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-60dec1bf-f482-4fcf-a601-41c9cd19a442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:11.803370 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dec1bf-f482-4fcf-a601-41c9cd19a442 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:11.866782 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:45:11.877868 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6a4fd-076a-40c5-97fa-ea6b7eae043c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:11.879323 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6a4fd-076a-40c5-97fa-ea6b7eae043c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:11.879795 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6a4fd-076a-40c5-97fa-ea6b7eae043c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:11.880471 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae6a4fd-076a-40c5-97fa-ea6b7eae043c admin admin] PATH_INFO: `/v3/projects/9241af50bd814cf0abdd0e452b82d361` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:11.883584 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6a4fd-076a-40c5-97fa-ea6b7eae043c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9241af50bd814cf0abdd0e452b82d361)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:11.886914 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae6a4fd-076a-40c5-97fa-ea6b7eae043c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:11.988895 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4ae6a4fd-076a-40c5-97fa-ea6b7eae043c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9241af50bd814cf0abdd0e452b82d361', 'request_id': 'req-4ae6a4fd-076a-40c5-97fa-ea6b7eae043c'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:12.000507 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4ae6a4fd-076a-40c5-97fa-ea6b7eae043c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9241af50bd814cf0abdd0e452b82d361', 'request_id': 'req-4ae6a4fd-076a-40c5-97fa-ea6b7eae043c'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:12.017692 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4ae6a4fd-076a-40c5-97fa-ea6b7eae043c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9241af50bd814cf0abdd0e452b82d361', 'request_id': 'req-4ae6a4fd-076a-40c5-97fa-ea6b7eae043c'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:12.050131 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4ae6a4fd-076a-40c5-97fa-ea6b7eae043c admin admin] The token cache is being invalidate because project 9241af50bd814cf0abdd0e452b82d361 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:45:12.051263 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4ae6a4fd-076a-40c5-97fa-ea6b7eae043c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:12.053155 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4ae6a4fd-076a-40c5-97fa-ea6b7eae043c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:12.056197 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1094/2225] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:45:11 2022] DELETE /identity/v3/projects/9241af50bd814cf0abdd0e452b82d361 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:45:12.061184 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16588c26-0646-45fc-b329-5c86c5c11d91 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:12.061478 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16588c26-0646-45fc-b329-5c86c5c11d91 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:12.061792 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16588c26-0646-45fc-b329-5c86c5c11d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:12.119380 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-16588c26-0646-45fc-b329-5c86c5c11d91 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:45:12.120802 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-16588c26-0646-45fc-b329-5c86c5c11d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:12.269067 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6a4fd-076a-40c5-97fa-ea6b7eae043c admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:12.270965 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4ae6a4fd-076a-40c5-97fa-ea6b7eae043c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:12.284524 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1132/2226] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:45:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:45:12.293799 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9ab1d-f611-431c-ae6f-c4d8a3a4afb6 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:12.294061 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9ab1d-f611-431c-ae6f-c4d8a3a4afb6 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:12.295927 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd9ab1d-f611-431c-ae6f-c4d8a3a4afb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:12.299442 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae6a4fd-076a-40c5-97fa-ea6b7eae043c admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:12.312710 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513978e-8cf4-4e35-b156-9484f1404ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:12.313631 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513978e-8cf4-4e35-b156-9484f1404ab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:12.313925 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513978e-8cf4-4e35-b156-9484f1404ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:12.314227 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0513978e-8cf4-4e35-b156-9484f1404ab4 admin admin] PATH_INFO: `/v3/projects/18d5b2d4479246ca8b39373083e74f1f` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:12.327670 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0513978e-8cf4-4e35-b156-9484f1404ab4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18d5b2d4479246ca8b39373083e74f1f)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:12.358960 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0513978e-8cf4-4e35-b156-9484f1404ab4 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:12.363583 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-2fd9ab1d-f611-431c-ae6f-c4d8a3a4afb6 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:45:12.365452 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2fd9ab1d-f611-431c-ae6f-c4d8a3a4afb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:12.389485 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1133/2227] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:45:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:45:12.395853 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9ab1d-f611-431c-ae6f-c4d8a3a4afb6 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:12.415494 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd9ab1d-f611-431c-ae6f-c4d8a3a4afb6 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:12.434886 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792dc04-ebc5-4566-954e-731e0706a037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:12.437076 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792dc04-ebc5-4566-954e-731e0706a037 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:12.437842 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792dc04-ebc5-4566-954e-731e0706a037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:12.438350 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792dc04-ebc5-4566-954e-731e0706a037 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:12.440223 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792dc04-ebc5-4566-954e-731e0706a037 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:45:12.440887 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792dc04-ebc5-4566-954e-731e0706a037 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:12.443806 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792dc04-ebc5-4566-954e-731e0706a037 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:12.461219 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1134/2228] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:45:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:45:12.465295 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792dc04-ebc5-4566-954e-731e0706a037 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:12.485076 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792dc04-ebc5-4566-954e-731e0706a037 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:12.499847 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0513978e-8cf4-4e35-b156-9484f1404ab4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18d5b2d4479246ca8b39373083e74f1f', 'request_id': 'req-0513978e-8cf4-4e35-b156-9484f1404ab4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:12.520347 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0513978e-8cf4-4e35-b156-9484f1404ab4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18d5b2d4479246ca8b39373083e74f1f', 'request_id': 'req-0513978e-8cf4-4e35-b156-9484f1404ab4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:12.534929 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0513978e-8cf4-4e35-b156-9484f1404ab4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18d5b2d4479246ca8b39373083e74f1f', 'request_id': 'req-0513978e-8cf4-4e35-b156-9484f1404ab4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:12.558714 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0513978e-8cf4-4e35-b156-9484f1404ab4 admin admin] The token cache is being invalidate because project 18d5b2d4479246ca8b39373083e74f1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:45:12.559012 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0513978e-8cf4-4e35-b156-9484f1404ab4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:12.560644 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0513978e-8cf4-4e35-b156-9484f1404ab4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:12.565949 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1095/2229] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:45:12 2022] DELETE /identity/v3/projects/18d5b2d4479246ca8b39373083e74f1f => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:45:12.662399 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4e526-5508-4960-aa2f-afe9b75f2380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:12.663602 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4e526-5508-4960-aa2f-afe9b75f2380 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:12.664129 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4e526-5508-4960-aa2f-afe9b75f2380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:12.664619 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4e526-5508-4960-aa2f-afe9b75f2380 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:12.665693 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b4e526-5508-4960-aa2f-afe9b75f2380 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:12.668576 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b4e526-5508-4960-aa2f-afe9b75f2380 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:12.727270 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1135/2230] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:45:12 2022] POST /identity/v3/projects => generated 385 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:45:12.732382 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513978e-8cf4-4e35-b156-9484f1404ab4 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:12.737893 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0513978e-8cf4-4e35-b156-9484f1404ab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:12.757073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0513978e-8cf4-4e35-b156-9484f1404ab4 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:12.852486 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aaaa1d-b04e-4618-83a5-3231c80d3385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:12.854156 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aaaa1d-b04e-4618-83a5-3231c80d3385 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:12.854696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aaaa1d-b04e-4618-83a5-3231c80d3385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:12.855187 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aaaa1d-b04e-4618-83a5-3231c80d3385 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:12.856112 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aaaa1d-b04e-4618-83a5-3231c80d3385 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:12.858821 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aaaa1d-b04e-4618-83a5-3231c80d3385 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:12.879622 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=81,keystone:DELETE=14,keystone:INSERT=5 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:45:12.890106 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1096/2231] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:45:12 2022] POST /identity/v3/users => generated 293 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:45:12.891573 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4e526-5508-4960-aa2f-afe9b75f2380 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:12.902277 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4e526-5508-4960-aa2f-afe9b75f2380 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:12.907634 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb3af4-e16f-4523-b521-86a585c45999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:12.908376 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb3af4-e16f-4523-b521-86a585c45999 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:12.908761 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb3af4-e16f-4523-b521-86a585c45999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:12.909103 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbb3af4-e16f-4523-b521-86a585c45999 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:12.909899 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb3af4-e16f-4523-b521-86a585c45999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:12.911609 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbb3af4-e16f-4523-b521-86a585c45999 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:12.924988 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1136/2232] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:45:12.928950 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aaaa1d-b04e-4618-83a5-3231c80d3385 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:12.942540 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aaaa1d-b04e-4618-83a5-3231c80d3385 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:12.950555 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b4114-b634-4c92-9c80-ac9482cdacaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:12.951003 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b4114-b634-4c92-9c80-ac9482cdacaf admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:12.951371 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b4114-b634-4c92-9c80-ac9482cdacaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:12.951708 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b4114-b634-4c92-9c80-ac9482cdacaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:12.952868 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9b4114-b634-4c92-9c80-ac9482cdacaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:12.954359 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9b4114-b634-4c92-9c80-ac9482cdacaf admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:12.969817 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1097/2233] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:45:12.971074 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb3af4-e16f-4523-b521-86a585c45999 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:12.978792 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:45:12.987808 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbb3af4-e16f-4523-b521-86a585c45999 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:13.003321 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303a732-d8e4-44cd-8281-17c74a5ee841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:13.005111 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303a732-d8e4-44cd-8281-17c74a5ee841 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:13.005593 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303a732-d8e4-44cd-8281-17c74a5ee841 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:13.006071 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2303a732-d8e4-44cd-8281-17c74a5ee841 admin admin] PATH_INFO: `/v3/projects/f2b480f31e60484ab4dbd49f97b1791b/users/eb4d2f13b2324feb86f196d7f5486dc4/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:13.031427 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2303a732-d8e4-44cd-8281-17c74a5ee841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2b480f31e60484ab4dbd49f97b1791b, user_id=eb4d2f13b2324feb86f196d7f5486dc4, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:13.036096 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2303a732-d8e4-44cd-8281-17c74a5ee841 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:13.058260 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1137/2234] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:45:12 2022] PUT /identity/v3/projects/f2b480f31e60484ab4dbd49f97b1791b/users/eb4d2f13b2324feb86f196d7f5486dc4/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:45:13.135153 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968b2d0-87a4-488b-b60a-e58487a1aabd None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:13.135749 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968b2d0-87a4-488b-b60a-e58487a1aabd None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:13.136484 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2968b2d0-87a4-488b-b60a-e58487a1aabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:13.173074 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-2968b2d0-87a4-488b-b60a-e58487a1aabd None None] MFA Rules not processed for user `eb4d2f13b2324feb86f196d7f5486dc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:45:13.175527 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2968b2d0-87a4-488b-b60a-e58487a1aabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:13.295132 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1098/2235] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:45:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:45:13.299819 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303a732-d8e4-44cd-8281-17c74a5ee841 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:13.425420 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2303a732-d8e4-44cd-8281-17c74a5ee841 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:13.433042 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46673ae-69fd-46ce-9223-8f71d90a4584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:13.433993 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46673ae-69fd-46ce-9223-8f71d90a4584 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:13.435057 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46673ae-69fd-46ce-9223-8f71d90a4584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:13.435552 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46673ae-69fd-46ce-9223-8f71d90a4584 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:13.437068 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46673ae-69fd-46ce-9223-8f71d90a4584 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:13.439842 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46673ae-69fd-46ce-9223-8f71d90a4584 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:13.482732 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1138/2236] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:45:13 2022] POST /identity/v3/projects => generated 383 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:45:13.486306 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968b2d0-87a4-488b-b60a-e58487a1aabd None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:13.500886 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2968b2d0-87a4-488b-b60a-e58487a1aabd None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:13.666843 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95fd76f-fd49-4d06-9484-22c8e9d11044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:13.667688 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95fd76f-fd49-4d06-9484-22c8e9d11044 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:13.668360 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95fd76f-fd49-4d06-9484-22c8e9d11044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:13.668754 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95fd76f-fd49-4d06-9484-22c8e9d11044 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:13.670548 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95fd76f-fd49-4d06-9484-22c8e9d11044 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:13.674326 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95fd76f-fd49-4d06-9484-22c8e9d11044 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:13.711221 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1099/2237] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:45:13 2022] POST /identity/v3/users => generated 292 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:45:13.714865 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46673ae-69fd-46ce-9223-8f71d90a4584 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:13.741311 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46673ae-69fd-46ce-9223-8f71d90a4584 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:13.749541 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74838d-8ecb-4236-829c-de9e875b4f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:13.750863 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74838d-8ecb-4236-829c-de9e875b4f3c admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:13.751313 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74838d-8ecb-4236-829c-de9e875b4f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:13.751725 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74838d-8ecb-4236-829c-de9e875b4f3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:13.753176 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef74838d-8ecb-4236-829c-de9e875b4f3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:13.755591 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef74838d-8ecb-4236-829c-de9e875b4f3c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:13.793299 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1139/2238] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 03:45:13.795092 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95fd76f-fd49-4d06-9484-22c8e9d11044 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:13.810733 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95fd76f-fd49-4d06-9484-22c8e9d11044 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:13.816574 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b3642-5b00-44d7-ad80-265f21d2e85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:13.817743 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b3642-5b00-44d7-ad80-265f21d2e85e admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:13.818497 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b3642-5b00-44d7-ad80-265f21d2e85e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:13.819176 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b3642-5b00-44d7-ad80-265f21d2e85e admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:13.820069 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b3642-5b00-44d7-ad80-265f21d2e85e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:13.822174 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b3642-5b00-44d7-ad80-265f21d2e85e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:13.844569 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1100/2239] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:45:13 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:45:13.849591 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74838d-8ecb-4236-829c-de9e875b4f3c admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:13.867318 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74838d-8ecb-4236-829c-de9e875b4f3c admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:13.878594 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11ac82-c901-4c09-a217-e420d776c732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:13.879509 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11ac82-c901-4c09-a217-e420d776c732 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:13.880633 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11ac82-c901-4c09-a217-e420d776c732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:13.880923 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11ac82-c901-4c09-a217-e420d776c732 admin admin] PATH_INFO: `/v3/projects/879c448b1a8e47e19d0cdff11e19429b/users/c2d1a8d1e6304f9dbe72e061f5ca65c9/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:13.914574 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11ac82-c901-4c09-a217-e420d776c732 admin admin] RBAC: Authorizing `identity:create_grant(project_id=879c448b1a8e47e19d0cdff11e19429b, user_id=c2d1a8d1e6304f9dbe72e061f5ca65c9, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:13.925685 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc11ac82-c901-4c09-a217-e420d776c732 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:13.959513 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1140/2240] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:45:13 2022] PUT /identity/v3/projects/879c448b1a8e47e19d0cdff11e19429b/users/c2d1a8d1e6304f9dbe72e061f5ca65c9/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:45:13.972663 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb8523-b1aa-45db-b306-34d2fea86e53 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:13.973301 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb8523-b1aa-45db-b306-34d2fea86e53 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:13.973301 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb8523-b1aa-45db-b306-34d2fea86e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:14.076665 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-f0fb8523-b1aa-45db-b306-34d2fea86e53 None None] MFA Rules not processed for user `c2d1a8d1e6304f9dbe72e061f5ca65c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:45:14.078615 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f0fb8523-b1aa-45db-b306-34d2fea86e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:14.154890 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:45:14.194991 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1101/2241] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:45:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:45:14.196729 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11ac82-c901-4c09-a217-e420d776c732 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:14.352449 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11ac82-c901-4c09-a217-e420d776c732 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:14.366645 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679a4e0-f798-49f1-af00-b549fae31d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:14.367507 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679a4e0-f798-49f1-af00-b549fae31d38 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:14.367943 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679a4e0-f798-49f1-af00-b549fae31d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:14.368892 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679a4e0-f798-49f1-af00-b549fae31d38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:14.369459 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a679a4e0-f798-49f1-af00-b549fae31d38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:14.371911 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a679a4e0-f798-49f1-af00-b549fae31d38 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:14.432949 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1141/2242] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:45:14 2022] POST /identity/v3/projects => generated 383 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:45:14.434515 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb8523-b1aa-45db-b306-34d2fea86e53 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:14.449985 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb8523-b1aa-45db-b306-34d2fea86e53 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:14.567977 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d74f5-a66e-49b8-a991-fbb9a33fbbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:14.568687 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d74f5-a66e-49b8-a991-fbb9a33fbbe0 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:14.569507 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d74f5-a66e-49b8-a991-fbb9a33fbbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:14.569809 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d74f5-a66e-49b8-a991-fbb9a33fbbe0 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:14.570557 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5d74f5-a66e-49b8-a991-fbb9a33fbbe0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:14.573303 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5d74f5-a66e-49b8-a991-fbb9a33fbbe0 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:14.609531 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1102/2243] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:45:14 2022] POST /identity/v3/users => generated 298 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:45:14.613886 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679a4e0-f798-49f1-af00-b549fae31d38 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:14.638494 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679a4e0-f798-49f1-af00-b549fae31d38 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:14.653640 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802fbc7d-f62a-403f-ba11-8a255b282c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:14.656195 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802fbc7d-f62a-403f-ba11-8a255b282c80 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:14.656484 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802fbc7d-f62a-403f-ba11-8a255b282c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:14.656759 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802fbc7d-f62a-403f-ba11-8a255b282c80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:14.657954 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802fbc7d-f62a-403f-ba11-8a255b282c80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:14.659844 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802fbc7d-f62a-403f-ba11-8a255b282c80 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:14.689602 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1142/2244] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:45:14.691491 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d74f5-a66e-49b8-a991-fbb9a33fbbe0 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:14.718898 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d74f5-a66e-49b8-a991-fbb9a33fbbe0 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:14.729945 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345be5f7-6ca2-41c5-80de-ae526ed6005d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:14.731052 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345be5f7-6ca2-41c5-80de-ae526ed6005d admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:14.731441 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345be5f7-6ca2-41c5-80de-ae526ed6005d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:14.731822 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345be5f7-6ca2-41c5-80de-ae526ed6005d admin admin] PATH_INFO: `/v3/projects/cb25f520e8594d00bb7188edfed442b0/users/b2193ce9573d46fc915bcd34fb3142e2/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:14.756438 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345be5f7-6ca2-41c5-80de-ae526ed6005d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb25f520e8594d00bb7188edfed442b0, user_id=b2193ce9573d46fc915bcd34fb3142e2, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:14.759553 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345be5f7-6ca2-41c5-80de-ae526ed6005d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:14.784245 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1103/2245] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:45:14 2022] PUT /identity/v3/projects/cb25f520e8594d00bb7188edfed442b0/users/b2193ce9573d46fc915bcd34fb3142e2/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:45:14.792539 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802fbc7d-f62a-403f-ba11-8a255b282c80 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:14.804804 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:45:14.819352 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802fbc7d-f62a-403f-ba11-8a255b282c80 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:14.939300 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ef6f7-7963-427d-8689-81f4c735c1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:14.940708 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ef6f7-7963-427d-8689-81f4c735c1dd admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:14.940979 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ef6f7-7963-427d-8689-81f4c735c1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:14.941268 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ef6f7-7963-427d-8689-81f4c735c1dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:14.942074 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3ef6f7-7963-427d-8689-81f4c735c1dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:14.944289 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3ef6f7-7963-427d-8689-81f4c735c1dd admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:14.969241 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1143/2246] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:45:14 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:45:14.970407 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345be5f7-6ca2-41c5-80de-ae526ed6005d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:14.982947 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345be5f7-6ca2-41c5-80de-ae526ed6005d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:15.007332 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc066a-9cc2-4596-bc1b-5222e4944f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:15.008247 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc066a-9cc2-4596-bc1b-5222e4944f97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:15.008531 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc066a-9cc2-4596-bc1b-5222e4944f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:15.011575 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc066a-9cc2-4596-bc1b-5222e4944f97 admin admin] PATH_INFO: `/v3/projects/cb25f520e8594d00bb7188edfed442b0/users/b2193ce9573d46fc915bcd34fb3142e2/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:15.020581 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bc066a-9cc2-4596-bc1b-5222e4944f97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb25f520e8594d00bb7188edfed442b0, user_id=b2193ce9573d46fc915bcd34fb3142e2, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:15.023348 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bc066a-9cc2-4596-bc1b-5222e4944f97 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:15.084238 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1104/2247] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:45:14 2022] PUT /identity/v3/projects/cb25f520e8594d00bb7188edfed442b0/users/b2193ce9573d46fc915bcd34fb3142e2/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:45:15.086146 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304c9a9-27c6-429c-88d6-576b941345df None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:15.086438 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304c9a9-27c6-429c-88d6-576b941345df None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:15.086746 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304c9a9-27c6-429c-88d6-576b941345df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:15.124987 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-2304c9a9-27c6-429c-88d6-576b941345df None None] MFA Rules not processed for user `b2193ce9573d46fc915bcd34fb3142e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:45:15.126958 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2304c9a9-27c6-429c-88d6-576b941345df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:15.244298 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1144/2248] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:45:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:45:15.253313 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc066a-9cc2-4596-bc1b-5222e4944f97 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:15.255846 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-38bc066a-9cc2-4596-bc1b-5222e4944f97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:15.352400 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc066a-9cc2-4596-bc1b-5222e4944f97 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:15.356238 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e966858-f9fd-4154-b79e-2a9c5721c6c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:15.356967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e966858-f9fd-4154-b79e-2a9c5721c6c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:15.357256 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e966858-f9fd-4154-b79e-2a9c5721c6c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:15.357535 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e966858-f9fd-4154-b79e-2a9c5721c6c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:15.436897 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:45:15.447167 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e966858-f9fd-4154-b79e-2a9c5721c6c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:15.448797 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e966858-f9fd-4154-b79e-2a9c5721c6c1 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:15.459324 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1105/2249] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:45:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:45:15.643818 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d96e78-7b29-428b-8d6e-af7db16308f5 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:15.644501 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d96e78-7b29-428b-8d6e-af7db16308f5 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:15.644640 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d96e78-7b29-428b-8d6e-af7db16308f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:15.711485 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-81d96e78-7b29-428b-8d6e-af7db16308f5 None None] MFA Rules not processed for user `80ed200a0cd740e8a0b857690584404e`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:45:15.713227 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-81d96e78-7b29-428b-8d6e-af7db16308f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:15.881770 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1145/2250] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:45:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:45:15.899485 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e966858-f9fd-4154-b79e-2a9c5721c6c1 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:15.901034 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0e966858-f9fd-4154-b79e-2a9c5721c6c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:16.012295 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e966858-f9fd-4154-b79e-2a9c5721c6c1 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:16.019762 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8502187-a906-42f2-a4c6-903b3a266ae5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:16.019917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8502187-a906-42f2-a4c6-903b3a266ae5 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:16.020088 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8502187-a906-42f2-a4c6-903b3a266ae5 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:16.020365 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8502187-a906-42f2-a4c6-903b3a266ae5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:16.028819 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8502187-a906-42f2-a4c6-903b3a266ae5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:16.030510 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8502187-a906-42f2-a4c6-903b3a266ae5 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:16.040212 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1106/2251] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:45:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:45:16.792106 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573e86a-fb05-4340-aaae-e22a18d93be2 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:16.793018 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573e86a-fb05-4340-aaae-e22a18d93be2 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:16.793507 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573e86a-fb05-4340-aaae-e22a18d93be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:16.832458 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-0573e86a-fb05-4340-aaae-e22a18d93be2 None None] MFA Rules not processed for user `1797ca9a94b144cfad94a45ef2d612f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:45:16.833783 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0573e86a-fb05-4340-aaae-e22a18d93be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:16.841831 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:45:16.991772 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1146/2252] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:45:16 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:45:17.006716 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8502187-a906-42f2-a4c6-903b3a266ae5 service nova] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:17.020929 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8502187-a906-42f2-a4c6-903b3a266ae5 service nova] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:17.027010 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f544834-1e71-42db-b9ef-9cc358e924db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:17.027741 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f544834-1e71-42db-b9ef-9cc358e924db service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:17.028103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f544834-1e71-42db-b9ef-9cc358e924db service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:17.028455 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f544834-1e71-42db-b9ef-9cc358e924db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:17.031395 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0f544834-1e71-42db-b9ef-9cc358e924db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:17.125808 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f544834-1e71-42db-b9ef-9cc358e924db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:17.129035 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f544834-1e71-42db-b9ef-9cc358e924db service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:17.149709 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1107/2253] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:45:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:45:17.252775 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573e86a-fb05-4340-aaae-e22a18d93be2 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:17.254770 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0573e86a-fb05-4340-aaae-e22a18d93be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:17.274759 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573e86a-fb05-4340-aaae-e22a18d93be2 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:17.281071 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492f5152-6042-4513-bba5-1fab5f5bed7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:17.282003 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f5152-6042-4513-bba5-1fab5f5bed7c service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:17.282777 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f5152-6042-4513-bba5-1fab5f5bed7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:17.283194 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492f5152-6042-4513-bba5-1fab5f5bed7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:17.420709 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492f5152-6042-4513-bba5-1fab5f5bed7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:17.423480 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492f5152-6042-4513-bba5-1fab5f5bed7c service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:17.464814 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1147/2254] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:45:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:45:18.474553 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f544834-1e71-42db-b9ef-9cc358e924db service nova] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:18.497519 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f544834-1e71-42db-b9ef-9cc358e924db service nova] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:18.504421 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02abc8e-fba6-420e-86d6-3ef7f0a1504c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:18.505622 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02abc8e-fba6-420e-86d6-3ef7f0a1504c service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:18.506069 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02abc8e-fba6-420e-86d6-3ef7f0a1504c service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:18.506505 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02abc8e-fba6-420e-86d6-3ef7f0a1504c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:18.510544 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c87cf-a680-4e5f-94e0-564bbf1177c2 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:18.511025 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c87cf-a680-4e5f-94e0-564bbf1177c2 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:18.511253 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c87cf-a680-4e5f-94e0-564bbf1177c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:18.523758 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02abc8e-fba6-420e-86d6-3ef7f0a1504c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:18.526325 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02abc8e-fba6-420e-86d6-3ef7f0a1504c service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:18.542645 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-ec0c87cf-a680-4e5f-94e0-564bbf1177c2 None None] MFA Rules not processed for user `80ed200a0cd740e8a0b857690584404e`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:45:18.543892 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ec0c87cf-a680-4e5f-94e0-564bbf1177c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:18.545372 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1108/2255] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:45:18 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:45:18.567857 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1148/2256] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:45:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:45:19.232401 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969d574-34ac-4b91-8478-64b86c830259 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:19.232693 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969d574-34ac-4b91-8478-64b86c830259 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:19.233046 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969d574-34ac-4b91-8478-64b86c830259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:19.280185 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-3969d574-34ac-4b91-8478-64b86c830259 None None] MFA Rules not processed for user `a14245daf0a34f93a1ed94a33798e051`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:45:19.288696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3969d574-34ac-4b91-8478-64b86c830259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:19.301592 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1109/2257] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:45:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:45:23.155783 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c87cf-a680-4e5f-94e0-564bbf1177c2 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:23.290914 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c87cf-a680-4e5f-94e0-564bbf1177c2 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:23.296257 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c7b2fc-4022-4bf9-af5d-ab1b489d8f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:23.297268 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7b2fc-4022-4bf9-af5d-ab1b489d8f0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:23.297619 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7b2fc-4022-4bf9-af5d-ab1b489d8f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:23.297973 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7b2fc-4022-4bf9-af5d-ab1b489d8f0b admin admin] PATH_INFO: `/v3/users/eb4d2f13b2324feb86f196d7f5486dc4` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:23.299473 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c7b2fc-4022-4bf9-af5d-ab1b489d8f0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb4d2f13b2324feb86f196d7f5486dc4)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:23.301441 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c7b2fc-4022-4bf9-af5d-ab1b489d8f0b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:23.342194 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:45:23.357819 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-61c7b2fc-4022-4bf9-af5d-ab1b489d8f0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb4d2f13b2324feb86f196d7f5486dc4'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:23.358535 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-61c7b2fc-4022-4bf9-af5d-ab1b489d8f0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb4d2f13b2324feb86f196d7f5486dc4'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:23.359234 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-61c7b2fc-4022-4bf9-af5d-ab1b489d8f0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb4d2f13b2324feb86f196d7f5486dc4'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:23.366447 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-61c7b2fc-4022-4bf9-af5d-ab1b489d8f0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb4d2f13b2324feb86f196d7f5486dc4'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:23.373973 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-61c7b2fc-4022-4bf9-af5d-ab1b489d8f0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb4d2f13b2324feb86f196d7f5486dc4'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:23.400800 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1149/2258] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:45:23 2022] DELETE /identity/v3/users/eb4d2f13b2324feb86f196d7f5486dc4 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:45:23.405200 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487cbdb-a938-422f-aa27-43fba284fe2f None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:23.405572 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487cbdb-a938-422f-aa27-43fba284fe2f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:23.405753 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487cbdb-a938-422f-aa27-43fba284fe2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:23.424540 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-a487cbdb-a938-422f-aa27-43fba284fe2f None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:45:23.425749 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a487cbdb-a938-422f-aa27-43fba284fe2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:23.476090 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:45:23.490773 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1110/2259] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:45:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:45:23.503080 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c7b2fc-4022-4bf9-af5d-ab1b489d8f0b admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:23.504970 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-61c7b2fc-4022-4bf9-af5d-ab1b489d8f0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:23.572638 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c7b2fc-4022-4bf9-af5d-ab1b489d8f0b admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:23.576529 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e1f3d-8834-40aa-865c-d7c13e40275b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:23.577240 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e1f3d-8834-40aa-865c-d7c13e40275b service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:23.577529 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e1f3d-8834-40aa-865c-d7c13e40275b service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:23.577807 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e1f3d-8834-40aa-865c-d7c13e40275b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:23.588651 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e1f3d-8834-40aa-865c-d7c13e40275b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:23.593277 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266e1f3d-8834-40aa-865c-d7c13e40275b service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:23.601100 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1150/2260] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:45:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:45:23.896611 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487cbdb-a938-422f-aa27-43fba284fe2f None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:23.898904 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a487cbdb-a938-422f-aa27-43fba284fe2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:23.914520 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487cbdb-a938-422f-aa27-43fba284fe2f None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:23.919692 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c00b7-1d34-43ea-9d79-e08fe6afec01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:23.920806 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c00b7-1d34-43ea-9d79-e08fe6afec01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:23.921088 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c00b7-1d34-43ea-9d79-e08fe6afec01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:23.921565 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c00b7-1d34-43ea-9d79-e08fe6afec01 admin admin] PATH_INFO: `/v3/projects/f2b480f31e60484ab4dbd49f97b1791b` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:23.922831 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c00b7-1d34-43ea-9d79-e08fe6afec01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2b480f31e60484ab4dbd49f97b1791b)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:23.925714 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c00b7-1d34-43ea-9d79-e08fe6afec01 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:23.984938 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-414c00b7-1d34-43ea-9d79-e08fe6afec01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2b480f31e60484ab4dbd49f97b1791b', 'request_id': 'req-414c00b7-1d34-43ea-9d79-e08fe6afec01'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:23.993446 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-414c00b7-1d34-43ea-9d79-e08fe6afec01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2b480f31e60484ab4dbd49f97b1791b', 'request_id': 'req-414c00b7-1d34-43ea-9d79-e08fe6afec01'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:24.001787 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-414c00b7-1d34-43ea-9d79-e08fe6afec01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2b480f31e60484ab4dbd49f97b1791b', 'request_id': 'req-414c00b7-1d34-43ea-9d79-e08fe6afec01'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:24.013650 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-414c00b7-1d34-43ea-9d79-e08fe6afec01 admin admin] The token cache is being invalidate because project f2b480f31e60484ab4dbd49f97b1791b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:45:24.013992 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-414c00b7-1d34-43ea-9d79-e08fe6afec01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:24.014671 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-414c00b7-1d34-43ea-9d79-e08fe6afec01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:24.016308 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1111/2261] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:45:23 2022] DELETE /identity/v3/projects/f2b480f31e60484ab4dbd49f97b1791b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:45:24.020871 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e1f3d-8834-40aa-865c-d7c13e40275b service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:24.030800 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e1f3d-8834-40aa-865c-d7c13e40275b service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:24.091347 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc0eb6-bad7-40d6-99e0-d912eea569d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:24.092226 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc0eb6-bad7-40d6-99e0-d912eea569d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:24.092513 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc0eb6-bad7-40d6-99e0-d912eea569d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:24.092797 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc0eb6-bad7-40d6-99e0-d912eea569d9 admin admin] PATH_INFO: `/v3/users/c2d1a8d1e6304f9dbe72e061f5ca65c9` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:24.094018 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fc0eb6-bad7-40d6-99e0-d912eea569d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2d1a8d1e6304f9dbe72e061f5ca65c9)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:24.096653 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fc0eb6-bad7-40d6-99e0-d912eea569d9 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:24.142337 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-67fc0eb6-bad7-40d6-99e0-d912eea569d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2d1a8d1e6304f9dbe72e061f5ca65c9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:24.143428 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-67fc0eb6-bad7-40d6-99e0-d912eea569d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2d1a8d1e6304f9dbe72e061f5ca65c9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:24.144027 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-67fc0eb6-bad7-40d6-99e0-d912eea569d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2d1a8d1e6304f9dbe72e061f5ca65c9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:24.151021 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-67fc0eb6-bad7-40d6-99e0-d912eea569d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2d1a8d1e6304f9dbe72e061f5ca65c9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:24.152952 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:45:24.160484 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-67fc0eb6-bad7-40d6-99e0-d912eea569d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2d1a8d1e6304f9dbe72e061f5ca65c9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:24.179787 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1151/2262] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:45:24 2022] DELETE /identity/v3/users/c2d1a8d1e6304f9dbe72e061f5ca65c9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:45:24.550284 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c00b7-1d34-43ea-9d79-e08fe6afec01 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:24.551972 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-414c00b7-1d34-43ea-9d79-e08fe6afec01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:24.566328 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c00b7-1d34-43ea-9d79-e08fe6afec01 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:24.623998 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24906bbb-73b4-48b3-af88-1c857944f607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:24.624860 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24906bbb-73b4-48b3-af88-1c857944f607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:24.625140 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24906bbb-73b4-48b3-af88-1c857944f607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:24.625407 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24906bbb-73b4-48b3-af88-1c857944f607 admin admin] PATH_INFO: `/v3/projects/879c448b1a8e47e19d0cdff11e19429b` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:24.626609 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24906bbb-73b4-48b3-af88-1c857944f607 admin admin] RBAC: Authorizing `identity:delete_project(project_id=879c448b1a8e47e19d0cdff11e19429b)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:24.629064 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24906bbb-73b4-48b3-af88-1c857944f607 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:24.677628 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-24906bbb-73b4-48b3-af88-1c857944f607 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '879c448b1a8e47e19d0cdff11e19429b', 'request_id': 'req-24906bbb-73b4-48b3-af88-1c857944f607'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:24.684856 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-24906bbb-73b4-48b3-af88-1c857944f607 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '879c448b1a8e47e19d0cdff11e19429b', 'request_id': 'req-24906bbb-73b4-48b3-af88-1c857944f607'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:24.696637 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-24906bbb-73b4-48b3-af88-1c857944f607 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '879c448b1a8e47e19d0cdff11e19429b', 'request_id': 'req-24906bbb-73b4-48b3-af88-1c857944f607'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:24.708478 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-24906bbb-73b4-48b3-af88-1c857944f607 admin admin] The token cache is being invalidate because project 879c448b1a8e47e19d0cdff11e19429b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:45:24.708800 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-24906bbb-73b4-48b3-af88-1c857944f607 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:24.709540 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-24906bbb-73b4-48b3-af88-1c857944f607 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:24.712357 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1112/2263] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:45:24 2022] DELETE /identity/v3/projects/879c448b1a8e47e19d0cdff11e19429b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:45:24.715179 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc0eb6-bad7-40d6-99e0-d912eea569d9 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:24.717121 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-67fc0eb6-bad7-40d6-99e0-d912eea569d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:24.730367 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc0eb6-bad7-40d6-99e0-d912eea569d9 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:24.789494 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d0520-dfaa-44e8-b321-d11917d9fc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:24.790365 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d0520-dfaa-44e8-b321-d11917d9fc54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:24.790675 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d0520-dfaa-44e8-b321-d11917d9fc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:24.790953 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d0520-dfaa-44e8-b321-d11917d9fc54 admin admin] PATH_INFO: `/v3/users/b2193ce9573d46fc915bcd34fb3142e2` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:24.792142 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d0520-dfaa-44e8-b321-d11917d9fc54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2193ce9573d46fc915bcd34fb3142e2)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:24.794106 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d0520-dfaa-44e8-b321-d11917d9fc54 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:24.842580 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e33d0520-dfaa-44e8-b321-d11917d9fc54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2193ce9573d46fc915bcd34fb3142e2'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:24.843230 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e33d0520-dfaa-44e8-b321-d11917d9fc54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2193ce9573d46fc915bcd34fb3142e2'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:24.843829 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e33d0520-dfaa-44e8-b321-d11917d9fc54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2193ce9573d46fc915bcd34fb3142e2'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:24.851037 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e33d0520-dfaa-44e8-b321-d11917d9fc54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2193ce9573d46fc915bcd34fb3142e2'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:24.858378 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e33d0520-dfaa-44e8-b321-d11917d9fc54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2193ce9573d46fc915bcd34fb3142e2'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:24.875733 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1152/2264] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:45:24 2022] DELETE /identity/v3/users/b2193ce9573d46fc915bcd34fb3142e2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:45:25.154255 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24906bbb-73b4-48b3-af88-1c857944f607 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:25.155794 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-24906bbb-73b4-48b3-af88-1c857944f607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:25.171096 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24906bbb-73b4-48b3-af88-1c857944f607 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:25.177134 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:45:25.234006 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0a3c0-a78c-4635-95ba-ef523bebb82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:25.234840 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0a3c0-a78c-4635-95ba-ef523bebb82a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:25.235226 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0a3c0-a78c-4635-95ba-ef523bebb82a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:25.235507 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0a3c0-a78c-4635-95ba-ef523bebb82a admin admin] PATH_INFO: `/v3/projects/cb25f520e8594d00bb7188edfed442b0` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:25.237335 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc0a3c0-a78c-4635-95ba-ef523bebb82a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb25f520e8594d00bb7188edfed442b0)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:25.239331 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc0a3c0-a78c-4635-95ba-ef523bebb82a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:25.286955 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3cc0a3c0-a78c-4635-95ba-ef523bebb82a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb25f520e8594d00bb7188edfed442b0', 'request_id': 'req-3cc0a3c0-a78c-4635-95ba-ef523bebb82a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:25.293075 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3cc0a3c0-a78c-4635-95ba-ef523bebb82a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb25f520e8594d00bb7188edfed442b0', 'request_id': 'req-3cc0a3c0-a78c-4635-95ba-ef523bebb82a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:25.300805 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3cc0a3c0-a78c-4635-95ba-ef523bebb82a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb25f520e8594d00bb7188edfed442b0', 'request_id': 'req-3cc0a3c0-a78c-4635-95ba-ef523bebb82a'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:25.311745 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3cc0a3c0-a78c-4635-95ba-ef523bebb82a admin admin] The token cache is being invalidate because project cb25f520e8594d00bb7188edfed442b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:45:25.312038 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3cc0a3c0-a78c-4635-95ba-ef523bebb82a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:25.312686 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3cc0a3c0-a78c-4635-95ba-ef523bebb82a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:25.314234 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1113/2265] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:45:25 2022] DELETE /identity/v3/projects/cb25f520e8594d00bb7188edfed442b0 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:45:25.319082 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f12c2-fb38-48db-8bea-c85353544e84 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:25.319529 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f12c2-fb38-48db-8bea-c85353544e84 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:25.319650 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51f12c2-fb38-48db-8bea-c85353544e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:25.337282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-a51f12c2-fb38-48db-8bea-c85353544e84 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:45:25.338499 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a51f12c2-fb38-48db-8bea-c85353544e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:25.386688 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:45:25.404007 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1153/2266] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:45:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:45:25.412670 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151b6eb-0eea-443f-8631-97f290a016c5 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:25.412958 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151b6eb-0eea-443f-8631-97f290a016c5 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:25.413234 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151b6eb-0eea-443f-8631-97f290a016c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:25.432238 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-6151b6eb-0eea-443f-8631-97f290a016c5 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:45:25.434231 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6151b6eb-0eea-443f-8631-97f290a016c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:25.442279 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1114/2267] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:45:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:45:25.446549 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f12c2-fb38-48db-8bea-c85353544e84 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:25.456934 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51f12c2-fb38-48db-8bea-c85353544e84 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:25.463285 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df5f48-8650-4753-8ca8-546fa46fac8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:25.464052 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df5f48-8650-4753-8ca8-546fa46fac8c admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:25.464339 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df5f48-8650-4753-8ca8-546fa46fac8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:25.464617 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df5f48-8650-4753-8ca8-546fa46fac8c admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:25.465348 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df5f48-8650-4753-8ca8-546fa46fac8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:45:25.465657 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df5f48-8650-4753-8ca8-546fa46fac8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:25.467276 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df5f48-8650-4753-8ca8-546fa46fac8c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:25.483671 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1154/2268] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:45:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:45:25.484825 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151b6eb-0eea-443f-8631-97f290a016c5 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:25.493882 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6151b6eb-0eea-443f-8631-97f290a016c5 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:25.498573 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78aa26-4eff-4aa2-af51-44c5e4fec884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:25.499254 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78aa26-4eff-4aa2-af51-44c5e4fec884 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:25.499533 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78aa26-4eff-4aa2-af51-44c5e4fec884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:25.499806 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c78aa26-4eff-4aa2-af51-44c5e4fec884 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:25.500562 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c78aa26-4eff-4aa2-af51-44c5e4fec884 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:25.502502 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c78aa26-4eff-4aa2-af51-44c5e4fec884 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:25.531672 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1115/2269] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:45:25 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:45:25.536971 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df5f48-8650-4753-8ca8-546fa46fac8c admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:25.546692 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df5f48-8650-4753-8ca8-546fa46fac8c admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:25.609500 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf84a80-8111-47db-bb10-6777e5f72cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:25.610208 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf84a80-8111-47db-bb10-6777e5f72cbf admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:25.610618 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf84a80-8111-47db-bb10-6777e5f72cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:25.610906 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf84a80-8111-47db-bb10-6777e5f72cbf admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:25.611637 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf84a80-8111-47db-bb10-6777e5f72cbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:25.613562 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf84a80-8111-47db-bb10-6777e5f72cbf admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:25.634628 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1155/2270] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:45:25 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:45:25.639066 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78aa26-4eff-4aa2-af51-44c5e4fec884 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:25.650268 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c78aa26-4eff-4aa2-af51-44c5e4fec884 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:25.655239 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc558d4c-3994-4c5a-b05b-caaa1afd87b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:25.655969 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc558d4c-3994-4c5a-b05b-caaa1afd87b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:25.656321 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc558d4c-3994-4c5a-b05b-caaa1afd87b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:25.656689 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc558d4c-3994-4c5a-b05b-caaa1afd87b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:25.657750 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc558d4c-3994-4c5a-b05b-caaa1afd87b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:25.660129 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc558d4c-3994-4c5a-b05b-caaa1afd87b8 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:25.671169 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1116/2271] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 03:45:25.675232 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf84a80-8111-47db-bb10-6777e5f72cbf admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:25.685282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf84a80-8111-47db-bb10-6777e5f72cbf admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:25.690198 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f3afd-3f18-4b93-96da-8cf751075c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:25.690913 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f3afd-3f18-4b93-96da-8cf751075c3a admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:25.691203 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f3afd-3f18-4b93-96da-8cf751075c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:25.691488 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f3afd-3f18-4b93-96da-8cf751075c3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:25.692236 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f3afd-3f18-4b93-96da-8cf751075c3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:25.693859 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012f3afd-3f18-4b93-96da-8cf751075c3a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:25.704861 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1156/2272] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:45:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:45:25.709530 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc558d4c-3994-4c5a-b05b-caaa1afd87b8 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:25.719656 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc558d4c-3994-4c5a-b05b-caaa1afd87b8 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:25.724728 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c169c7-8470-4e87-af87-ae79fa3ddc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:25.725603 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c169c7-8470-4e87-af87-ae79fa3ddc98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:25.725912 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c169c7-8470-4e87-af87-ae79fa3ddc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:25.726186 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c169c7-8470-4e87-af87-ae79fa3ddc98 admin admin] PATH_INFO: `/v3/projects/ff1ff92ccfe14f66907696e347962ce2/users/fc308bc93cc649179767b89903dcd8a6/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:25.740852 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c169c7-8470-4e87-af87-ae79fa3ddc98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff1ff92ccfe14f66907696e347962ce2, user_id=fc308bc93cc649179767b89903dcd8a6, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:25.743974 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c169c7-8470-4e87-af87-ae79fa3ddc98 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:25.757753 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1117/2273] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:45:25 2022] PUT /identity/v3/projects/ff1ff92ccfe14f66907696e347962ce2/users/fc308bc93cc649179767b89903dcd8a6/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:45:25.762820 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565fc729-7606-4909-8384-1bd48a934e50 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:25.763111 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565fc729-7606-4909-8384-1bd48a934e50 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:25.763385 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565fc729-7606-4909-8384-1bd48a934e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:25.781336 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-565fc729-7606-4909-8384-1bd48a934e50 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:45:25.782821 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-565fc729-7606-4909-8384-1bd48a934e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:25.845326 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1157/2274] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:45:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:45:25.855024 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c169c7-8470-4e87-af87-ae79fa3ddc98 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:25.856777 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e6c169c7-8470-4e87-af87-ae79fa3ddc98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:25.900657 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:45:25.920174 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c169c7-8470-4e87-af87-ae79fa3ddc98 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:25.925124 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62480fb9-6ccf-4dfa-8e2e-7a98edd41085 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:25.925790 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62480fb9-6ccf-4dfa-8e2e-7a98edd41085 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:25.926071 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62480fb9-6ccf-4dfa-8e2e-7a98edd41085 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:25.926351 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62480fb9-6ccf-4dfa-8e2e-7a98edd41085 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:25.935831 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62480fb9-6ccf-4dfa-8e2e-7a98edd41085 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:25.937281 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62480fb9-6ccf-4dfa-8e2e-7a98edd41085 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:25.947768 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1118/2275] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:45:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:45:26.647980 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080db0e-e590-4c38-ad69-4d6055f56fb6 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:26.648473 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080db0e-e590-4c38-ad69-4d6055f56fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:26.648558 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080db0e-e590-4c38-ad69-4d6055f56fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:26.676112 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-1080db0e-e590-4c38-ad69-4d6055f56fb6 None None] MFA Rules not processed for user `fc308bc93cc649179767b89903dcd8a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:45:26.677332 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1080db0e-e590-4c38-ad69-4d6055f56fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:26.746498 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:45:26.769717 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1158/2276] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:45:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:45:26.780693 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62480fb9-6ccf-4dfa-8e2e-7a98edd41085 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:26.782636 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-62480fb9-6ccf-4dfa-8e2e-7a98edd41085 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:26.851391 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62480fb9-6ccf-4dfa-8e2e-7a98edd41085 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:26.855131 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b084c-6826-446c-9654-e87870205fc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:26.855754 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b084c-6826-446c-9654-e87870205fc2 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:26.856040 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b084c-6826-446c-9654-e87870205fc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:26.856320 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b084c-6826-446c-9654-e87870205fc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:26.865807 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b084c-6826-446c-9654-e87870205fc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:26.867265 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b084c-6826-446c-9654-e87870205fc2 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:26.876033 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1119/2277] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:45:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:45:28.253134 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a91c0-d73b-4177-983c-a071482de21f None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:28.253621 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a91c0-d73b-4177-983c-a071482de21f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:28.253832 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a91c0-d73b-4177-983c-a071482de21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:28.277865 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-fa2a91c0-d73b-4177-983c-a071482de21f None None] MFA Rules not processed for user `fc308bc93cc649179767b89903dcd8a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:45:28.277865 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-fa2a91c0-d73b-4177-983c-a071482de21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:28.284567 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1159/2278] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:45:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:45:33.601662 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b084c-6826-446c-9654-e87870205fc2 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:33.604341 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7e9b084c-6826-446c-9654-e87870205fc2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:33.618637 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b084c-6826-446c-9654-e87870205fc2 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:33.623121 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68c59d-1576-46d5-bfc3-4100cef9ae82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:33.623994 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68c59d-1576-46d5-bfc3-4100cef9ae82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:33.624278 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68c59d-1576-46d5-bfc3-4100cef9ae82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:33.624554 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68c59d-1576-46d5-bfc3-4100cef9ae82 admin admin] PATH_INFO: `/v3/users/49b051839fd74ab0a2feffae10f81b48` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:33.625740 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68c59d-1576-46d5-bfc3-4100cef9ae82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49b051839fd74ab0a2feffae10f81b48)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:33.628236 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68c59d-1576-46d5-bfc3-4100cef9ae82 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:33.683908 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0b68c59d-1576-46d5-bfc3-4100cef9ae82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49b051839fd74ab0a2feffae10f81b48'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:33.684735 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0b68c59d-1576-46d5-bfc3-4100cef9ae82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49b051839fd74ab0a2feffae10f81b48'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:33.685399 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0b68c59d-1576-46d5-bfc3-4100cef9ae82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49b051839fd74ab0a2feffae10f81b48'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:33.706667 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0b68c59d-1576-46d5-bfc3-4100cef9ae82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49b051839fd74ab0a2feffae10f81b48'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:33.728016 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0b68c59d-1576-46d5-bfc3-4100cef9ae82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49b051839fd74ab0a2feffae10f81b48'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:33.763322 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1120/2279] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:45:33 2022] DELETE /identity/v3/users/49b051839fd74ab0a2feffae10f81b48 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:45:33.768393 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0b011-e1d5-4d41-8e8b-1a18d84a2da1 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:33.768944 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0b011-e1d5-4d41-8e8b-1a18d84a2da1 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:33.769604 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0b011-e1d5-4d41-8e8b-1a18d84a2da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:33.816803 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-9de0b011-e1d5-4d41-8e8b-1a18d84a2da1 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:45:33.824981 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9de0b011-e1d5-4d41-8e8b-1a18d84a2da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:33.914597 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1160/2280] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:45:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:45:33.924330 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68c59d-1576-46d5-bfc3-4100cef9ae82 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:33.927477 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0b68c59d-1576-46d5-bfc3-4100cef9ae82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:33.990021 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68c59d-1576-46d5-bfc3-4100cef9ae82 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:33.993581 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4987f28e-190b-4353-9637-36dc27b4af4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:33.994228 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987f28e-190b-4353-9637-36dc27b4af4a service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:33.994544 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987f28e-190b-4353-9637-36dc27b4af4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:33.994823 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987f28e-190b-4353-9637-36dc27b4af4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:34.002860 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:45:34.006862 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4987f28e-190b-4353-9637-36dc27b4af4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:34.007130 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4987f28e-190b-4353-9637-36dc27b4af4a service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:34.019523 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1121/2281] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:45:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:45:34.426220 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de0b011-e1d5-4d41-8e8b-1a18d84a2da1 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:34.428008 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9de0b011-e1d5-4d41-8e8b-1a18d84a2da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:34.446553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de0b011-e1d5-4d41-8e8b-1a18d84a2da1 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:34.452308 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c48152c-33d5-42ef-bec7-d3170265c530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:34.453369 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48152c-33d5-42ef-bec7-d3170265c530 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:34.453697 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48152c-33d5-42ef-bec7-d3170265c530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:34.454213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48152c-33d5-42ef-bec7-d3170265c530 admin admin] PATH_INFO: `/v3/projects/08f6efc703bb486785bf550a8dbc2749` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:34.456278 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c48152c-33d5-42ef-bec7-d3170265c530 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08f6efc703bb486785bf550a8dbc2749)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:34.458654 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c48152c-33d5-42ef-bec7-d3170265c530 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:34.511927 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3c48152c-33d5-42ef-bec7-d3170265c530 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08f6efc703bb486785bf550a8dbc2749', 'request_id': 'req-3c48152c-33d5-42ef-bec7-d3170265c530'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:34.519299 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3c48152c-33d5-42ef-bec7-d3170265c530 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08f6efc703bb486785bf550a8dbc2749', 'request_id': 'req-3c48152c-33d5-42ef-bec7-d3170265c530'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:34.527564 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3c48152c-33d5-42ef-bec7-d3170265c530 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08f6efc703bb486785bf550a8dbc2749', 'request_id': 'req-3c48152c-33d5-42ef-bec7-d3170265c530'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:34.541354 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3c48152c-33d5-42ef-bec7-d3170265c530 admin admin] The token cache is being invalidate because project 08f6efc703bb486785bf550a8dbc2749 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:45:34.541649 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3c48152c-33d5-42ef-bec7-d3170265c530 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:34.542343 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3c48152c-33d5-42ef-bec7-d3170265c530 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:45:34.543947 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1161/2282] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:45:34 2022] DELETE /identity/v3/projects/08f6efc703bb486785bf550a8dbc2749 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:45:34.548750 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbc63f-340f-46b7-87e5-05219cbae58b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:34.549044 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbc63f-340f-46b7-87e5-05219cbae58b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:34.549329 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbc63f-340f-46b7-87e5-05219cbae58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:34.572444 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-6edbc63f-340f-46b7-87e5-05219cbae58b None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:45:34.573985 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6edbc63f-340f-46b7-87e5-05219cbae58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:34.672751 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1122/2283] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:45:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:45:34.677608 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb62db-c588-4eae-9c31-f742edc79148 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:34.677900 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb62db-c588-4eae-9c31-f742edc79148 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:34.678195 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb62db-c588-4eae-9c31-f742edc79148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:34.702298 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-4ffb62db-c588-4eae-9c31-f742edc79148 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:45:34.703560 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4ffb62db-c588-4eae-9c31-f742edc79148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:34.721181 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1162/2284] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:45:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:45:34.725273 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edbc63f-340f-46b7-87e5-05219cbae58b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:34.737910 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edbc63f-340f-46b7-87e5-05219cbae58b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:34.746268 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461def9-21cd-4cfe-af28-9d8e617ffa3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:34.747874 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461def9-21cd-4cfe-af28-9d8e617ffa3f admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:34.748310 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461def9-21cd-4cfe-af28-9d8e617ffa3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:34.754929 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2461def9-21cd-4cfe-af28-9d8e617ffa3f admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:34.755956 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2461def9-21cd-4cfe-af28-9d8e617ffa3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:45:34.756236 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2461def9-21cd-4cfe-af28-9d8e617ffa3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:34.759573 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2461def9-21cd-4cfe-af28-9d8e617ffa3f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:34.773830 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1123/2285] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:45:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:45:34.778056 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb62db-c588-4eae-9c31-f742edc79148 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:34.802676 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb62db-c588-4eae-9c31-f742edc79148 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:34.812478 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751cbc76-d14d-4ecd-8df3-bd27c51dfd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:34.813233 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cbc76-d14d-4ecd-8df3-bd27c51dfd99 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:34.813588 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cbc76-d14d-4ecd-8df3-bd27c51dfd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:34.813984 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cbc76-d14d-4ecd-8df3-bd27c51dfd99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:34.815325 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751cbc76-d14d-4ecd-8df3-bd27c51dfd99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:34.817466 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751cbc76-d14d-4ecd-8df3-bd27c51dfd99 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:34.852619 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1163/2286] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:45:34 2022] POST /identity/v3/projects => generated 383 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:45:34.856497 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461def9-21cd-4cfe-af28-9d8e617ffa3f admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:34.867740 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2461def9-21cd-4cfe-af28-9d8e617ffa3f admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:34.934595 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f73aa2-2c69-4be8-966e-0d13db9a77f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:34.935289 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f73aa2-2c69-4be8-966e-0d13db9a77f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:34.935575 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f73aa2-2c69-4be8-966e-0d13db9a77f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:34.935847 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f73aa2-2c69-4be8-966e-0d13db9a77f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:34.936568 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f73aa2-2c69-4be8-966e-0d13db9a77f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:34.938514 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f73aa2-2c69-4be8-966e-0d13db9a77f7 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:34.964910 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1124/2287] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:45:34 2022] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:45:34.969129 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751cbc76-d14d-4ecd-8df3-bd27c51dfd99 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:34.983709 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751cbc76-d14d-4ecd-8df3-bd27c51dfd99 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:34.988585 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff27a9c-edb3-45d7-b395-fbe77195f5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:34.989362 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff27a9c-edb3-45d7-b395-fbe77195f5bc admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:34.989709 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff27a9c-edb3-45d7-b395-fbe77195f5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:34.990058 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff27a9c-edb3-45d7-b395-fbe77195f5bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:34.991041 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff27a9c-edb3-45d7-b395-fbe77195f5bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:34.992852 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff27a9c-edb3-45d7-b395-fbe77195f5bc admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:35.006621 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1164/2288] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:45:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:45:35.008734 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f73aa2-2c69-4be8-966e-0d13db9a77f7 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:35.019538 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f73aa2-2c69-4be8-966e-0d13db9a77f7 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:35.024174 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f403506-f9b8-4684-89b7-481d78a45806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:35.024847 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f403506-f9b8-4684-89b7-481d78a45806 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:35.025132 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f403506-f9b8-4684-89b7-481d78a45806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:35.025410 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f403506-f9b8-4684-89b7-481d78a45806 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:35.026147 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f403506-f9b8-4684-89b7-481d78a45806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:35.027813 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f403506-f9b8-4684-89b7-481d78a45806 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:35.042553 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1125/2289] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:45:35.043995 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff27a9c-edb3-45d7-b395-fbe77195f5bc admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:35.054308 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff27a9c-edb3-45d7-b395-fbe77195f5bc admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:35.058970 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc32f7-724e-4f64-8fa3-c7d353144d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:35.059851 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc32f7-724e-4f64-8fa3-c7d353144d12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:35.060141 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc32f7-724e-4f64-8fa3-c7d353144d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:35.060421 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc32f7-724e-4f64-8fa3-c7d353144d12 admin admin] PATH_INFO: `/v3/projects/ebb41f5a255940849923f298bd5dd552/users/d00aad208d65407bbe57513d3feae922/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:35.075808 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc32f7-724e-4f64-8fa3-c7d353144d12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebb41f5a255940849923f298bd5dd552, user_id=d00aad208d65407bbe57513d3feae922, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:35.078477 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc32f7-724e-4f64-8fa3-c7d353144d12 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:35.091675 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1165/2290] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:45:35 2022] PUT /identity/v3/projects/ebb41f5a255940849923f298bd5dd552/users/d00aad208d65407bbe57513d3feae922/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:45:35.096874 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544db73-411a-4d12-96c9-fe41dd6e0c21 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:35.097218 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544db73-411a-4d12-96c9-fe41dd6e0c21 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:35.097504 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544db73-411a-4d12-96c9-fe41dd6e0c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:35.115157 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-8544db73-411a-4d12-96c9-fe41dd6e0c21 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:45:35.116383 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8544db73-411a-4d12-96c9-fe41dd6e0c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:35.186787 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1126/2291] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:45:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:45:35.194192 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc32f7-724e-4f64-8fa3-c7d353144d12 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:35.196021 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8efc32f7-724e-4f64-8fa3-c7d353144d12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:35.203341 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:45:35.286012 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc32f7-724e-4f64-8fa3-c7d353144d12 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:35.289868 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97099f3-c79a-42a2-9abe-6d6176b01a57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:35.290554 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97099f3-c79a-42a2-9abe-6d6176b01a57 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:35.290845 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97099f3-c79a-42a2-9abe-6d6176b01a57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:35.291121 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97099f3-c79a-42a2-9abe-6d6176b01a57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:35.303635 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97099f3-c79a-42a2-9abe-6d6176b01a57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:35.305868 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97099f3-c79a-42a2-9abe-6d6176b01a57 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:35.316754 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1166/2292] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:45:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:45:36.042448 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda9efb-c54a-4ef6-b896-216099365285 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:36.042982 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda9efb-c54a-4ef6-b896-216099365285 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:36.043093 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda9efb-c54a-4ef6-b896-216099365285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:36.049192 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:45:36.077011 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-2fda9efb-c54a-4ef6-b896-216099365285 None None] MFA Rules not processed for user `d00aad208d65407bbe57513d3feae922`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:45:36.078765 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2fda9efb-c54a-4ef6-b896-216099365285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:36.181252 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1127/2293] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:45:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:45:36.192709 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97099f3-c79a-42a2-9abe-6d6176b01a57 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:45:36.194220 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a97099f3-c79a-42a2-9abe-6d6176b01a57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:36.251235 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97099f3-c79a-42a2-9abe-6d6176b01a57 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:45:36.256147 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2b5932-19e1-4c52-a62f-597f29f904a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:45:36.257086 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b5932-19e1-4c52-a62f-597f29f904a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:36.257465 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b5932-19e1-4c52-a62f-597f29f904a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:36.257748 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2b5932-19e1-4c52-a62f-597f29f904a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:36.266229 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b5932-19e1-4c52-a62f-597f29f904a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:45:36.267766 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2b5932-19e1-4c52-a62f-597f29f904a8 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:45:36.276604 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1167/2294] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:45:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:45:37.655135 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe2747-c52e-493b-979a-56186ca4cc9b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:37.655572 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe2747-c52e-493b-979a-56186ca4cc9b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:37.655700 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe2747-c52e-493b-979a-56186ca4cc9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:37.674161 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-77fe2747-c52e-493b-979a-56186ca4cc9b None None] MFA Rules not processed for user `d00aad208d65407bbe57513d3feae922`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:45:37.675415 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-77fe2747-c52e-493b-979a-56186ca4cc9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:37.682444 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1128/2295] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:45:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:45:46.272518 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=51 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:45:47.668352 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=34 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:45:54.632559 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6f71e-5932-4bc1-87fc-76b6ad4259b1 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:45:54.633076 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6f71e-5932-4bc1-87fc-76b6ad4259b1 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:45:54.633171 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c6f71e-5932-4bc1-87fc-76b6ad4259b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:45:54.697788 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-c5c6f71e-5932-4bc1-87fc-76b6ad4259b1 None None] MFA Rules not processed for user `fc308bc93cc649179767b89903dcd8a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:45:54.702332 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c5c6f71e-5932-4bc1-87fc-76b6ad4259b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:45:54.816877 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1168/2296] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:45:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:46:04.807133 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=25 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:46:08.104811 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4aad11-de6d-40be-a8b3-ed2cbbe22ca9 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:46:08.105701 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4aad11-de6d-40be-a8b3-ed2cbbe22ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:46:08.106038 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4aad11-de6d-40be-a8b3-ed2cbbe22ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:46:08.124925 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ce4aad11-de6d-40be-a8b3-ed2cbbe22ca9 None None] MFA Rules not processed for user `8d4f1b27da1540339cb16efcb079135f`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:46:08.126129 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ce4aad11-de6d-40be-a8b3-ed2cbbe22ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:46:08.186084 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1129/2297] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:46:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:46:11.954870 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c6f71e-5932-4bc1-87fc-76b6ad4259b1 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:46:11.964386 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c6f71e-5932-4bc1-87fc-76b6ad4259b1 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:46:11.968015 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf071bd-1a43-4519-8e77-4b5e2bac2ba1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:46:11.968661 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf071bd-1a43-4519-8e77-4b5e2bac2ba1 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:46:11.968948 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf071bd-1a43-4519-8e77-4b5e2bac2ba1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:46:11.969227 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf071bd-1a43-4519-8e77-4b5e2bac2ba1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:46:11.971051 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6bf071bd-1a43-4519-8e77-4b5e2bac2ba1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:46:12.039814 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf071bd-1a43-4519-8e77-4b5e2bac2ba1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:46:12.042081 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf071bd-1a43-4519-8e77-4b5e2bac2ba1 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:46:12.054872 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1169/2298] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:46:11 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 03:46:18.179609 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=25 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:46:22.049264 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=30 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:46:25.444348 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2236c2-b868-4bc5-8fbf-13b405f32fc0 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:46:25.444954 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2236c2-b868-4bc5-8fbf-13b405f32fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:46:25.445305 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2236c2-b868-4bc5-8fbf-13b405f32fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:46:25.467973 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ce2236c2-b868-4bc5-8fbf-13b405f32fc0 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:46:25.469238 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ce2236c2-b868-4bc5-8fbf-13b405f32fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:46:25.477705 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1130/2299] 10.222.0.36 () {58 vars in 1016 bytes} [Thu Jul 21 03:46:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:46:25.503020 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf071bd-1a43-4519-8e77-4b5e2bac2ba1 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:46:25.505019 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6bf071bd-1a43-4519-8e77-4b5e2bac2ba1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:46:25.590281 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf071bd-1a43-4519-8e77-4b5e2bac2ba1 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:46:25.596335 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d30782-6260-488f-bdd5-0a88d92ffe1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:46:25.596997 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d30782-6260-488f-bdd5-0a88d92ffe1b service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:46:25.597287 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d30782-6260-488f-bdd5-0a88d92ffe1b service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:46:25.597567 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d30782-6260-488f-bdd5-0a88d92ffe1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:46:25.606883 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d30782-6260-488f-bdd5-0a88d92ffe1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:46:25.608618 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d30782-6260-488f-bdd5-0a88d92ffe1b service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:46:25.619059 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1170/2300] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:46:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:46:27.658889 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cadbcf4-a255-4ace-b575-7f13cdad5f55 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:46:27.659337 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cadbcf4-a255-4ace-b575-7f13cdad5f55 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:46:27.659441 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cadbcf4-a255-4ace-b575-7f13cdad5f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:46:27.676793 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-9cadbcf4-a255-4ace-b575-7f13cdad5f55 None None] MFA Rules not processed for user `73fad109df9f449e8ac5f38749c01ace`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:46:27.677991 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9cadbcf4-a255-4ace-b575-7f13cdad5f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:46:27.734508 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1131/2301] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jul 21 03:46:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:46:27.777032 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d30782-6260-488f-bdd5-0a88d92ffe1b service nova] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:46:27.778395 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-80d30782-6260-488f-bdd5-0a88d92ffe1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:46:27.848313 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d30782-6260-488f-bdd5-0a88d92ffe1b service nova] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:46:27.853324 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ddd82-62f6-48e4-9d15-c189f43afbc3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8bc228892e45c0a7d1b529c2f9a8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:46:27.853967 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ddd82-62f6-48e4-9d15-c189f43afbc3 service swift] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:46:27.854252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ddd82-62f6-48e4-9d15-c189f43afbc3 service swift] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:46:27.854561 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ddd82-62f6-48e4-9d15-c189f43afbc3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:46:27.862481 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ddd82-62f6-48e4-9d15-c189f43afbc3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:46:27.864425 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ddd82-62f6-48e4-9d15-c189f43afbc3 service swift] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:46:27.872440 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1171/2302] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jul 21 03:46:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 03:46:31.620780 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17783790-23a1-478f-8359-f702ebdd2c96 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:46:31.621286 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17783790-23a1-478f-8359-f702ebdd2c96 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:46:31.621389 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17783790-23a1-478f-8359-f702ebdd2c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:46:31.663336 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-17783790-23a1-478f-8359-f702ebdd2c96 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:46:31.665551 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-17783790-23a1-478f-8359-f702ebdd2c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:46:31.684090 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1132/2303] 10.222.0.36 () {58 vars in 1016 bytes} [Thu Jul 21 03:46:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:46:31.712956 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ddd82-62f6-48e4-9d15-c189f43afbc3 service swift] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:46:31.753359 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ddd82-62f6-48e4-9d15-c189f43afbc3 service swift] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:46:31.774808 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a03120-4cb8-4d98-be41-25b81d785945 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:46:31.776386 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a03120-4cb8-4d98-be41-25b81d785945 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:46:31.777532 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a03120-4cb8-4d98-be41-25b81d785945 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:46:31.778428 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a03120-4cb8-4d98-be41-25b81d785945 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:46:31.796484 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a03120-4cb8-4d98-be41-25b81d785945 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:46:31.799123 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a03120-4cb8-4d98-be41-25b81d785945 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:46:31.814044 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1172/2304] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:46:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:46:36.013519 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d09d2-6f80-434d-862b-4b7ed36d48b4 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:46:36.014217 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d09d2-6f80-434d-862b-4b7ed36d48b4 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:46:36.014217 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d09d2-6f80-434d-862b-4b7ed36d48b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:46:36.042017 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-da5d09d2-6f80-434d-862b-4b7ed36d48b4 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:46:36.043616 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-da5d09d2-6f80-434d-862b-4b7ed36d48b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:46:36.053265 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1133/2305] 10.222.0.36 () {58 vars in 1016 bytes} [Thu Jul 21 03:46:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:46:36.079056 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a03120-4cb8-4d98-be41-25b81d785945 service nova] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:46:36.096278 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a03120-4cb8-4d98-be41-25b81d785945 service nova] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:46:36.103648 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c772a-6e4e-431b-a062-a0fefc43f508 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:46:36.104500 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c772a-6e4e-431b-a062-a0fefc43f508 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:46:36.104935 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c772a-6e4e-431b-a062-a0fefc43f508 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:46:36.105356 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c772a-6e4e-431b-a062-a0fefc43f508 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:46:36.114787 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627c772a-6e4e-431b-a062-a0fefc43f508 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:46:36.116577 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627c772a-6e4e-431b-a062-a0fefc43f508 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:46:36.127635 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1173/2306] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:46:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:46:40.166296 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe187017-c478-4c11-8511-e3089f983b91 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:46:40.166876 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe187017-c478-4c11-8511-e3089f983b91 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:46:40.166876 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe187017-c478-4c11-8511-e3089f983b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:46:40.184875 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-fe187017-c478-4c11-8511-e3089f983b91 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:46:40.186089 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fe187017-c478-4c11-8511-e3089f983b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:46:40.193985 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1134/2307] 10.222.0.36 () {58 vars in 1016 bytes} [Thu Jul 21 03:46:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:46:40.237735 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c772a-6e4e-431b-a062-a0fefc43f508 service nova] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:46:40.241814 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-627c772a-6e4e-431b-a062-a0fefc43f508 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:46:40.280081 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c772a-6e4e-431b-a062-a0fefc43f508 service nova] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:46:40.285951 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da4774-6c33-456f-91ba-a9d21e499ced service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:46:40.288244 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da4774-6c33-456f-91ba-a9d21e499ced service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:46:40.289956 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da4774-6c33-456f-91ba-a9d21e499ced service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:46:40.290318 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3da4774-6c33-456f-91ba-a9d21e499ced service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:46:40.304876 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da4774-6c33-456f-91ba-a9d21e499ced service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:46:40.307002 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3da4774-6c33-456f-91ba-a9d21e499ced service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:46:40.321611 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1174/2308] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:46:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:46:46.138660 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d206ae-b0e7-4545-b685-7a3f28b99839 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:46:46.139179 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d206ae-b0e7-4545-b685-7a3f28b99839 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:46:46.139328 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d206ae-b0e7-4545-b685-7a3f28b99839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:46:46.157229 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-b4d206ae-b0e7-4545-b685-7a3f28b99839 None None] MFA Rules not processed for user `73fad109df9f449e8ac5f38749c01ace`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:46:46.158774 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b4d206ae-b0e7-4545-b685-7a3f28b99839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:46:46.166583 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1135/2309] 10.222.0.20 () {58 vars in 967 bytes} [Thu Jul 21 03:46:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:46:46.179321 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da4774-6c33-456f-91ba-a9d21e499ced service nova] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:46:46.190351 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3da4774-6c33-456f-91ba-a9d21e499ced service nova] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:46:46.195604 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ff898-4153-490a-914d-466ec79a9f91 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8bc228892e45c0a7d1b529c2f9a8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:46:46.196390 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ff898-4153-490a-914d-466ec79a9f91 service swift] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:46:46.196685 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ff898-4153-490a-914d-466ec79a9f91 service swift] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:46:46.196961 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ff898-4153-490a-914d-466ec79a9f91 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:46:46.205372 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ff898-4153-490a-914d-466ec79a9f91 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:46:46.207007 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ff898-4153-490a-914d-466ec79a9f91 service swift] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:46:46.215832 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1175/2310] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jul 21 03:46:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 03:46:47.465801 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c643ba-33b4-4466-aab3-73a63c4915a4 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:46:47.466309 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c643ba-33b4-4466-aab3-73a63c4915a4 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:46:47.466425 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c643ba-33b4-4466-aab3-73a63c4915a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:46:47.484711 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-35c643ba-33b4-4466-aab3-73a63c4915a4 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:46:47.485912 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-35c643ba-33b4-4466-aab3-73a63c4915a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:46:47.493951 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1136/2311] 10.222.0.36 () {58 vars in 1016 bytes} [Thu Jul 21 03:46:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:46:47.548428 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ff898-4153-490a-914d-466ec79a9f91 service swift] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:46:47.560342 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ff898-4153-490a-914d-466ec79a9f91 service swift] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:46:47.565948 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc9566-3938-48f1-8234-72c78c0b0269 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:46:47.566679 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc9566-3938-48f1-8234-72c78c0b0269 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:46:47.566904 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc9566-3938-48f1-8234-72c78c0b0269 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:46:47.567274 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bc9566-3938-48f1-8234-72c78c0b0269 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:46:47.575936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc9566-3938-48f1-8234-72c78c0b0269 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:46:47.577495 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bc9566-3938-48f1-8234-72c78c0b0269 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:46:47.587551 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1176/2312] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:46:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:46:48.222292 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc29cc0-a3f1-4fa9-b48e-52c8ae6b8a9c None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:46:48.222622 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc29cc0-a3f1-4fa9-b48e-52c8ae6b8a9c None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:46:48.222908 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc29cc0-a3f1-4fa9-b48e-52c8ae6b8a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:46:48.229403 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=44 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:46:48.242440 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-0dc29cc0-a3f1-4fa9-b48e-52c8ae6b8a9c None None] MFA Rules not processed for user `52f492a1c5f5474d86a6ac8f0348321b`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:46:48.243681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0dc29cc0-a3f1-4fa9-b48e-52c8ae6b8a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:46:48.305977 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1137/2313] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:46:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:46:48.361881 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc9566-3938-48f1-8234-72c78c0b0269 service nova] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:46:48.363502 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-14bc9566-3938-48f1-8234-72c78c0b0269 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:46:48.379377 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bc9566-3938-48f1-8234-72c78c0b0269 service nova] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:46:48.384234 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5ff1c-8edb-49a3-86c4-546c2a192639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:46:48.385122 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5ff1c-8edb-49a3-86c4-546c2a192639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:46:48.385411 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5ff1c-8edb-49a3-86c4-546c2a192639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:46:48.385881 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5ff1c-8edb-49a3-86c4-546c2a192639 admin admin] PATH_INFO: `/v3/users/fc308bc93cc649179767b89903dcd8a6` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:46:48.387166 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb5ff1c-8edb-49a3-86c4-546c2a192639 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc308bc93cc649179767b89903dcd8a6)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:46:48.389124 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb5ff1c-8edb-49a3-86c4-546c2a192639 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:46:48.391643 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:46:48.443167 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5cb5ff1c-8edb-49a3-86c4-546c2a192639 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc308bc93cc649179767b89903dcd8a6'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:46:48.443757 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5cb5ff1c-8edb-49a3-86c4-546c2a192639 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc308bc93cc649179767b89903dcd8a6'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:46:48.444447 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5cb5ff1c-8edb-49a3-86c4-546c2a192639 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc308bc93cc649179767b89903dcd8a6'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:46:48.452246 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5cb5ff1c-8edb-49a3-86c4-546c2a192639 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc308bc93cc649179767b89903dcd8a6'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:46:48.461130 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-5cb5ff1c-8edb-49a3-86c4-546c2a192639 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc308bc93cc649179767b89903dcd8a6'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:46:48.480205 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1177/2314] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:46:48 2022] DELETE /identity/v3/users/fc308bc93cc649179767b89903dcd8a6 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:46:48.673450 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc29cc0-a3f1-4fa9-b48e-52c8ae6b8a9c None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:46:48.700474 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc29cc0-a3f1-4fa9-b48e-52c8ae6b8a9c None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:46:48.760060 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffddac95-a85e-4491-a058-4667b7c3026f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:46:48.760932 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffddac95-a85e-4491-a058-4667b7c3026f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:46:48.761217 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffddac95-a85e-4491-a058-4667b7c3026f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:46:48.761495 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffddac95-a85e-4491-a058-4667b7c3026f admin admin] PATH_INFO: `/v3/projects/ff1ff92ccfe14f66907696e347962ce2` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:46:48.762754 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffddac95-a85e-4491-a058-4667b7c3026f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff1ff92ccfe14f66907696e347962ce2)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:46:48.764690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffddac95-a85e-4491-a058-4667b7c3026f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:46:48.812278 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ffddac95-a85e-4491-a058-4667b7c3026f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff1ff92ccfe14f66907696e347962ce2', 'request_id': 'req-ffddac95-a85e-4491-a058-4667b7c3026f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:46:48.822861 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ffddac95-a85e-4491-a058-4667b7c3026f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff1ff92ccfe14f66907696e347962ce2', 'request_id': 'req-ffddac95-a85e-4491-a058-4667b7c3026f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:46:48.831243 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ffddac95-a85e-4491-a058-4667b7c3026f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff1ff92ccfe14f66907696e347962ce2', 'request_id': 'req-ffddac95-a85e-4491-a058-4667b7c3026f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:46:48.843736 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ffddac95-a85e-4491-a058-4667b7c3026f admin admin] The token cache is being invalidate because project ff1ff92ccfe14f66907696e347962ce2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:46:48.844038 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ffddac95-a85e-4491-a058-4667b7c3026f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:46:48.844706 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ffddac95-a85e-4491-a058-4667b7c3026f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:46:48.846312 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1138/2315] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:46:48 2022] DELETE /identity/v3/projects/ff1ff92ccfe14f66907696e347962ce2 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:46:50.358061 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5ff1c-8edb-49a3-86c4-546c2a192639 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:46:50.359489 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5cb5ff1c-8edb-49a3-86c4-546c2a192639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:46:50.428513 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5ff1c-8edb-49a3-86c4-546c2a192639 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:46:50.486174 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8843847-7970-47d8-a1ca-6d0a0154aa32 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb39129b3ed04db28ed01860b37bd714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:46:50.486857 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8843847-7970-47d8-a1ca-6d0a0154aa32 service placement] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:46:50.487141 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8843847-7970-47d8-a1ca-6d0a0154aa32 service placement] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:46:50.487418 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8843847-7970-47d8-a1ca-6d0a0154aa32 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:46:50.489195 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a8843847-7970-47d8-a1ca-6d0a0154aa32 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:46:50.500604 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8843847-7970-47d8-a1ca-6d0a0154aa32 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:46:50.502222 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8843847-7970-47d8-a1ca-6d0a0154aa32 service placement] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:46:50.516742 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1178/2316] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:46:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:46:51.653769 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6ae09-25b2-4eb2-bba7-e0e557356662 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:46:51.654259 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6ae09-25b2-4eb2-bba7-e0e557356662 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:46:51.654259 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6ae09-25b2-4eb2-bba7-e0e557356662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:46:51.673567 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-b9f6ae09-25b2-4eb2-bba7-e0e557356662 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:46:51.674811 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b9f6ae09-25b2-4eb2-bba7-e0e557356662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:46:51.709631 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:46:51.742811 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1139/2317] 10.222.0.36 () {58 vars in 1016 bytes} [Thu Jul 21 03:46:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:46:51.766358 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8843847-7970-47d8-a1ca-6d0a0154aa32 service placement] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:46:51.768804 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a8843847-7970-47d8-a1ca-6d0a0154aa32 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:46:51.784493 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:46:51.848178 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8843847-7970-47d8-a1ca-6d0a0154aa32 service placement] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:46:51.853835 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33261142-dec9-4fc6-957d-10a0cc65f96a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:46:51.854519 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33261142-dec9-4fc6-957d-10a0cc65f96a service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:46:51.854812 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33261142-dec9-4fc6-957d-10a0cc65f96a service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:46:51.855093 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33261142-dec9-4fc6-957d-10a0cc65f96a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:46:51.863481 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33261142-dec9-4fc6-957d-10a0cc65f96a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:46:51.865662 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33261142-dec9-4fc6-957d-10a0cc65f96a service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:46:51.875501 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1179/2318] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:46:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:47:01.732018 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=10 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:47:01.871069 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=28 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:47:13.265874 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4a6ba-5bae-4b0d-9713-343be7a6d8e7 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:47:13.266332 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4a6ba-5bae-4b0d-9713-343be7a6d8e7 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:47:13.266476 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c4a6ba-5bae-4b0d-9713-343be7a6d8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:47:13.284647 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-a4c4a6ba-5bae-4b0d-9713-343be7a6d8e7 None None] MFA Rules not processed for user `d00aad208d65407bbe57513d3feae922`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:47:13.285500 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a4c4a6ba-5bae-4b0d-9713-343be7a6d8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:47:13.339260 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1140/2319] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:47:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:47:23.332149 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=25 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:47:29.485378 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6484b69-e350-4f56-a224-b3ce9293d156 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:47:29.485844 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6484b69-e350-4f56-a224-b3ce9293d156 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:47:29.485959 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6484b69-e350-4f56-a224-b3ce9293d156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:47:29.503280 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b6484b69-e350-4f56-a224-b3ce9293d156 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:47:29.505007 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b6484b69-e350-4f56-a224-b3ce9293d156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:47:29.512888 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1180/2320] 10.222.0.36 () {58 vars in 1016 bytes} [Thu Jul 21 03:47:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:47:29.538548 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c4a6ba-5bae-4b0d-9713-343be7a6d8e7 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:47:29.539981 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a4c4a6ba-5bae-4b0d-9713-343be7a6d8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:47:29.556086 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c4a6ba-5bae-4b0d-9713-343be7a6d8e7 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:47:29.561804 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084c8b2-d3f6-4d1a-a9d5-88086d2012b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:47:29.562487 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084c8b2-d3f6-4d1a-a9d5-88086d2012b6 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:47:29.562769 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084c8b2-d3f6-4d1a-a9d5-88086d2012b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:47:29.563048 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e084c8b2-d3f6-4d1a-a9d5-88086d2012b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:47:29.571872 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e084c8b2-d3f6-4d1a-a9d5-88086d2012b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:47:29.573450 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e084c8b2-d3f6-4d1a-a9d5-88086d2012b6 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:47:29.583798 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1141/2321] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:47:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:47:33.759525 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f091d21-f28f-478e-8e1c-6dc567e2d7f4 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:47:33.760014 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f091d21-f28f-478e-8e1c-6dc567e2d7f4 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:47:33.760110 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f091d21-f28f-478e-8e1c-6dc567e2d7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:47:33.778225 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-5f091d21-f28f-478e-8e1c-6dc567e2d7f4 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:47:33.779443 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5f091d21-f28f-478e-8e1c-6dc567e2d7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:47:33.788133 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1181/2322] 10.222.0.36 () {58 vars in 1016 bytes} [Thu Jul 21 03:47:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:47:33.822188 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084c8b2-d3f6-4d1a-a9d5-88086d2012b6 service nova] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:47:33.833509 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e084c8b2-d3f6-4d1a-a9d5-88086d2012b6 service nova] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:47:33.839300 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93a7b9-c4ea-486b-91ac-3c162a6af76e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:47:33.839941 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93a7b9-c4ea-486b-91ac-3c162a6af76e service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:47:33.840250 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93a7b9-c4ea-486b-91ac-3c162a6af76e service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:47:33.840526 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c93a7b9-c4ea-486b-91ac-3c162a6af76e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:47:33.849368 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93a7b9-c4ea-486b-91ac-3c162a6af76e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:47:33.850963 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c93a7b9-c4ea-486b-91ac-3c162a6af76e service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:47:33.860300 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1142/2323] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:47:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:47:37.869764 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a130b7d-ace6-4a4a-a6b4-4d278e1a43cf None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:47:37.870305 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a130b7d-ace6-4a4a-a6b4-4d278e1a43cf None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:47:37.870410 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a130b7d-ace6-4a4a-a6b4-4d278e1a43cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:47:37.888192 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-6a130b7d-ace6-4a4a-a6b4-4d278e1a43cf None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:47:37.889399 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6a130b7d-ace6-4a4a-a6b4-4d278e1a43cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:47:37.897384 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1182/2324] 10.222.0.36 () {58 vars in 1016 bytes} [Thu Jul 21 03:47:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:47:37.919955 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93a7b9-c4ea-486b-91ac-3c162a6af76e service nova] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:47:37.931596 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c93a7b9-c4ea-486b-91ac-3c162a6af76e service nova] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:47:37.936972 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5d22f-48d4-4191-af42-de9527c44d79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:47:37.937606 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5d22f-48d4-4191-af42-de9527c44d79 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:47:37.937892 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5d22f-48d4-4191-af42-de9527c44d79 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:47:37.938171 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5d22f-48d4-4191-af42-de9527c44d79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:47:37.946199 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5d22f-48d4-4191-af42-de9527c44d79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:47:37.947805 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5d22f-48d4-4191-af42-de9527c44d79 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:47:37.957150 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1143/2325] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:47:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:47:43.051525 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4171b-b4af-4081-b99e-2a0547c10982 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:47:43.052016 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4171b-b4af-4081-b99e-2a0547c10982 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:47:43.052133 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4171b-b4af-4081-b99e-2a0547c10982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:47:43.070205 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-1fd4171b-b4af-4081-b99e-2a0547c10982 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:47:43.071433 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1fd4171b-b4af-4081-b99e-2a0547c10982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:47:43.079411 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1183/2326] 10.222.0.36 () {58 vars in 1016 bytes} [Thu Jul 21 03:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:47:43.107621 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5d22f-48d4-4191-af42-de9527c44d79 service nova] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:47:43.118652 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5d22f-48d4-4191-af42-de9527c44d79 service nova] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:47:43.124074 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af7207-ff83-486e-bab0-b58e1ff193f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:47:43.124699 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af7207-ff83-486e-bab0-b58e1ff193f2 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:47:43.124981 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af7207-ff83-486e-bab0-b58e1ff193f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:47:43.125253 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54af7207-ff83-486e-bab0-b58e1ff193f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:47:43.133801 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54af7207-ff83-486e-bab0-b58e1ff193f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:47:43.135389 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54af7207-ff83-486e-bab0-b58e1ff193f2 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:47:43.148815 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1144/2327] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:47:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:47:48.893599 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7919b-8a24-4a16-91c1-f277f14e6b56 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:47:48.894157 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7919b-8a24-4a16-91c1-f277f14e6b56 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:47:48.894157 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7919b-8a24-4a16-91c1-f277f14e6b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:47:48.912491 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-76c7919b-8a24-4a16-91c1-f277f14e6b56 None None] MFA Rules not processed for user `73fad109df9f449e8ac5f38749c01ace`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:47:48.913621 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-76c7919b-8a24-4a16-91c1-f277f14e6b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:47:48.967148 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1184/2328] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jul 21 03:47:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:47:49.012769 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af7207-ff83-486e-bab0-b58e1ff193f2 service nova] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:47:49.014408 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-54af7207-ff83-486e-bab0-b58e1ff193f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:47:49.083238 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54af7207-ff83-486e-bab0-b58e1ff193f2 service nova] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:47:49.089604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab206d8-d571-41bf-aa64-b8c12f02af5f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8bc228892e45c0a7d1b529c2f9a8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:47:49.090271 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab206d8-d571-41bf-aa64-b8c12f02af5f service swift] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:47:49.090586 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab206d8-d571-41bf-aa64-b8c12f02af5f service swift] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:47:49.090885 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab206d8-d571-41bf-aa64-b8c12f02af5f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:47:49.101206 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab206d8-d571-41bf-aa64-b8c12f02af5f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:47:49.102881 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab206d8-d571-41bf-aa64-b8c12f02af5f service swift] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:47:49.111762 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1145/2329] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jul 21 03:47:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 03:47:49.303587 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ce695-ee3c-4e90-b920-700d6c6f5ba2 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:47:49.304117 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ce695-ee3c-4e90-b920-700d6c6f5ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:47:49.304768 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ce695-ee3c-4e90-b920-700d6c6f5ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:47:49.335211 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-895ce695-ee3c-4e90-b920-700d6c6f5ba2 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:47:49.336470 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-895ce695-ee3c-4e90-b920-700d6c6f5ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:47:49.345663 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1185/2330] 10.222.0.36 () {58 vars in 1016 bytes} [Thu Jul 21 03:47:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:47:49.372633 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab206d8-d571-41bf-aa64-b8c12f02af5f service swift] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:47:49.384942 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab206d8-d571-41bf-aa64-b8c12f02af5f service swift] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:47:49.391146 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9bbfc3-4fa5-4462-ba85-5bd885691ee0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:47:49.391795 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9bbfc3-4fa5-4462-ba85-5bd885691ee0 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:47:49.392084 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9bbfc3-4fa5-4462-ba85-5bd885691ee0 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:47:49.392362 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9bbfc3-4fa5-4462-ba85-5bd885691ee0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:47:49.402511 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9bbfc3-4fa5-4462-ba85-5bd885691ee0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:47:49.404189 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9bbfc3-4fa5-4462-ba85-5bd885691ee0 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:47:49.415956 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1146/2331] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:47:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:47:59.321827 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=40 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:47:59.409964 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=62 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:48:04.513772 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd949250-ad94-4580-96da-7270266e7329 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:48:04.514283 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd949250-ad94-4580-96da-7270266e7329 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:48:04.514283 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd949250-ad94-4580-96da-7270266e7329 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:48:04.515701 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1186/2332] 10.222.0.20 () {54 vars in 921 bytes} [Thu Jul 21 03:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:48:04.522627 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4afdf3-ee55-4b74-85fc-e711a2a7b043 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:48:04.523095 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4afdf3-ee55-4b74-85fc-e711a2a7b043 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:48:04.523204 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4afdf3-ee55-4b74-85fc-e711a2a7b043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:48:04.543292 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ba4afdf3-ee55-4b74-85fc-e711a2a7b043 None None] MFA Rules not processed for user `cefbe2d0c739428ab0d4dfeaed6c37ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:48:04.544726 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ba4afdf3-ee55-4b74-85fc-e711a2a7b043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:48:04.557985 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1147/2333] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Jul 21 03:48:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:48:04.570443 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd949250-ad94-4580-96da-7270266e7329 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:48:04.573294 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-dd949250-ad94-4580-96da-7270266e7329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:48:04.641052 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd949250-ad94-4580-96da-7270266e7329 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:48:04.645008 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ed6dc-176c-4332-8e6d-a6d4795edfb1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a567cddc98164bd39317a245626d0f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:48:04.645664 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ed6dc-176c-4332-8e6d-a6d4795edfb1 service glance] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:48:04.645948 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ed6dc-176c-4332-8e6d-a6d4795edfb1 service glance] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:48:04.646387 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ed6dc-176c-4332-8e6d-a6d4795edfb1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:48:04.658095 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820ed6dc-176c-4332-8e6d-a6d4795edfb1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:48:04.660368 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820ed6dc-176c-4332-8e6d-a6d4795edfb1 service glance] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:48:04.672128 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1187/2334] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:48:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 03:48:04.740514 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad61bf5-3e4e-484a-8542-a6edb2621ab2 None None] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:48:04.740803 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad61bf5-3e4e-484a-8542-a6edb2621ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:48:04.741083 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad61bf5-3e4e-484a-8542-a6edb2621ab2 None None] PATH_INFO: `/` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:48:04.742472 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1148/2335] 10.222.0.20 () {54 vars in 921 bytes} [Thu Jul 21 03:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:48:04.747245 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4ffa4-afcd-4c4a-a4b0-74fab987e350 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:48:04.747535 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4ffa4-afcd-4c4a-a4b0-74fab987e350 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:48:04.747841 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab4ffa4-afcd-4c4a-a4b0-74fab987e350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:48:04.765964 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-6ab4ffa4-afcd-4c4a-a4b0-74fab987e350 None None] MFA Rules not processed for user `b68c257254de483ab65eb5dc5684a704`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:48:04.767138 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6ab4ffa4-afcd-4c4a-a4b0-74fab987e350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:48:04.818522 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1188/2336] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Jul 21 03:48:04 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:48:04.830158 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad61bf5-3e4e-484a-8542-a6edb2621ab2 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:48:04.831854 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0ad61bf5-3e4e-484a-8542-a6edb2621ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:48:04.844825 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad61bf5-3e4e-484a-8542-a6edb2621ab2 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:48:04.848837 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ad3c0-3dd3-4d62-9d43-b7c431f7b040 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:48:04.849473 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ad3c0-3dd3-4d62-9d43-b7c431f7b040 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:48:04.849758 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ad3c0-3dd3-4d62-9d43-b7c431f7b040 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:48:04.850037 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ad3c0-3dd3-4d62-9d43-b7c431f7b040 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:48:04.856983 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ad3c0-3dd3-4d62-9d43-b7c431f7b040 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:48:04.858407 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ad3c0-3dd3-4d62-9d43-b7c431f7b040 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:48:04.867323 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1149/2337] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:48:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:48:04.951168 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214dbab-c5f0-4e30-9f30-8cd3a1869043 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:48:04.951459 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214dbab-c5f0-4e30-9f30-8cd3a1869043 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:48:04.951740 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5214dbab-c5f0-4e30-9f30-8cd3a1869043 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:48:04.953151 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1189/2338] 10.222.0.20 () {54 vars in 921 bytes} [Thu Jul 21 03:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:48:04.957967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae105712-da31-4932-a201-bbfcfcaf145d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:48:04.958260 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae105712-da31-4932-a201-bbfcfcaf145d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:48:04.958567 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae105712-da31-4932-a201-bbfcfcaf145d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:48:04.976966 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ae105712-da31-4932-a201-bbfcfcaf145d None None] MFA Rules not processed for user `cefbe2d0c739428ab0d4dfeaed6c37ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:48:04.978166 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ae105712-da31-4932-a201-bbfcfcaf145d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:48:04.987360 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1150/2339] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Jul 21 03:48:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:48:04.998147 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5214dbab-c5f0-4e30-9f30-8cd3a1869043 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:48:05.009137 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5214dbab-c5f0-4e30-9f30-8cd3a1869043 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:48:05.012758 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc823f9-e0ee-4338-a895-f9c3c629562e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:48:05.013395 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc823f9-e0ee-4338-a895-f9c3c629562e service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:48:05.013682 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc823f9-e0ee-4338-a895-f9c3c629562e service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:48:05.013987 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc823f9-e0ee-4338-a895-f9c3c629562e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:48:05.026120 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc823f9-e0ee-4338-a895-f9c3c629562e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:48:05.027507 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc823f9-e0ee-4338-a895-f9c3c629562e service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:48:05.039049 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1190/2340] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:48:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:48:07.366808 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eefabc-1871-41ce-857d-3dde7610b846 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:48:07.367295 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eefabc-1871-41ce-857d-3dde7610b846 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:48:07.367395 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eefabc-1871-41ce-857d-3dde7610b846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:48:07.385551 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-02eefabc-1871-41ce-857d-3dde7610b846 None None] MFA Rules not processed for user `73fad109df9f449e8ac5f38749c01ace`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:48:07.386820 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-02eefabc-1871-41ce-857d-3dde7610b846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:48:07.394003 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1151/2341] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jul 21 03:48:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:48:07.406332 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc823f9-e0ee-4338-a895-f9c3c629562e service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:48:07.418260 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc823f9-e0ee-4338-a895-f9c3c629562e service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:48:07.423154 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9dad8f-49c2-4375-a26e-fca2e5ac8da9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8bc228892e45c0a7d1b529c2f9a8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:48:07.423785 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9dad8f-49c2-4375-a26e-fca2e5ac8da9 service swift] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:48:07.424071 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9dad8f-49c2-4375-a26e-fca2e5ac8da9 service swift] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:48:07.424349 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9dad8f-49c2-4375-a26e-fca2e5ac8da9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:48:07.432519 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9dad8f-49c2-4375-a26e-fca2e5ac8da9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:48:07.434063 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9dad8f-49c2-4375-a26e-fca2e5ac8da9 service swift] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:48:07.442190 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1191/2342] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jul 21 03:48:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 03:48:17.380106 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=15 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:48:17.438951 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=61 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:48:24.162977 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eefabc-1871-41ce-857d-3dde7610b846 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:48:24.165448 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-02eefabc-1871-41ce-857d-3dde7610b846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:48:24.181253 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eefabc-1871-41ce-857d-3dde7610b846 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:48:24.185676 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e84071c-a723-443e-af73-7141fd2bcd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:48:24.186591 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84071c-a723-443e-af73-7141fd2bcd3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:48:24.186875 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84071c-a723-443e-af73-7141fd2bcd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:48:24.187148 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e84071c-a723-443e-af73-7141fd2bcd3a admin admin] PATH_INFO: `/v3/users/d00aad208d65407bbe57513d3feae922` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:48:24.188587 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e84071c-a723-443e-af73-7141fd2bcd3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d00aad208d65407bbe57513d3feae922)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:48:24.190608 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e84071c-a723-443e-af73-7141fd2bcd3a admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:48:24.234961 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8e84071c-a723-443e-af73-7141fd2bcd3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd00aad208d65407bbe57513d3feae922'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:48:24.235612 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8e84071c-a723-443e-af73-7141fd2bcd3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd00aad208d65407bbe57513d3feae922'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:48:24.236219 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8e84071c-a723-443e-af73-7141fd2bcd3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd00aad208d65407bbe57513d3feae922'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:48:24.243637 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8e84071c-a723-443e-af73-7141fd2bcd3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd00aad208d65407bbe57513d3feae922'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:48:24.250765 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8e84071c-a723-443e-af73-7141fd2bcd3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd00aad208d65407bbe57513d3feae922'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:48:24.269896 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1152/2343] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:48:24 2022] DELETE /identity/v3/users/d00aad208d65407bbe57513d3feae922 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:48:24.437549 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9dad8f-49c2-4375-a26e-fca2e5ac8da9 service swift] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:48:24.448733 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9dad8f-49c2-4375-a26e-fca2e5ac8da9 service swift] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:48:24.505509 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f40a58-1e9b-45ab-b664-21ce6d3e773a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:48:24.506367 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f40a58-1e9b-45ab-b664-21ce6d3e773a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:48:24.506685 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f40a58-1e9b-45ab-b664-21ce6d3e773a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:48:24.506965 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f40a58-1e9b-45ab-b664-21ce6d3e773a admin admin] PATH_INFO: `/v3/projects/ebb41f5a255940849923f298bd5dd552` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:48:24.508173 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f40a58-1e9b-45ab-b664-21ce6d3e773a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebb41f5a255940849923f298bd5dd552)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:48:24.510060 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f40a58-1e9b-45ab-b664-21ce6d3e773a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:48:24.555269 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d9f40a58-1e9b-45ab-b664-21ce6d3e773a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebb41f5a255940849923f298bd5dd552', 'request_id': 'req-d9f40a58-1e9b-45ab-b664-21ce6d3e773a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:48:24.561164 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d9f40a58-1e9b-45ab-b664-21ce6d3e773a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebb41f5a255940849923f298bd5dd552', 'request_id': 'req-d9f40a58-1e9b-45ab-b664-21ce6d3e773a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:48:24.568255 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d9f40a58-1e9b-45ab-b664-21ce6d3e773a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebb41f5a255940849923f298bd5dd552', 'request_id': 'req-d9f40a58-1e9b-45ab-b664-21ce6d3e773a'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:48:24.578591 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d9f40a58-1e9b-45ab-b664-21ce6d3e773a admin admin] The token cache is being invalidate because project ebb41f5a255940849923f298bd5dd552 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:48:24.578883 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d9f40a58-1e9b-45ab-b664-21ce6d3e773a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:48:24.579500 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d9f40a58-1e9b-45ab-b664-21ce6d3e773a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:48:24.581029 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1192/2344] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:48:24 2022] DELETE /identity/v3/projects/ebb41f5a255940849923f298bd5dd552 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:48:32.765432 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5e330-1562-4336-9ec8-ad7a8594dd66 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:48:32.765877 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5e330-1562-4336-9ec8-ad7a8594dd66 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:48:32.765984 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec5e330-1562-4336-9ec8-ad7a8594dd66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:48:32.784285 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-0ec5e330-1562-4336-9ec8-ad7a8594dd66 None None] MFA Rules not processed for user `73fad109df9f449e8ac5f38749c01ace`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:48:32.785478 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0ec5e330-1562-4336-9ec8-ad7a8594dd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:48:32.838772 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1153/2345] 10.222.0.20 () {58 vars in 967 bytes} [Thu Jul 21 03:48:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:48:32.851544 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f40a58-1e9b-45ab-b664-21ce6d3e773a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:48:32.852943 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d9f40a58-1e9b-45ab-b664-21ce6d3e773a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:48:32.921185 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f40a58-1e9b-45ab-b664-21ce6d3e773a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:48:32.926156 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5351546a-d47c-4c7f-8fac-44dea6fbe9f2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8bc228892e45c0a7d1b529c2f9a8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:48:32.926836 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351546a-d47c-4c7f-8fac-44dea6fbe9f2 service swift] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:48:32.927125 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351546a-d47c-4c7f-8fac-44dea6fbe9f2 service swift] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:48:32.927409 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351546a-d47c-4c7f-8fac-44dea6fbe9f2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:48:32.935781 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5351546a-d47c-4c7f-8fac-44dea6fbe9f2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:48:32.937496 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5351546a-d47c-4c7f-8fac-44dea6fbe9f2 service swift] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:48:32.946212 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1193/2346] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jul 21 03:48:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 03:48:42.831808 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:48:42.942491 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:48:43.930325 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5e330-1562-4336-9ec8-ad7a8594dd66 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:48:43.931798 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0ec5e330-1562-4336-9ec8-ad7a8594dd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:48:43.987991 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec5e330-1562-4336-9ec8-ad7a8594dd66 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:48:43.991826 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44883c2-29fe-4d31-a5e2-b87461dc51b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:48:43.992486 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44883c2-29fe-4d31-a5e2-b87461dc51b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:48:43.992782 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44883c2-29fe-4d31-a5e2-b87461dc51b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:48:43.993057 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44883c2-29fe-4d31-a5e2-b87461dc51b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:48:43.994865 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a44883c2-29fe-4d31-a5e2-b87461dc51b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:48:44.066978 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44883c2-29fe-4d31-a5e2-b87461dc51b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:48:44.068501 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44883c2-29fe-4d31-a5e2-b87461dc51b6 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:48:44.079523 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1154/2347] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:48:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:48:44.315745 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd435c-7468-4f40-84cb-0269e2e6ac62 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:48:44.316273 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd435c-7468-4f40-84cb-0269e2e6ac62 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:48:44.316382 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd435c-7468-4f40-84cb-0269e2e6ac62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:48:44.339023 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-54fd435c-7468-4f40-84cb-0269e2e6ac62 None None] MFA Rules not processed for user `8d4f1b27da1540339cb16efcb079135f`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:48:44.340243 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-54fd435c-7468-4f40-84cb-0269e2e6ac62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:48:44.395329 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1194/2348] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:48:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:48:46.497549 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44883c2-29fe-4d31-a5e2-b87461dc51b6 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:48:46.498990 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a44883c2-29fe-4d31-a5e2-b87461dc51b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:48:46.509842 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44883c2-29fe-4d31-a5e2-b87461dc51b6 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:48:46.514113 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67278e37-09fe-4333-b579-11ebf4eb2fa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:48:46.514812 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67278e37-09fe-4333-b579-11ebf4eb2fa3 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:48:46.515099 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67278e37-09fe-4333-b579-11ebf4eb2fa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:48:46.515378 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67278e37-09fe-4333-b579-11ebf4eb2fa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:48:46.517151 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-67278e37-09fe-4333-b579-11ebf4eb2fa3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:48:46.531356 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67278e37-09fe-4333-b579-11ebf4eb2fa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:48:46.532806 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67278e37-09fe-4333-b579-11ebf4eb2fa3 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:48:46.546006 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1155/2349] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:48:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:48:54.388615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=25 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:48:56.539968 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=60 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:49:01.062819 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd435c-7468-4f40-84cb-0269e2e6ac62 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:49:01.064249 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-54fd435c-7468-4f40-84cb-0269e2e6ac62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:49:01.120275 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd435c-7468-4f40-84cb-0269e2e6ac62 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:49:01.123870 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb22498d-97bd-4b58-896a-38ce6ea1e618 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:49:01.124517 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22498d-97bd-4b58-896a-38ce6ea1e618 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:49:01.124875 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22498d-97bd-4b58-896a-38ce6ea1e618 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:49:01.125210 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb22498d-97bd-4b58-896a-38ce6ea1e618 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:49:01.127196 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-fb22498d-97bd-4b58-896a-38ce6ea1e618 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:49:01.188351 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb22498d-97bd-4b58-896a-38ce6ea1e618 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:49:01.189780 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb22498d-97bd-4b58-896a-38ce6ea1e618 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:49:01.198686 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1195/2350] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:49:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:49:06.871848 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67278e37-09fe-4333-b579-11ebf4eb2fa3 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:49:06.873339 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-67278e37-09fe-4333-b579-11ebf4eb2fa3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:49:06.887546 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67278e37-09fe-4333-b579-11ebf4eb2fa3 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:49:06.893293 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023e405-8ec9-40cd-9789-b194b16d1a94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:49:06.893979 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023e405-8ec9-40cd-9789-b194b16d1a94 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:49:06.894261 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023e405-8ec9-40cd-9789-b194b16d1a94 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:49:06.894577 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023e405-8ec9-40cd-9789-b194b16d1a94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:49:06.896378 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8023e405-8ec9-40cd-9789-b194b16d1a94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:49:06.957572 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8023e405-8ec9-40cd-9789-b194b16d1a94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:49:06.959135 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8023e405-8ec9-40cd-9789-b194b16d1a94 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:49:06.968470 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1156/2351] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:49:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:49:09.446950 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11609481-c6ab-4332-bffb-2783fb072cce None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:49:09.447496 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11609481-c6ab-4332-bffb-2783fb072cce None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:49:09.447496 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11609481-c6ab-4332-bffb-2783fb072cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:49:09.464807 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-11609481-c6ab-4332-bffb-2783fb072cce None None] MFA Rules not processed for user `52f492a1c5f5474d86a6ac8f0348321b`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:49:09.466014 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-11609481-c6ab-4332-bffb-2783fb072cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:49:09.473010 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1196/2352] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:49:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:49:09.778972 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023e405-8ec9-40cd-9789-b194b16d1a94 service nova] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:49:09.789411 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023e405-8ec9-40cd-9789-b194b16d1a94 service nova] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:49:09.793126 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c52eb-6dcd-4f22-97ea-d99bfaabc3c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:49:09.793811 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c52eb-6dcd-4f22-97ea-d99bfaabc3c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:49:09.794097 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c52eb-6dcd-4f22-97ea-d99bfaabc3c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:49:09.794378 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c52eb-6dcd-4f22-97ea-d99bfaabc3c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:49:09.796253 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ef1c52eb-6dcd-4f22-97ea-d99bfaabc3c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:49:09.810716 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c52eb-6dcd-4f22-97ea-d99bfaabc3c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:49:09.812159 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1c52eb-6dcd-4f22-97ea-d99bfaabc3c4 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:49:09.820891 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1157/2353] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:49:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:49:10.126946 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11609481-c6ab-4332-bffb-2783fb072cce None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:49:10.128423 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-11609481-c6ab-4332-bffb-2783fb072cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:49:10.200855 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11609481-c6ab-4332-bffb-2783fb072cce None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:49:10.205801 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ec552-0489-49a9-9b8a-11da7ec678d3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb39129b3ed04db28ed01860b37bd714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:49:10.206441 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ec552-0489-49a9-9b8a-11da7ec678d3 service placement] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:49:10.206761 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ec552-0489-49a9-9b8a-11da7ec678d3 service placement] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:49:10.207034 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ec552-0489-49a9-9b8a-11da7ec678d3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:49:10.208761 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9d2ec552-0489-49a9-9b8a-11da7ec678d3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:49:10.221142 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ec552-0489-49a9-9b8a-11da7ec678d3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:49:10.222915 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ec552-0489-49a9-9b8a-11da7ec678d3 service placement] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:49:10.232795 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1197/2354] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:49:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:49:12.224713 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c52eb-6dcd-4f22-97ea-d99bfaabc3c4 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:49:12.234504 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c52eb-6dcd-4f22-97ea-d99bfaabc3c4 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:49:12.238224 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429798e-0a08-455f-a721-bf473a772adb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:49:12.238907 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429798e-0a08-455f-a721-bf473a772adb service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:49:12.239193 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429798e-0a08-455f-a721-bf473a772adb service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:49:12.239472 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429798e-0a08-455f-a721-bf473a772adb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:49:12.241258 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6429798e-0a08-455f-a721-bf473a772adb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:49:12.252075 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429798e-0a08-455f-a721-bf473a772adb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:49:12.253508 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6429798e-0a08-455f-a721-bf473a772adb service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:49:12.261504 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1158/2355] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:49:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:49:20.229082 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=83 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:49:22.257916 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=40 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:49:24.716340 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ec552-0489-49a9-9b8a-11da7ec678d3 service placement] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:49:24.717829 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9d2ec552-0489-49a9-9b8a-11da7ec678d3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:49:24.733652 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ec552-0489-49a9-9b8a-11da7ec678d3 service placement] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:49:24.739297 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b6d42-e584-4171-ac06-f5fe85f58553 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:49:24.740628 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b6d42-e584-4171-ac06-f5fe85f58553 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:49:24.740628 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b6d42-e584-4171-ac06-f5fe85f58553 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:49:24.740628 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436b6d42-e584-4171-ac06-f5fe85f58553 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:49:24.742576 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-436b6d42-e584-4171-ac06-f5fe85f58553 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:49:24.757249 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436b6d42-e584-4171-ac06-f5fe85f58553 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:49:24.759262 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436b6d42-e584-4171-ac06-f5fe85f58553 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:49:24.771127 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1198/2356] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:49:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:49:30.227124 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429798e-0a08-455f-a721-bf473a772adb service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:49:30.241407 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6429798e-0a08-455f-a721-bf473a772adb service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:49:30.247062 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9285213-8d68-4ac9-baae-cb3ca61f42a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:49:30.247802 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9285213-8d68-4ac9-baae-cb3ca61f42a7 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:49:30.248156 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9285213-8d68-4ac9-baae-cb3ca61f42a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:49:30.248440 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9285213-8d68-4ac9-baae-cb3ca61f42a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:49:30.250234 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c9285213-8d68-4ac9-baae-cb3ca61f42a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:49:30.263126 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9285213-8d68-4ac9-baae-cb3ca61f42a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:49:30.264740 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9285213-8d68-4ac9-baae-cb3ca61f42a7 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:49:30.276155 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1159/2357] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:49:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:49:34.765972 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=6 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:49:40.270790 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=6 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:49:46.586390 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b6d42-e584-4171-ac06-f5fe85f58553 service nova] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:49:46.598784 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436b6d42-e584-4171-ac06-f5fe85f58553 service nova] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:49:46.605537 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa8aaaa-ef98-4fd5-85ba-8461acb9843e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:49:46.606420 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa8aaaa-ef98-4fd5-85ba-8461acb9843e service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:49:46.606953 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa8aaaa-ef98-4fd5-85ba-8461acb9843e service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:49:46.607488 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa8aaaa-ef98-4fd5-85ba-8461acb9843e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:49:46.609457 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9fa8aaaa-ef98-4fd5-85ba-8461acb9843e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:49:46.623375 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa8aaaa-ef98-4fd5-85ba-8461acb9843e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:49:46.625506 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa8aaaa-ef98-4fd5-85ba-8461acb9843e service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:49:46.638475 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1199/2358] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:49:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:49:50.032110 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2926ce-9af3-4b14-afc9-fbe47ab9ca0a None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:49:50.032661 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2926ce-9af3-4b14-afc9-fbe47ab9ca0a None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:49:50.032661 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2926ce-9af3-4b14-afc9-fbe47ab9ca0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:49:50.050296 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ab2926ce-9af3-4b14-afc9-fbe47ab9ca0a None None] MFA Rules not processed for user `80ed200a0cd740e8a0b857690584404e`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:49:50.051618 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ab2926ce-9af3-4b14-afc9-fbe47ab9ca0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:49:50.106250 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1160/2359] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:49:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:49:55.947802 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa8aaaa-ef98-4fd5-85ba-8461acb9843e service nova] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:49:55.949176 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9fa8aaaa-ef98-4fd5-85ba-8461acb9843e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:49:55.960329 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa8aaaa-ef98-4fd5-85ba-8461acb9843e service nova] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:49:55.963900 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053a003-6477-4e43-a5f5-9414f712e005 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:49:55.964584 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053a003-6477-4e43-a5f5-9414f712e005 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:49:55.964818 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053a003-6477-4e43-a5f5-9414f712e005 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:49:55.965097 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053a003-6477-4e43-a5f5-9414f712e005 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:49:55.966848 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0053a003-6477-4e43-a5f5-9414f712e005 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:49:55.977210 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0053a003-6477-4e43-a5f5-9414f712e005 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:49:55.978649 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0053a003-6477-4e43-a5f5-9414f712e005 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:49:55.987472 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1200/2360] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:49:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:50:00.099550 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=25 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:50:05.983404 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=12 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:50:16.145206 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2926ce-9af3-4b14-afc9-fbe47ab9ca0a None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:16.155267 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2926ce-9af3-4b14-afc9-fbe47ab9ca0a None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:16.159313 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2e934-255a-40f7-950e-aa0e9fb89460 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:16.160061 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2e934-255a-40f7-950e-aa0e9fb89460 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:16.160417 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2e934-255a-40f7-950e-aa0e9fb89460 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:16.160763 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2e934-255a-40f7-950e-aa0e9fb89460 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:16.162696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6ba2e934-255a-40f7-950e-aa0e9fb89460 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:50:16.227674 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba2e934-255a-40f7-950e-aa0e9fb89460 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:16.229120 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba2e934-255a-40f7-950e-aa0e9fb89460 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:16.238795 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1161/2361] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:50:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:50:19.018046 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a1f11-e375-42fd-bd6e-6f10b196d274 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:19.018926 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a1f11-e375-42fd-bd6e-6f10b196d274 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:19.019212 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a1f11-e375-42fd-bd6e-6f10b196d274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:19.037033 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f39a1f11-e375-42fd-bd6e-6f10b196d274 None None] MFA Rules not processed for user `9f13db57fa094debba1664160b6c4b46`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:50:19.038270 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f39a1f11-e375-42fd-bd6e-6f10b196d274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:50:19.045693 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1201/2362] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:50:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:50:19.773260 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2e934-255a-40f7-950e-aa0e9fb89460 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:19.775960 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6ba2e934-255a-40f7-950e-aa0e9fb89460 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:50:19.800813 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2e934-255a-40f7-950e-aa0e9fb89460 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:19.806592 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6865d53-d638-44ef-b063-0d1ca28b06b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb39129b3ed04db28ed01860b37bd714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:19.807241 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6865d53-d638-44ef-b063-0d1ca28b06b7 service placement] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:19.807822 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6865d53-d638-44ef-b063-0d1ca28b06b7 service placement] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:19.808266 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6865d53-d638-44ef-b063-0d1ca28b06b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:19.812365 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e6865d53-d638-44ef-b063-0d1ca28b06b7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:50:19.834809 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6865d53-d638-44ef-b063-0d1ca28b06b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:19.838504 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6865d53-d638-44ef-b063-0d1ca28b06b7 service placement] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:19.855690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1162/2363] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:50:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:50:19.899547 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a1f11-e375-42fd-bd6e-6f10b196d274 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:19.900012 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f39a1f11-e375-42fd-bd6e-6f10b196d274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:50:19.918860 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a1f11-e375-42fd-bd6e-6f10b196d274 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:19.923995 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fa97a8-bc00-4448-beb9-0c6ddbd3fbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:19.927555 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa97a8-bc00-4448-beb9-0c6ddbd3fbbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:19.927555 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa97a8-bc00-4448-beb9-0c6ddbd3fbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:19.927712 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fa97a8-bc00-4448-beb9-0c6ddbd3fbbd admin admin] PATH_INFO: `/v3/users/8d4f1b27da1540339cb16efcb079135f` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:19.928978 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa97a8-bc00-4448-beb9-0c6ddbd3fbbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d4f1b27da1540339cb16efcb079135f)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:19.931735 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fa97a8-bc00-4448-beb9-0c6ddbd3fbbd admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:19.988188 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-40fa97a8-bc00-4448-beb9-0c6ddbd3fbbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d4f1b27da1540339cb16efcb079135f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:19.988903 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-40fa97a8-bc00-4448-beb9-0c6ddbd3fbbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d4f1b27da1540339cb16efcb079135f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:19.989712 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-40fa97a8-bc00-4448-beb9-0c6ddbd3fbbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d4f1b27da1540339cb16efcb079135f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:19.997659 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-40fa97a8-bc00-4448-beb9-0c6ddbd3fbbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d4f1b27da1540339cb16efcb079135f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:20.005560 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-40fa97a8-bc00-4448-beb9-0c6ddbd3fbbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d4f1b27da1540339cb16efcb079135f'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:20.024483 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1202/2364] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:50:19 2022] DELETE /identity/v3/users/8d4f1b27da1540339cb16efcb079135f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:50:20.204658 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6865d53-d638-44ef-b063-0d1ca28b06b7 service placement] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:20.215562 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6865d53-d638-44ef-b063-0d1ca28b06b7 service placement] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:20.275882 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66b873-795e-4e06-89bd-19a5e65546c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:20.276764 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66b873-795e-4e06-89bd-19a5e65546c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:20.277069 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66b873-795e-4e06-89bd-19a5e65546c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:20.277318 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66b873-795e-4e06-89bd-19a5e65546c7 admin admin] PATH_INFO: `/v3/projects/04cb7afd9f9d4475b155bc5aa4292812` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:20.278528 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b66b873-795e-4e06-89bd-19a5e65546c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04cb7afd9f9d4475b155bc5aa4292812)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:20.280433 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b66b873-795e-4e06-89bd-19a5e65546c7 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:20.332918 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5b66b873-795e-4e06-89bd-19a5e65546c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04cb7afd9f9d4475b155bc5aa4292812', 'request_id': 'req-5b66b873-795e-4e06-89bd-19a5e65546c7'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:20.339808 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5b66b873-795e-4e06-89bd-19a5e65546c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04cb7afd9f9d4475b155bc5aa4292812', 'request_id': 'req-5b66b873-795e-4e06-89bd-19a5e65546c7'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:20.346716 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5b66b873-795e-4e06-89bd-19a5e65546c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04cb7afd9f9d4475b155bc5aa4292812', 'request_id': 'req-5b66b873-795e-4e06-89bd-19a5e65546c7'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:20.357173 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5b66b873-795e-4e06-89bd-19a5e65546c7 admin admin] The token cache is being invalidate because project 04cb7afd9f9d4475b155bc5aa4292812 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:50:20.357464 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5b66b873-795e-4e06-89bd-19a5e65546c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:20.358104 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5b66b873-795e-4e06-89bd-19a5e65546c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:20.359698 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1163/2365] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:50:20 2022] DELETE /identity/v3/projects/04cb7afd9f9d4475b155bc5aa4292812 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:50:20.364601 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d95bdd-9d8c-4d35-97a3-cc81e0f731c9 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:20.364970 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d95bdd-9d8c-4d35-97a3-cc81e0f731c9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:20.365326 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d95bdd-9d8c-4d35-97a3-cc81e0f731c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:20.384174 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-95d95bdd-9d8c-4d35-97a3-cc81e0f731c9 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:50:20.385617 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-95d95bdd-9d8c-4d35-97a3-cc81e0f731c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:50:20.452495 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1203/2366] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:50:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:50:20.460810 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9acb668-75ea-4260-bdb4-d9fab68c3307 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:20.461242 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9acb668-75ea-4260-bdb4-d9fab68c3307 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:20.462509 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9acb668-75ea-4260-bdb4-d9fab68c3307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:20.483286 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d9acb668-75ea-4260-bdb4-d9fab68c3307 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:50:20.484554 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d9acb668-75ea-4260-bdb4-d9fab68c3307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:50:20.492396 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1164/2367] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:50:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:50:20.496710 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d95bdd-9d8c-4d35-97a3-cc81e0f731c9 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:20.506674 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d95bdd-9d8c-4d35-97a3-cc81e0f731c9 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:20.513199 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2568ecf-13cc-40b1-824e-20260fc71643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:20.513864 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2568ecf-13cc-40b1-824e-20260fc71643 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:20.514151 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2568ecf-13cc-40b1-824e-20260fc71643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:20.514429 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2568ecf-13cc-40b1-824e-20260fc71643 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:20.515202 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2568ecf-13cc-40b1-824e-20260fc71643 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:50:20.515511 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2568ecf-13cc-40b1-824e-20260fc71643 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:20.517473 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2568ecf-13cc-40b1-824e-20260fc71643 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:20.530076 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1204/2368] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:50:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:50:20.534886 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9acb668-75ea-4260-bdb4-d9fab68c3307 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:20.540563 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:50:20.545223 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9acb668-75ea-4260-bdb4-d9fab68c3307 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:20.551497 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe714a1-f669-4ba9-b24f-0ade7ec0c48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:20.552298 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe714a1-f669-4ba9-b24f-0ade7ec0c48e admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:20.552762 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe714a1-f669-4ba9-b24f-0ade7ec0c48e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:20.553038 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe714a1-f669-4ba9-b24f-0ade7ec0c48e admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:20.553739 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe714a1-f669-4ba9-b24f-0ade7ec0c48e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:20.555738 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe714a1-f669-4ba9-b24f-0ade7ec0c48e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:20.583635 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1165/2369] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:50:20 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:50:20.588273 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2568ecf-13cc-40b1-824e-20260fc71643 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:20.598183 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2568ecf-13cc-40b1-824e-20260fc71643 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:20.645034 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:50:20.655236 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6413fa5-d689-4a0f-bb67-470b8dd39f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:20.655927 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6413fa5-d689-4a0f-bb67-470b8dd39f14 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:20.656240 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6413fa5-d689-4a0f-bb67-470b8dd39f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:20.656691 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6413fa5-d689-4a0f-bb67-470b8dd39f14 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:20.657411 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6413fa5-d689-4a0f-bb67-470b8dd39f14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:20.659844 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6413fa5-d689-4a0f-bb67-470b8dd39f14 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:20.681655 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1205/2370] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:50:20 2022] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:50:20.683158 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe714a1-f669-4ba9-b24f-0ade7ec0c48e admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:20.693488 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe714a1-f669-4ba9-b24f-0ade7ec0c48e admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:20.699773 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb0bf1-f587-4f6a-8179-09ace4e5d213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:20.700588 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb0bf1-f587-4f6a-8179-09ace4e5d213 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:20.700871 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb0bf1-f587-4f6a-8179-09ace4e5d213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:20.701147 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb0bf1-f587-4f6a-8179-09ace4e5d213 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:20.701935 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbb0bf1-f587-4f6a-8179-09ace4e5d213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:20.703574 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbb0bf1-f587-4f6a-8179-09ace4e5d213 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:20.714851 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1166/2371] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:50:20.718988 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6413fa5-d689-4a0f-bb67-470b8dd39f14 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:20.729069 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6413fa5-d689-4a0f-bb67-470b8dd39f14 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:20.733772 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa8708-af3f-4140-9b0d-eec23d6991f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:20.734619 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa8708-af3f-4140-9b0d-eec23d6991f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:20.734908 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa8708-af3f-4140-9b0d-eec23d6991f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:20.735189 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa8708-af3f-4140-9b0d-eec23d6991f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:20.735951 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa8708-af3f-4140-9b0d-eec23d6991f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:20.737541 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa8708-af3f-4140-9b0d-eec23d6991f4 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:20.748353 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1206/2372] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:50:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:50:20.752563 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb0bf1-f587-4f6a-8179-09ace4e5d213 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:20.763293 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb0bf1-f587-4f6a-8179-09ace4e5d213 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:20.767847 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be71b4cd-708b-43c7-8405-0bc6eb7b7998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:20.768727 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71b4cd-708b-43c7-8405-0bc6eb7b7998 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:20.769013 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71b4cd-708b-43c7-8405-0bc6eb7b7998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:20.769291 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be71b4cd-708b-43c7-8405-0bc6eb7b7998 admin admin] PATH_INFO: `/v3/projects/2d4e2dc3f1bd442884651be60dc8f11d/users/7c35c1a979674e3ab9a26efe569558f8/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:20.785153 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be71b4cd-708b-43c7-8405-0bc6eb7b7998 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d4e2dc3f1bd442884651be60dc8f11d, user_id=7c35c1a979674e3ab9a26efe569558f8, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:20.787853 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be71b4cd-708b-43c7-8405-0bc6eb7b7998 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:20.802615 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1167/2373] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:50:20 2022] PUT /identity/v3/projects/2d4e2dc3f1bd442884651be60dc8f11d/users/7c35c1a979674e3ab9a26efe569558f8/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:50:20.816056 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b4e14-2531-43c5-9ff6-5f0a4ecb1c36 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:20.816353 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b4e14-2531-43c5-9ff6-5f0a4ecb1c36 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:20.816639 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b4e14-2531-43c5-9ff6-5f0a4ecb1c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:20.844611 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-c99b4e14-2531-43c5-9ff6-5f0a4ecb1c36 None None] MFA Rules not processed for user `7c35c1a979674e3ab9a26efe569558f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:50:20.845881 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c99b4e14-2531-43c5-9ff6-5f0a4ecb1c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:50:20.926506 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1207/2374] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:50:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:50:20.931092 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be71b4cd-708b-43c7-8405-0bc6eb7b7998 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:21.026314 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be71b4cd-708b-43c7-8405-0bc6eb7b7998 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:21.032431 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c11fd7-cbf4-49c9-b0a2-b8019bc88898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:21.033441 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c11fd7-cbf4-49c9-b0a2-b8019bc88898 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:21.034089 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c11fd7-cbf4-49c9-b0a2-b8019bc88898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:21.034492 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c11fd7-cbf4-49c9-b0a2-b8019bc88898 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:21.036207 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c11fd7-cbf4-49c9-b0a2-b8019bc88898 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:21.043848 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c11fd7-cbf4-49c9-b0a2-b8019bc88898 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:21.076162 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1168/2375] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:50:20 2022] POST /identity/v3/projects => generated 371 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:50:21.077336 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b4e14-2531-43c5-9ff6-5f0a4ecb1c36 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:21.088170 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b4e14-2531-43c5-9ff6-5f0a4ecb1c36 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:21.143338 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05bff0a-b2be-487b-80f3-9721d5c8ad53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:21.144002 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bff0a-b2be-487b-80f3-9721d5c8ad53 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:21.144292 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bff0a-b2be-487b-80f3-9721d5c8ad53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:21.144571 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bff0a-b2be-487b-80f3-9721d5c8ad53 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:21.145252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05bff0a-b2be-487b-80f3-9721d5c8ad53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:21.147226 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05bff0a-b2be-487b-80f3-9721d5c8ad53 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:21.167944 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1208/2376] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:50:21 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:50:21.172108 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c11fd7-cbf4-49c9-b0a2-b8019bc88898 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:21.182977 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c11fd7-cbf4-49c9-b0a2-b8019bc88898 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:21.187593 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da5e26-2923-42e7-8b35-c310874e7b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:21.188252 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da5e26-2923-42e7-8b35-c310874e7b20 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:21.188536 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da5e26-2923-42e7-8b35-c310874e7b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:21.188813 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5da5e26-2923-42e7-8b35-c310874e7b20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:21.189542 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da5e26-2923-42e7-8b35-c310874e7b20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:21.191209 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5da5e26-2923-42e7-8b35-c310874e7b20 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:21.205403 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1169/2377] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:50:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:50:21.206541 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05bff0a-b2be-487b-80f3-9721d5c8ad53 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:21.217268 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05bff0a-b2be-487b-80f3-9721d5c8ad53 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:21.222183 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c15e406-5a22-470d-bb30-1e58a47b2844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:21.223104 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15e406-5a22-470d-bb30-1e58a47b2844 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:21.223388 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15e406-5a22-470d-bb30-1e58a47b2844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:21.223665 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15e406-5a22-470d-bb30-1e58a47b2844 admin admin] PATH_INFO: `/v3/projects/38e35fb553f242898aa865618d4805b8/users/f4a52c67307648ad998d9057d2f1a220/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:21.239942 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c15e406-5a22-470d-bb30-1e58a47b2844 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38e35fb553f242898aa865618d4805b8, user_id=f4a52c67307648ad998d9057d2f1a220, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:21.243287 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c15e406-5a22-470d-bb30-1e58a47b2844 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:21.257707 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1209/2378] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:50:21 2022] PUT /identity/v3/projects/38e35fb553f242898aa865618d4805b8/users/f4a52c67307648ad998d9057d2f1a220/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:50:21.261832 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da5e26-2923-42e7-8b35-c310874e7b20 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:21.272403 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5da5e26-2923-42e7-8b35-c310874e7b20 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:21.332696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbbaa02-3709-4776-9f31-39e5bb67f6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:21.333367 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbbaa02-3709-4776-9f31-39e5bb67f6e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:21.333650 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbbaa02-3709-4776-9f31-39e5bb67f6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:21.333925 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbbaa02-3709-4776-9f31-39e5bb67f6e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:21.334692 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbbaa02-3709-4776-9f31-39e5bb67f6e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:21.336894 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbbaa02-3709-4776-9f31-39e5bb67f6e8 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:21.350822 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1170/2379] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:50:21 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 03:50:21.352273 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c15e406-5a22-470d-bb30-1e58a47b2844 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:21.365374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c15e406-5a22-470d-bb30-1e58a47b2844 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:21.370048 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8ceed-e827-4359-b6f8-58900d557aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:21.370974 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8ceed-e827-4359-b6f8-58900d557aa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:21.371267 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8ceed-e827-4359-b6f8-58900d557aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:21.371548 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8ceed-e827-4359-b6f8-58900d557aa5 admin admin] PATH_INFO: `/v3/projects/38e35fb553f242898aa865618d4805b8/users/f4a52c67307648ad998d9057d2f1a220/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:21.373583 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c8ceed-e827-4359-b6f8-58900d557aa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38e35fb553f242898aa865618d4805b8, user_id=f4a52c67307648ad998d9057d2f1a220, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:21.379729 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c8ceed-e827-4359-b6f8-58900d557aa5 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:21.392168 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1210/2380] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:50:21 2022] PUT /identity/v3/projects/38e35fb553f242898aa865618d4805b8/users/f4a52c67307648ad998d9057d2f1a220/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:50:21.402749 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff08e71-a69e-4fb0-9eb4-dc3597d839c6 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:21.403043 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff08e71-a69e-4fb0-9eb4-dc3597d839c6 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:21.403323 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff08e71-a69e-4fb0-9eb4-dc3597d839c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:21.431781 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-9ff08e71-a69e-4fb0-9eb4-dc3597d839c6 None None] MFA Rules not processed for user `f4a52c67307648ad998d9057d2f1a220`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:50:21.433406 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9ff08e71-a69e-4fb0-9eb4-dc3597d839c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:50:21.438447 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:50:21.505083 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1171/2381] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:50:21 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:50:21.516370 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8ceed-e827-4359-b6f8-58900d557aa5 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:21.518201 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d1c8ceed-e827-4359-b6f8-58900d557aa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:50:21.534024 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:50:21.580320 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c8ceed-e827-4359-b6f8-58900d557aa5 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:21.584750 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beeee8f-617e-46dc-9ef7-b1fe34a6e25d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:21.585480 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beeee8f-617e-46dc-9ef7-b1fe34a6e25d service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:21.585763 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beeee8f-617e-46dc-9ef7-b1fe34a6e25d service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:21.586856 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beeee8f-617e-46dc-9ef7-b1fe34a6e25d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:21.598795 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beeee8f-617e-46dc-9ef7-b1fe34a6e25d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:21.600266 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beeee8f-617e-46dc-9ef7-b1fe34a6e25d service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:21.611063 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1211/2382] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:50:21 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:50:21.691564 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff08e71-a69e-4fb0-9eb4-dc3597d839c6 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:21.707657 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff08e71-a69e-4fb0-9eb4-dc3597d839c6 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:21.712514 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708d9d1-72eb-4f9b-b4d4-b7609de2f209 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:21.716398 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708d9d1-72eb-4f9b-b4d4-b7609de2f209 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:21.716398 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708d9d1-72eb-4f9b-b4d4-b7609de2f209 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:21.716817 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708d9d1-72eb-4f9b-b4d4-b7609de2f209 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:21.782853 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e708d9d1-72eb-4f9b-b4d4-b7609de2f209 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:21.784619 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e708d9d1-72eb-4f9b-b4d4-b7609de2f209 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:21.795937 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1172/2383] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:50:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:50:31.606139 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=20 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:50:31.790834 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=54 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:50:51.001324 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beeee8f-617e-46dc-9ef7-b1fe34a6e25d service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:51.068436 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beeee8f-617e-46dc-9ef7-b1fe34a6e25d service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:51.072937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5497c0e-4349-4a8c-8a14-66ce4b9eb462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:51.073805 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5497c0e-4349-4a8c-8a14-66ce4b9eb462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:51.074089 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5497c0e-4349-4a8c-8a14-66ce4b9eb462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:51.074366 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5497c0e-4349-4a8c-8a14-66ce4b9eb462 admin admin] PATH_INFO: `/v3/users/7c35c1a979674e3ab9a26efe569558f8` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:51.075587 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5497c0e-4349-4a8c-8a14-66ce4b9eb462 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c35c1a979674e3ab9a26efe569558f8)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:51.077494 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5497c0e-4349-4a8c-8a14-66ce4b9eb462 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:51.122880 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b5497c0e-4349-4a8c-8a14-66ce4b9eb462 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c35c1a979674e3ab9a26efe569558f8'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:51.123542 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b5497c0e-4349-4a8c-8a14-66ce4b9eb462 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c35c1a979674e3ab9a26efe569558f8'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:51.124158 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b5497c0e-4349-4a8c-8a14-66ce4b9eb462 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c35c1a979674e3ab9a26efe569558f8'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:51.131352 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b5497c0e-4349-4a8c-8a14-66ce4b9eb462 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c35c1a979674e3ab9a26efe569558f8'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:51.139974 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b5497c0e-4349-4a8c-8a14-66ce4b9eb462 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c35c1a979674e3ab9a26efe569558f8'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:51.160494 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1212/2384] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:50:51 2022] DELETE /identity/v3/users/7c35c1a979674e3ab9a26efe569558f8 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:50:51.165241 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42777e-0df7-4f6e-bdc3-d36544894b76 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:51.165771 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42777e-0df7-4f6e-bdc3-d36544894b76 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:51.165771 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a42777e-0df7-4f6e-bdc3-d36544894b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:51.183567 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-5a42777e-0df7-4f6e-bdc3-d36544894b76 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:50:51.184894 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5a42777e-0df7-4f6e-bdc3-d36544894b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:50:51.248394 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1173/2385] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:50:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:50:51.255212 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5497c0e-4349-4a8c-8a14-66ce4b9eb462 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:51.256907 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b5497c0e-4349-4a8c-8a14-66ce4b9eb462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:50:51.318088 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5497c0e-4349-4a8c-8a14-66ce4b9eb462 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:51.321819 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c70c2a-7337-4c5f-97d0-bd9b6a757c9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:51.322628 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c70c2a-7337-4c5f-97d0-bd9b6a757c9a service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:51.322944 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c70c2a-7337-4c5f-97d0-bd9b6a757c9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:51.323256 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c70c2a-7337-4c5f-97d0-bd9b6a757c9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:51.333933 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c70c2a-7337-4c5f-97d0-bd9b6a757c9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:51.335392 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c70c2a-7337-4c5f-97d0-bd9b6a757c9a service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:51.347218 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1213/2386] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:50:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:50:51.639365 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42777e-0df7-4f6e-bdc3-d36544894b76 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:51.641110 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5a42777e-0df7-4f6e-bdc3-d36544894b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:50:51.657447 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a42777e-0df7-4f6e-bdc3-d36544894b76 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:51.662630 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e05e9f-b066-4823-bbbd-5c8e10f415f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:51.663680 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e05e9f-b066-4823-bbbd-5c8e10f415f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:51.664089 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e05e9f-b066-4823-bbbd-5c8e10f415f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:51.664560 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e05e9f-b066-4823-bbbd-5c8e10f415f0 admin admin] PATH_INFO: `/v3/projects/2d4e2dc3f1bd442884651be60dc8f11d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:51.666118 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e05e9f-b066-4823-bbbd-5c8e10f415f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d4e2dc3f1bd442884651be60dc8f11d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:51.668144 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e05e9f-b066-4823-bbbd-5c8e10f415f0 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:51.716319 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f9e05e9f-b066-4823-bbbd-5c8e10f415f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d4e2dc3f1bd442884651be60dc8f11d', 'request_id': 'req-f9e05e9f-b066-4823-bbbd-5c8e10f415f0'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:51.722572 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f9e05e9f-b066-4823-bbbd-5c8e10f415f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d4e2dc3f1bd442884651be60dc8f11d', 'request_id': 'req-f9e05e9f-b066-4823-bbbd-5c8e10f415f0'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:51.729768 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f9e05e9f-b066-4823-bbbd-5c8e10f415f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d4e2dc3f1bd442884651be60dc8f11d', 'request_id': 'req-f9e05e9f-b066-4823-bbbd-5c8e10f415f0'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:51.740078 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f9e05e9f-b066-4823-bbbd-5c8e10f415f0 admin admin] The token cache is being invalidate because project 2d4e2dc3f1bd442884651be60dc8f11d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:50:51.740363 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f9e05e9f-b066-4823-bbbd-5c8e10f415f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:51.740974 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f9e05e9f-b066-4823-bbbd-5c8e10f415f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:51.742528 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1174/2387] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:50:51 2022] DELETE /identity/v3/projects/2d4e2dc3f1bd442884651be60dc8f11d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:50:51.751990 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c70c2a-7337-4c5f-97d0-bd9b6a757c9a service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:51.761569 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c70c2a-7337-4c5f-97d0-bd9b6a757c9a service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:51.779941 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:50:51.820026 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc2ab4-a62d-4005-ad6b-536171ba453d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:51.820894 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc2ab4-a62d-4005-ad6b-536171ba453d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:51.821180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc2ab4-a62d-4005-ad6b-536171ba453d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:51.821461 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc2ab4-a62d-4005-ad6b-536171ba453d admin admin] PATH_INFO: `/v3/users/f4a52c67307648ad998d9057d2f1a220` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:51.822762 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bc2ab4-a62d-4005-ad6b-536171ba453d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4a52c67307648ad998d9057d2f1a220)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:51.825271 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bc2ab4-a62d-4005-ad6b-536171ba453d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:51.869667 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-61bc2ab4-a62d-4005-ad6b-536171ba453d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4a52c67307648ad998d9057d2f1a220'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:51.870310 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-61bc2ab4-a62d-4005-ad6b-536171ba453d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4a52c67307648ad998d9057d2f1a220'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:51.870943 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-61bc2ab4-a62d-4005-ad6b-536171ba453d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4a52c67307648ad998d9057d2f1a220'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:51.878195 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-61bc2ab4-a62d-4005-ad6b-536171ba453d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4a52c67307648ad998d9057d2f1a220'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:51.885318 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-61bc2ab4-a62d-4005-ad6b-536171ba453d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4a52c67307648ad998d9057d2f1a220'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:51.902685 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1214/2388] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:50:51 2022] DELETE /identity/v3/users/f4a52c67307648ad998d9057d2f1a220 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:50:52.175485 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e05e9f-b066-4823-bbbd-5c8e10f415f0 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:52.176977 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f9e05e9f-b066-4823-bbbd-5c8e10f415f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:50:52.191133 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e05e9f-b066-4823-bbbd-5c8e10f415f0 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:52.250505 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0bd512-7112-4609-8aef-125267cccfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:52.251374 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0bd512-7112-4609-8aef-125267cccfac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:52.251652 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0bd512-7112-4609-8aef-125267cccfac admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:52.252098 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0bd512-7112-4609-8aef-125267cccfac admin admin] PATH_INFO: `/v3/projects/38e35fb553f242898aa865618d4805b8` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:52.253289 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0bd512-7112-4609-8aef-125267cccfac admin admin] RBAC: Authorizing `identity:delete_project(project_id=38e35fb553f242898aa865618d4805b8)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:52.255283 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0bd512-7112-4609-8aef-125267cccfac admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:52.291548 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:50:52.310134 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2a0bd512-7112-4609-8aef-125267cccfac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38e35fb553f242898aa865618d4805b8', 'request_id': 'req-2a0bd512-7112-4609-8aef-125267cccfac'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:52.316259 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2a0bd512-7112-4609-8aef-125267cccfac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38e35fb553f242898aa865618d4805b8', 'request_id': 'req-2a0bd512-7112-4609-8aef-125267cccfac'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:52.323422 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2a0bd512-7112-4609-8aef-125267cccfac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38e35fb553f242898aa865618d4805b8', 'request_id': 'req-2a0bd512-7112-4609-8aef-125267cccfac'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:52.333790 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2a0bd512-7112-4609-8aef-125267cccfac admin admin] The token cache is being invalidate because project 38e35fb553f242898aa865618d4805b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:50:52.334077 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2a0bd512-7112-4609-8aef-125267cccfac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:52.334719 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2a0bd512-7112-4609-8aef-125267cccfac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:52.336258 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1175/2389] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:50:52 2022] DELETE /identity/v3/projects/38e35fb553f242898aa865618d4805b8 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:50:52.341147 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b6db7-ee97-4c8d-8d2b-be858d448e96 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:52.341612 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b6db7-ee97-4c8d-8d2b-be858d448e96 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:52.341728 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b6db7-ee97-4c8d-8d2b-be858d448e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:52.361137 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-847b6db7-ee97-4c8d-8d2b-be858d448e96 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:50:52.362321 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-847b6db7-ee97-4c8d-8d2b-be858d448e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:50:52.419715 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1215/2390] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:50:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:50:52.427458 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c0466-0947-44e0-9366-c4bf3abeded2 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:52.427784 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c0466-0947-44e0-9366-c4bf3abeded2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:52.428069 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c0466-0947-44e0-9366-c4bf3abeded2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:52.446423 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-9a8c0466-0947-44e0-9366-c4bf3abeded2 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:50:52.447715 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9a8c0466-0947-44e0-9366-c4bf3abeded2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:50:52.455769 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1176/2391] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:50:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:50:52.460028 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b6db7-ee97-4c8d-8d2b-be858d448e96 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:52.470363 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847b6db7-ee97-4c8d-8d2b-be858d448e96 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:52.475364 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec97f1-6ab9-4f76-aebf-4ec25213fe4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:52.476019 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec97f1-6ab9-4f76-aebf-4ec25213fe4e admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:52.476307 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec97f1-6ab9-4f76-aebf-4ec25213fe4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:52.476584 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec97f1-6ab9-4f76-aebf-4ec25213fe4e admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:52.477549 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afec97f1-6ab9-4f76-aebf-4ec25213fe4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:50:52.477937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afec97f1-6ab9-4f76-aebf-4ec25213fe4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:52.479574 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afec97f1-6ab9-4f76-aebf-4ec25213fe4e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:52.492329 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1216/2392] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:50:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:50:52.496483 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c0466-0947-44e0-9366-c4bf3abeded2 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:52.507900 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c0466-0947-44e0-9366-c4bf3abeded2 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:52.513126 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1478ebc2-b114-48df-9e64-d8a6a2e07d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:52.513785 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478ebc2-b114-48df-9e64-d8a6a2e07d31 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:52.514068 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478ebc2-b114-48df-9e64-d8a6a2e07d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:52.514345 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1478ebc2-b114-48df-9e64-d8a6a2e07d31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:52.515077 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1478ebc2-b114-48df-9e64-d8a6a2e07d31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:52.516995 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1478ebc2-b114-48df-9e64-d8a6a2e07d31 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:52.551137 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1177/2393] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:50:52 2022] POST /identity/v3/projects => generated 363 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:50:52.555406 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec97f1-6ab9-4f76-aebf-4ec25213fe4e admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:52.566106 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec97f1-6ab9-4f76-aebf-4ec25213fe4e admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:52.592226 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:50:52.624203 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f1d69-5690-4ac1-b91f-003330c057d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:52.624875 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f1d69-5690-4ac1-b91f-003330c057d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:52.625159 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f1d69-5690-4ac1-b91f-003330c057d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:52.625465 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f1d69-5690-4ac1-b91f-003330c057d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:52.626160 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393f1d69-5690-4ac1-b91f-003330c057d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:52.628161 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393f1d69-5690-4ac1-b91f-003330c057d9 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:52.648470 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1217/2394] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:50:52 2022] POST /identity/v3/users => generated 282 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:50:52.653063 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1478ebc2-b114-48df-9e64-d8a6a2e07d31 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:52.663687 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1478ebc2-b114-48df-9e64-d8a6a2e07d31 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:52.669221 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000519f8-9293-4388-8101-9f760944f2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:52.669890 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000519f8-9293-4388-8101-9f760944f2ba admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:52.670173 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000519f8-9293-4388-8101-9f760944f2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:52.670449 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000519f8-9293-4388-8101-9f760944f2ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:52.671267 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000519f8-9293-4388-8101-9f760944f2ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:52.672889 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000519f8-9293-4388-8101-9f760944f2ba admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:52.686510 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1178/2395] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:50:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:50:52.687877 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f1d69-5690-4ac1-b91f-003330c057d9 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:52.699544 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f1d69-5690-4ac1-b91f-003330c057d9 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:52.704280 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c103b-242c-42d3-9587-f2f409cfda3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:52.704952 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c103b-242c-42d3-9587-f2f409cfda3a admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:52.705239 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c103b-242c-42d3-9587-f2f409cfda3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:52.705647 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c103b-242c-42d3-9587-f2f409cfda3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:52.706269 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0c103b-242c-42d3-9587-f2f409cfda3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:52.707984 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0c103b-242c-42d3-9587-f2f409cfda3a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:52.720599 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1218/2396] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:50:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:50:52.724788 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000519f8-9293-4388-8101-9f760944f2ba admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:52.735830 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000519f8-9293-4388-8101-9f760944f2ba admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:52.740681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111969a-68a9-4f46-a492-035a739b4238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:52.741922 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111969a-68a9-4f46-a492-035a739b4238 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:52.742245 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111969a-68a9-4f46-a492-035a739b4238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:52.742699 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7111969a-68a9-4f46-a492-035a739b4238 admin admin] PATH_INFO: `/v3/projects/2a646b950ad54221a339f5ad4207d807/users/656509f9bcaa47c3b9147f39f8e53322/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:52.759182 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7111969a-68a9-4f46-a492-035a739b4238 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a646b950ad54221a339f5ad4207d807, user_id=656509f9bcaa47c3b9147f39f8e53322, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:52.761820 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7111969a-68a9-4f46-a492-035a739b4238 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:52.776119 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1179/2397] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:50:52 2022] PUT /identity/v3/projects/2a646b950ad54221a339f5ad4207d807/users/656509f9bcaa47c3b9147f39f8e53322/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:50:52.788378 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82769836-5134-4c16-89da-a39670d98ddf None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:52.789455 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82769836-5134-4c16-89da-a39670d98ddf None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:52.789455 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82769836-5134-4c16-89da-a39670d98ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:52.819263 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-82769836-5134-4c16-89da-a39670d98ddf None None] MFA Rules not processed for user `656509f9bcaa47c3b9147f39f8e53322`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:50:52.820471 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-82769836-5134-4c16-89da-a39670d98ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:50:52.885482 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1219/2398] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:50:52 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:50:52.890708 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111969a-68a9-4f46-a492-035a739b4238 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:52.953341 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7111969a-68a9-4f46-a492-035a739b4238 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:52.958003 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c84bb0-aff8-4b1c-8c0c-240ad84d3bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:52.958703 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c84bb0-aff8-4b1c-8c0c-240ad84d3bbb admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:52.958971 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c84bb0-aff8-4b1c-8c0c-240ad84d3bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:52.959248 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c84bb0-aff8-4b1c-8c0c-240ad84d3bbb admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:52.959944 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c84bb0-aff8-4b1c-8c0c-240ad84d3bbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:52.961834 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c84bb0-aff8-4b1c-8c0c-240ad84d3bbb admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:52.987981 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1180/2399] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:50:52 2022] POST /identity/v3/projects => generated 363 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:50:52.992098 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82769836-5134-4c16-89da-a39670d98ddf None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:53.003408 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82769836-5134-4c16-89da-a39670d98ddf None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:53.058640 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9eefa1-1e7e-458b-bf5c-0e9e68ea66e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:53.059925 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9eefa1-1e7e-458b-bf5c-0e9e68ea66e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:53.060215 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9eefa1-1e7e-458b-bf5c-0e9e68ea66e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:53.060496 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9eefa1-1e7e-458b-bf5c-0e9e68ea66e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:53.061244 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9eefa1-1e7e-458b-bf5c-0e9e68ea66e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:53.063239 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9eefa1-1e7e-458b-bf5c-0e9e68ea66e1 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:53.082533 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1220/2400] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:50:52 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:50:53.086715 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c84bb0-aff8-4b1c-8c0c-240ad84d3bbb admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:53.096853 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c84bb0-aff8-4b1c-8c0c-240ad84d3bbb admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:53.101336 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da227dee-9bdd-4ec6-b6b6-9d727dcb21ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:53.101984 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da227dee-9bdd-4ec6-b6b6-9d727dcb21ac admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:53.102267 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da227dee-9bdd-4ec6-b6b6-9d727dcb21ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:53.102579 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da227dee-9bdd-4ec6-b6b6-9d727dcb21ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:53.103303 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da227dee-9bdd-4ec6-b6b6-9d727dcb21ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:53.104903 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da227dee-9bdd-4ec6-b6b6-9d727dcb21ac admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:53.115883 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1181/2401] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 03:50:53.119996 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9eefa1-1e7e-458b-bf5c-0e9e68ea66e1 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:53.130843 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9eefa1-1e7e-458b-bf5c-0e9e68ea66e1 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:53.135846 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511aac3e-44bb-4167-9701-da88a61c6a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:53.136620 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511aac3e-44bb-4167-9701-da88a61c6a53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:53.136918 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511aac3e-44bb-4167-9701-da88a61c6a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:53.137203 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511aac3e-44bb-4167-9701-da88a61c6a53 admin admin] PATH_INFO: `/v3/projects/fcd7ad35862d4e18a6eb674eb9ccf693/users/94b73871d6ec4e26b9e87c30ef262ea9/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:53.153202 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511aac3e-44bb-4167-9701-da88a61c6a53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcd7ad35862d4e18a6eb674eb9ccf693, user_id=94b73871d6ec4e26b9e87c30ef262ea9, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:53.155873 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511aac3e-44bb-4167-9701-da88a61c6a53 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:53.168198 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1221/2402] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:50:53 2022] PUT /identity/v3/projects/fcd7ad35862d4e18a6eb674eb9ccf693/users/94b73871d6ec4e26b9e87c30ef262ea9/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:50:53.172705 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da227dee-9bdd-4ec6-b6b6-9d727dcb21ac admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:53.182789 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da227dee-9bdd-4ec6-b6b6-9d727dcb21ac admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:53.202339 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:50:53.243016 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5bff13-bf93-46d3-8680-9bd0b170591d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:53.243692 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bff13-bf93-46d3-8680-9bd0b170591d admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:53.243981 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bff13-bf93-46d3-8680-9bd0b170591d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:53.244263 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5bff13-bf93-46d3-8680-9bd0b170591d admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:53.244996 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5bff13-bf93-46d3-8680-9bd0b170591d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:53.246695 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5bff13-bf93-46d3-8680-9bd0b170591d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:53.256269 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1182/2403] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:50:53.260448 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511aac3e-44bb-4167-9701-da88a61c6a53 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:53.265955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:50:53.272168 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511aac3e-44bb-4167-9701-da88a61c6a53 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:53.276846 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978da9d-2e28-40dc-b0e5-f7e21a5cfad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:53.278230 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978da9d-2e28-40dc-b0e5-f7e21a5cfad2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:53.278538 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978da9d-2e28-40dc-b0e5-f7e21a5cfad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:53.278813 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978da9d-2e28-40dc-b0e5-f7e21a5cfad2 admin admin] PATH_INFO: `/v3/projects/fcd7ad35862d4e18a6eb674eb9ccf693/users/94b73871d6ec4e26b9e87c30ef262ea9/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:53.280802 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978da9d-2e28-40dc-b0e5-f7e21a5cfad2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcd7ad35862d4e18a6eb674eb9ccf693, user_id=94b73871d6ec4e26b9e87c30ef262ea9, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:53.283453 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978da9d-2e28-40dc-b0e5-f7e21a5cfad2 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:53.294308 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1222/2404] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:50:53 2022] PUT /identity/v3/projects/fcd7ad35862d4e18a6eb674eb9ccf693/users/94b73871d6ec4e26b9e87c30ef262ea9/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:50:53.305257 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff4a2d-223c-4893-a446-59a7ee181cfe None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:53.305543 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff4a2d-223c-4893-a446-59a7ee181cfe None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:53.305819 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dff4a2d-223c-4893-a446-59a7ee181cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:53.331281 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-9dff4a2d-223c-4893-a446-59a7ee181cfe None None] MFA Rules not processed for user `94b73871d6ec4e26b9e87c30ef262ea9`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:50:53.332409 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9dff4a2d-223c-4893-a446-59a7ee181cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:50:53.399105 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1183/2405] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:50:53 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:50:53.410757 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978da9d-2e28-40dc-b0e5-f7e21a5cfad2 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:53.412507 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e978da9d-2e28-40dc-b0e5-f7e21a5cfad2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:50:53.467343 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978da9d-2e28-40dc-b0e5-f7e21a5cfad2 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:53.470947 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea77c5a-09e3-41dd-a2dd-a208346956b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:53.471579 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea77c5a-09e3-41dd-a2dd-a208346956b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:53.471862 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea77c5a-09e3-41dd-a2dd-a208346956b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:53.472138 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea77c5a-09e3-41dd-a2dd-a208346956b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:53.481410 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea77c5a-09e3-41dd-a2dd-a208346956b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:53.482848 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea77c5a-09e3-41dd-a2dd-a208346956b0 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:53.491906 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1223/2406] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:50:53 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:50:53.882530 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff4a2d-223c-4893-a446-59a7ee181cfe None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:53.948865 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dff4a2d-223c-4893-a446-59a7ee181cfe None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:53.953923 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d2e6e-dd8a-4858-b402-53d7f3083c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:53.955065 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d2e6e-dd8a-4858-b402-53d7f3083c4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:53.955355 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d2e6e-dd8a-4858-b402-53d7f3083c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:53.955627 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d2e6e-dd8a-4858-b402-53d7f3083c4d admin admin] PATH_INFO: `/v3/users/656509f9bcaa47c3b9147f39f8e53322` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:53.956812 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d2e6e-dd8a-4858-b402-53d7f3083c4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=656509f9bcaa47c3b9147f39f8e53322)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:53.958778 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d2e6e-dd8a-4858-b402-53d7f3083c4d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:54.003897 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5a6d2e6e-dd8a-4858-b402-53d7f3083c4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '656509f9bcaa47c3b9147f39f8e53322'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:54.004554 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5a6d2e6e-dd8a-4858-b402-53d7f3083c4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '656509f9bcaa47c3b9147f39f8e53322'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:54.005170 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5a6d2e6e-dd8a-4858-b402-53d7f3083c4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '656509f9bcaa47c3b9147f39f8e53322'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:54.006363 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:50:54.014510 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5a6d2e6e-dd8a-4858-b402-53d7f3083c4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '656509f9bcaa47c3b9147f39f8e53322'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:54.021386 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5a6d2e6e-dd8a-4858-b402-53d7f3083c4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '656509f9bcaa47c3b9147f39f8e53322'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:54.038578 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1184/2407] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:50:53 2022] DELETE /identity/v3/users/656509f9bcaa47c3b9147f39f8e53322 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:50:54.043169 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4ca54-52d8-47ef-8c40-23840c585230 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:54.043467 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4ca54-52d8-47ef-8c40-23840c585230 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:54.043755 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db4ca54-52d8-47ef-8c40-23840c585230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:54.061457 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-4db4ca54-52d8-47ef-8c40-23840c585230 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:50:54.062692 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4db4ca54-52d8-47ef-8c40-23840c585230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:50:54.122853 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1224/2408] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:50:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:50:54.132762 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d2e6e-dd8a-4858-b402-53d7f3083c4d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:54.134302 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5a6d2e6e-dd8a-4858-b402-53d7f3083c4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:50:54.193017 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d2e6e-dd8a-4858-b402-53d7f3083c4d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:54.197044 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08beea5-8f58-4af6-ba9a-1c8ed9df6753 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:54.197761 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08beea5-8f58-4af6-ba9a-1c8ed9df6753 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:54.198042 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08beea5-8f58-4af6-ba9a-1c8ed9df6753 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:54.198320 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08beea5-8f58-4af6-ba9a-1c8ed9df6753 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:54.208150 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08beea5-8f58-4af6-ba9a-1c8ed9df6753 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:54.209592 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08beea5-8f58-4af6-ba9a-1c8ed9df6753 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:54.219477 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1185/2409] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:50:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:50:54.485775 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4ca54-52d8-47ef-8c40-23840c585230 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:54.487385 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4db4ca54-52d8-47ef-8c40-23840c585230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:50:54.499527 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db4ca54-52d8-47ef-8c40-23840c585230 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:54.504119 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b96d9e-372b-416d-a5dd-061ab8beacbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:54.504981 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b96d9e-372b-416d-a5dd-061ab8beacbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:54.505287 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b96d9e-372b-416d-a5dd-061ab8beacbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:54.505563 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b96d9e-372b-416d-a5dd-061ab8beacbf admin admin] PATH_INFO: `/v3/projects/2a646b950ad54221a339f5ad4207d807` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:54.507332 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b96d9e-372b-416d-a5dd-061ab8beacbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a646b950ad54221a339f5ad4207d807)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:54.508827 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b96d9e-372b-416d-a5dd-061ab8beacbf admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:54.555774 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c9b96d9e-372b-416d-a5dd-061ab8beacbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a646b950ad54221a339f5ad4207d807', 'request_id': 'req-c9b96d9e-372b-416d-a5dd-061ab8beacbf'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:54.561856 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c9b96d9e-372b-416d-a5dd-061ab8beacbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a646b950ad54221a339f5ad4207d807', 'request_id': 'req-c9b96d9e-372b-416d-a5dd-061ab8beacbf'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:54.569238 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c9b96d9e-372b-416d-a5dd-061ab8beacbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a646b950ad54221a339f5ad4207d807', 'request_id': 'req-c9b96d9e-372b-416d-a5dd-061ab8beacbf'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:54.580009 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c9b96d9e-372b-416d-a5dd-061ab8beacbf admin admin] The token cache is being invalidate because project 2a646b950ad54221a339f5ad4207d807 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:50:54.580296 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c9b96d9e-372b-416d-a5dd-061ab8beacbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:54.580925 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c9b96d9e-372b-416d-a5dd-061ab8beacbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:54.582493 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1225/2410] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:50:54 2022] DELETE /identity/v3/projects/2a646b950ad54221a339f5ad4207d807 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:50:54.586408 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08beea5-8f58-4af6-ba9a-1c8ed9df6753 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:54.596491 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08beea5-8f58-4af6-ba9a-1c8ed9df6753 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:54.655822 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f0ffa9-7428-40b3-a55e-fa8ab81d4ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:54.656619 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0ffa9-7428-40b3-a55e-fa8ab81d4ba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:54.656903 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0ffa9-7428-40b3-a55e-fa8ab81d4ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:54.657180 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0ffa9-7428-40b3-a55e-fa8ab81d4ba8 admin admin] PATH_INFO: `/v3/users/94b73871d6ec4e26b9e87c30ef262ea9` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:54.658363 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f0ffa9-7428-40b3-a55e-fa8ab81d4ba8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94b73871d6ec4e26b9e87c30ef262ea9)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:54.660626 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f0ffa9-7428-40b3-a55e-fa8ab81d4ba8 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:54.705511 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-06f0ffa9-7428-40b3-a55e-fa8ab81d4ba8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94b73871d6ec4e26b9e87c30ef262ea9'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:54.706153 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-06f0ffa9-7428-40b3-a55e-fa8ab81d4ba8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94b73871d6ec4e26b9e87c30ef262ea9'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:54.706775 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-06f0ffa9-7428-40b3-a55e-fa8ab81d4ba8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94b73871d6ec4e26b9e87c30ef262ea9'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:54.713574 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-06f0ffa9-7428-40b3-a55e-fa8ab81d4ba8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94b73871d6ec4e26b9e87c30ef262ea9'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:54.720974 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-06f0ffa9-7428-40b3-a55e-fa8ab81d4ba8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94b73871d6ec4e26b9e87c30ef262ea9'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:54.726062 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:50:54.740467 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1186/2411] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:50:54 2022] DELETE /identity/v3/users/94b73871d6ec4e26b9e87c30ef262ea9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:50:55.027604 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b96d9e-372b-416d-a5dd-061ab8beacbf admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:55.029115 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c9b96d9e-372b-416d-a5dd-061ab8beacbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:50:55.045106 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b96d9e-372b-416d-a5dd-061ab8beacbf admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:55.057962 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:50:55.106324 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb354f3e-92e2-4242-bafc-413bc513f3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:55.107260 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb354f3e-92e2-4242-bafc-413bc513f3ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:55.107603 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb354f3e-92e2-4242-bafc-413bc513f3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:55.107803 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb354f3e-92e2-4242-bafc-413bc513f3ce admin admin] PATH_INFO: `/v3/projects/fcd7ad35862d4e18a6eb674eb9ccf693` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:55.109009 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb354f3e-92e2-4242-bafc-413bc513f3ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcd7ad35862d4e18a6eb674eb9ccf693)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:55.110936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb354f3e-92e2-4242-bafc-413bc513f3ce admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:55.161753 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-bb354f3e-92e2-4242-bafc-413bc513f3ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcd7ad35862d4e18a6eb674eb9ccf693', 'request_id': 'req-bb354f3e-92e2-4242-bafc-413bc513f3ce'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:55.167953 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-bb354f3e-92e2-4242-bafc-413bc513f3ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcd7ad35862d4e18a6eb674eb9ccf693', 'request_id': 'req-bb354f3e-92e2-4242-bafc-413bc513f3ce'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:55.181192 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-bb354f3e-92e2-4242-bafc-413bc513f3ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcd7ad35862d4e18a6eb674eb9ccf693', 'request_id': 'req-bb354f3e-92e2-4242-bafc-413bc513f3ce'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:55.192546 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-bb354f3e-92e2-4242-bafc-413bc513f3ce admin admin] The token cache is being invalidate because project fcd7ad35862d4e18a6eb674eb9ccf693 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:50:55.192862 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-bb354f3e-92e2-4242-bafc-413bc513f3ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:55.193498 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-bb354f3e-92e2-4242-bafc-413bc513f3ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:50:55.195332 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1226/2412] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:50:55 2022] DELETE /identity/v3/projects/fcd7ad35862d4e18a6eb674eb9ccf693 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:50:55.200246 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe104b6-31cf-435d-8090-65fbac88591d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:55.200699 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe104b6-31cf-435d-8090-65fbac88591d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:55.200929 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe104b6-31cf-435d-8090-65fbac88591d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:55.219087 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-0fe104b6-31cf-435d-8090-65fbac88591d None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:50:55.220288 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0fe104b6-31cf-435d-8090-65fbac88591d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:50:55.282689 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1187/2413] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:50:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:50:55.290962 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463966e-b3e8-4e0e-b2b5-fe262c59eda9 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:55.291265 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463966e-b3e8-4e0e-b2b5-fe262c59eda9 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:55.291524 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463966e-b3e8-4e0e-b2b5-fe262c59eda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:55.311473 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-c463966e-b3e8-4e0e-b2b5-fe262c59eda9 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:50:55.312672 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c463966e-b3e8-4e0e-b2b5-fe262c59eda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:50:55.320855 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1227/2414] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:50:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:50:55.325288 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe104b6-31cf-435d-8090-65fbac88591d None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:55.335110 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe104b6-31cf-435d-8090-65fbac88591d None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:55.339876 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd27d4-1bd8-4aa4-9dc9-6c565167b815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:55.341087 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd27d4-1bd8-4aa4-9dc9-6c565167b815 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:55.341372 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd27d4-1bd8-4aa4-9dc9-6c565167b815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:55.341645 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd27d4-1bd8-4aa4-9dc9-6c565167b815 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:55.342381 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fd27d4-1bd8-4aa4-9dc9-6c565167b815 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:50:55.342718 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fd27d4-1bd8-4aa4-9dc9-6c565167b815 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:55.344342 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fd27d4-1bd8-4aa4-9dc9-6c565167b815 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:55.361721 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1188/2415] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:50:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:50:55.362807 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463966e-b3e8-4e0e-b2b5-fe262c59eda9 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:55.373449 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c463966e-b3e8-4e0e-b2b5-fe262c59eda9 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:55.379673 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8b1d1-9a87-4227-864b-58437125b847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:55.380340 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8b1d1-9a87-4227-864b-58437125b847 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:55.380625 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8b1d1-9a87-4227-864b-58437125b847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:55.380903 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8b1d1-9a87-4227-864b-58437125b847 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:55.381604 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c8b1d1-9a87-4227-864b-58437125b847 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:55.383557 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c8b1d1-9a87-4227-864b-58437125b847 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:55.414564 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1228/2416] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:50:55 2022] POST /identity/v3/projects => generated 357 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:50:55.419105 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd27d4-1bd8-4aa4-9dc9-6c565167b815 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:55.429311 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd27d4-1bd8-4aa4-9dc9-6c565167b815 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:55.492536 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383cad9-d1de-4c98-a03d-4a56e0edf8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:55.493274 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383cad9-d1de-4c98-a03d-4a56e0edf8b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:55.493557 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383cad9-d1de-4c98-a03d-4a56e0edf8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:55.493832 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4383cad9-d1de-4c98-a03d-4a56e0edf8b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:55.494551 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4383cad9-d1de-4c98-a03d-4a56e0edf8b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:55.496482 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4383cad9-d1de-4c98-a03d-4a56e0edf8b0 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:55.517760 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1189/2417] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:50:55 2022] POST /identity/v3/users => generated 279 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:50:55.521670 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8b1d1-9a87-4227-864b-58437125b847 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:55.532397 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8b1d1-9a87-4227-864b-58437125b847 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:55.538294 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8be8e-a16d-4abb-b8ce-a038f6ace84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:55.539221 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8be8e-a16d-4abb-b8ce-a038f6ace84f admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:55.539521 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8be8e-a16d-4abb-b8ce-a038f6ace84f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:55.539905 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8be8e-a16d-4abb-b8ce-a038f6ace84f admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:55.540645 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d8be8e-a16d-4abb-b8ce-a038f6ace84f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:55.542275 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d8be8e-a16d-4abb-b8ce-a038f6ace84f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:55.552888 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1229/2418] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:50:55.557014 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383cad9-d1de-4c98-a03d-4a56e0edf8b0 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:55.566712 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4383cad9-d1de-4c98-a03d-4a56e0edf8b0 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:55.571263 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd1073-0d52-4910-a4a1-3766c2f5dfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:55.571920 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd1073-0d52-4910-a4a1-3766c2f5dfb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:55.572210 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd1073-0d52-4910-a4a1-3766c2f5dfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:55.572492 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd1073-0d52-4910-a4a1-3766c2f5dfb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:55.573217 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd1073-0d52-4910-a4a1-3766c2f5dfb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:55.575362 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd1073-0d52-4910-a4a1-3766c2f5dfb3 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:55.584980 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1190/2419] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:50:55.588828 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8be8e-a16d-4abb-b8ce-a038f6ace84f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:55.599193 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8be8e-a16d-4abb-b8ce-a038f6ace84f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:55.603809 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1af879c-05c3-4d62-a5f0-00b5cafdbee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:55.604673 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af879c-05c3-4d62-a5f0-00b5cafdbee7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:55.604956 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af879c-05c3-4d62-a5f0-00b5cafdbee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:55.605232 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af879c-05c3-4d62-a5f0-00b5cafdbee7 admin admin] PATH_INFO: `/v3/projects/b2d47beae76444a3a832c5135771d169/users/77b1bbc2c07f4dca9c2f7e2c044176b8/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:55.619309 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1af879c-05c3-4d62-a5f0-00b5cafdbee7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2d47beae76444a3a832c5135771d169, user_id=77b1bbc2c07f4dca9c2f7e2c044176b8, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:55.621951 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1af879c-05c3-4d62-a5f0-00b5cafdbee7 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:55.634577 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1230/2420] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:50:55 2022] PUT /identity/v3/projects/b2d47beae76444a3a832c5135771d169/users/77b1bbc2c07f4dca9c2f7e2c044176b8/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:50:55.645115 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a847eb-92d9-46cb-bbf5-dad9b7e8ea98 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:55.645407 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a847eb-92d9-46cb-bbf5-dad9b7e8ea98 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:55.645711 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a847eb-92d9-46cb-bbf5-dad9b7e8ea98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:55.672721 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c1a847eb-92d9-46cb-bbf5-dad9b7e8ea98 None None] MFA Rules not processed for user `77b1bbc2c07f4dca9c2f7e2c044176b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:50:55.673887 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c1a847eb-92d9-46cb-bbf5-dad9b7e8ea98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:50:55.714939 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:50:55.739297 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1191/2421] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:50:55 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:50:55.743778 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1af879c-05c3-4d62-a5f0-00b5cafdbee7 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:55.787840 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:50:55.805736 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1af879c-05c3-4d62-a5f0-00b5cafdbee7 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:55.811104 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6559fbcd-c072-4669-8625-2f95b9bd4ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:55.811756 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559fbcd-c072-4669-8625-2f95b9bd4ddd admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:55.812037 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559fbcd-c072-4669-8625-2f95b9bd4ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:55.812310 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559fbcd-c072-4669-8625-2f95b9bd4ddd admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:55.812999 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6559fbcd-c072-4669-8625-2f95b9bd4ddd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:55.814922 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6559fbcd-c072-4669-8625-2f95b9bd4ddd admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:55.839581 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1231/2422] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:50:55 2022] POST /identity/v3/projects => generated 357 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:50:55.843629 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a847eb-92d9-46cb-bbf5-dad9b7e8ea98 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:55.854123 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a847eb-92d9-46cb-bbf5-dad9b7e8ea98 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:55.908443 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b638b-cee3-4078-812d-e7ed178f3ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:55.909354 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b638b-cee3-4078-812d-e7ed178f3ee6 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:55.909633 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b638b-cee3-4078-812d-e7ed178f3ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:55.909904 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b638b-cee3-4078-812d-e7ed178f3ee6 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:55.910631 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b638b-cee3-4078-812d-e7ed178f3ee6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:55.912573 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b638b-cee3-4078-812d-e7ed178f3ee6 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:55.931903 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1192/2423] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:50:55 2022] POST /identity/v3/users => generated 285 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:50:55.936335 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6559fbcd-c072-4669-8625-2f95b9bd4ddd admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:55.946622 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6559fbcd-c072-4669-8625-2f95b9bd4ddd admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:55.951837 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6b4ee-2157-4539-9bad-9065b441205f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:55.952492 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6b4ee-2157-4539-9bad-9065b441205f admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:55.952775 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6b4ee-2157-4539-9bad-9065b441205f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:55.953047 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6b4ee-2157-4539-9bad-9065b441205f admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:55.953770 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6b4ee-2157-4539-9bad-9065b441205f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:55.955389 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6b4ee-2157-4539-9bad-9065b441205f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:55.965784 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1232/2424] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:50:55.969684 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b638b-cee3-4078-812d-e7ed178f3ee6 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:55.979492 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b638b-cee3-4078-812d-e7ed178f3ee6 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:55.984175 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd17018-97b5-4e95-a923-3f7afebb02dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:55.985052 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd17018-97b5-4e95-a923-3f7afebb02dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:55.985337 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd17018-97b5-4e95-a923-3f7afebb02dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:55.985615 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd17018-97b5-4e95-a923-3f7afebb02dd admin admin] PATH_INFO: `/v3/projects/1beab760fb2c4c7c8f48c9282bfff00e/users/776b1de861c8402b86281673b93b2a2b/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:56.001915 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd17018-97b5-4e95-a923-3f7afebb02dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=1beab760fb2c4c7c8f48c9282bfff00e, user_id=776b1de861c8402b86281673b93b2a2b, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:56.004595 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd17018-97b5-4e95-a923-3f7afebb02dd admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:56.017434 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1193/2425] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:50:55 2022] PUT /identity/v3/projects/1beab760fb2c4c7c8f48c9282bfff00e/users/776b1de861c8402b86281673b93b2a2b/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:50:56.021412 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6b4ee-2157-4539-9bad-9065b441205f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:56.031457 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6b4ee-2157-4539-9bad-9065b441205f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:56.088538 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26906c2f-02b7-4944-8cf2-5d0d66109d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:56.089203 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26906c2f-02b7-4944-8cf2-5d0d66109d84 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:56.089489 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26906c2f-02b7-4944-8cf2-5d0d66109d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:56.089767 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26906c2f-02b7-4944-8cf2-5d0d66109d84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:56.090528 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26906c2f-02b7-4944-8cf2-5d0d66109d84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:56.092123 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26906c2f-02b7-4944-8cf2-5d0d66109d84 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:56.101908 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1233/2426] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:50:56 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:50:56.106148 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd17018-97b5-4e95-a923-3f7afebb02dd admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:56.116358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd17018-97b5-4e95-a923-3f7afebb02dd admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:56.121080 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95afa3b-8d70-46e0-83c4-de80ce955ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:56.122554 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95afa3b-8d70-46e0-83c4-de80ce955ba0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:56.122838 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95afa3b-8d70-46e0-83c4-de80ce955ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:56.123117 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95afa3b-8d70-46e0-83c4-de80ce955ba0 admin admin] PATH_INFO: `/v3/projects/1beab760fb2c4c7c8f48c9282bfff00e/users/776b1de861c8402b86281673b93b2a2b/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:56.125127 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95afa3b-8d70-46e0-83c4-de80ce955ba0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1beab760fb2c4c7c8f48c9282bfff00e, user_id=776b1de861c8402b86281673b93b2a2b, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:56.127798 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95afa3b-8d70-46e0-83c4-de80ce955ba0 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:56.138444 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1194/2427] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:50:56 2022] PUT /identity/v3/projects/1beab760fb2c4c7c8f48c9282bfff00e/users/776b1de861c8402b86281673b93b2a2b/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:50:56.149587 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c6e83-e866-4198-82a8-39f2b93a2494 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:56.149880 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c6e83-e866-4198-82a8-39f2b93a2494 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:56.150162 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c6e83-e866-4198-82a8-39f2b93a2494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:56.177654 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-021c6e83-e866-4198-82a8-39f2b93a2494 None None] MFA Rules not processed for user `776b1de861c8402b86281673b93b2a2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:50:56.178889 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-021c6e83-e866-4198-82a8-39f2b93a2494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:50:56.247146 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1234/2428] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:50:56 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:50:56.258925 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95afa3b-8d70-46e0-83c4-de80ce955ba0 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:56.260728 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f95afa3b-8d70-46e0-83c4-de80ce955ba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:50:56.321039 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95afa3b-8d70-46e0-83c4-de80ce955ba0 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:56.325267 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14343798-ed9b-44d5-ae2d-26562b6d4241 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:56.325922 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14343798-ed9b-44d5-ae2d-26562b6d4241 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:56.326208 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14343798-ed9b-44d5-ae2d-26562b6d4241 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:56.326514 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14343798-ed9b-44d5-ae2d-26562b6d4241 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:56.336223 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14343798-ed9b-44d5-ae2d-26562b6d4241 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:56.337887 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14343798-ed9b-44d5-ae2d-26562b6d4241 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:56.348385 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1195/2429] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:50:56 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:50:56.418846 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c6e83-e866-4198-82a8-39f2b93a2494 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:50:56.428440 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c6e83-e866-4198-82a8-39f2b93a2494 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:50:56.432051 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e19b9-bbc4-48de-83a5-d32f6cee1e8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:50:56.432694 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e19b9-bbc4-48de-83a5-d32f6cee1e8e service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:50:56.432979 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e19b9-bbc4-48de-83a5-d32f6cee1e8e service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:50:56.433259 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89e19b9-bbc4-48de-83a5-d32f6cee1e8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:50:56.469024 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:50:56.492676 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e19b9-bbc4-48de-83a5-d32f6cee1e8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:50:56.494105 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89e19b9-bbc4-48de-83a5-d32f6cee1e8e service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:50:56.502882 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1235/2430] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:50:56 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:51:02.449690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f601e-9b53-4b05-949c-9ddcf682c077 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:02.450167 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f601e-9b53-4b05-949c-9ddcf682c077 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:02.450261 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f601e-9b53-4b05-949c-9ddcf682c077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:02.468256 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-790f601e-9b53-4b05-949c-9ddcf682c077 None None] MFA Rules not processed for user `52f492a1c5f5474d86a6ac8f0348321b`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:51:02.469462 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-790f601e-9b53-4b05-949c-9ddcf682c077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:02.502418 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:51:02.525703 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1196/2431] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:51:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:51:06.498905 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=11 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:51:11.362391 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e19b9-bbc4-48de-83a5-d32f6cee1e8e service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:11.424301 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89e19b9-bbc4-48de-83a5-d32f6cee1e8e service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:11.428888 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59710a-07b7-4684-909e-c0355862583d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:11.429762 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59710a-07b7-4684-909e-c0355862583d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:11.430049 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59710a-07b7-4684-909e-c0355862583d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:11.430329 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59710a-07b7-4684-909e-c0355862583d admin admin] PATH_INFO: `/v3/users/77b1bbc2c07f4dca9c2f7e2c044176b8` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:11.431555 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea59710a-07b7-4684-909e-c0355862583d admin admin] RBAC: Authorizing `identity:delete_user(user_id=77b1bbc2c07f4dca9c2f7e2c044176b8)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:11.434085 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea59710a-07b7-4684-909e-c0355862583d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:11.482903 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ea59710a-07b7-4684-909e-c0355862583d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77b1bbc2c07f4dca9c2f7e2c044176b8'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:11.483561 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ea59710a-07b7-4684-909e-c0355862583d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77b1bbc2c07f4dca9c2f7e2c044176b8'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:11.484210 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ea59710a-07b7-4684-909e-c0355862583d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77b1bbc2c07f4dca9c2f7e2c044176b8'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:11.491397 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ea59710a-07b7-4684-909e-c0355862583d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77b1bbc2c07f4dca9c2f7e2c044176b8'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:11.500021 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ea59710a-07b7-4684-909e-c0355862583d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77b1bbc2c07f4dca9c2f7e2c044176b8'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:11.517917 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1236/2432] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:51:11 2022] DELETE /identity/v3/users/77b1bbc2c07f4dca9c2f7e2c044176b8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:51:11.522156 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91129f85-a73d-4978-9c5c-8de1b483c551 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:11.522748 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91129f85-a73d-4978-9c5c-8de1b483c551 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:11.522748 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91129f85-a73d-4978-9c5c-8de1b483c551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:11.540838 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-91129f85-a73d-4978-9c5c-8de1b483c551 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:51:11.542309 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-91129f85-a73d-4978-9c5c-8de1b483c551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:11.612539 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1197/2433] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:51:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:51:11.619484 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59710a-07b7-4684-909e-c0355862583d admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:11.621060 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ea59710a-07b7-4684-909e-c0355862583d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:11.678477 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59710a-07b7-4684-909e-c0355862583d admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:11.682384 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb9600-265c-4507-87d6-ccabefeaa12d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:11.683061 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb9600-265c-4507-87d6-ccabefeaa12d service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:11.683373 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb9600-265c-4507-87d6-ccabefeaa12d service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:11.683644 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb9600-265c-4507-87d6-ccabefeaa12d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:11.692600 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb9600-265c-4507-87d6-ccabefeaa12d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:11.694038 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb9600-265c-4507-87d6-ccabefeaa12d service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:11.704152 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1237/2434] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:51:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:51:11.977116 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91129f85-a73d-4978-9c5c-8de1b483c551 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:11.978580 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-91129f85-a73d-4978-9c5c-8de1b483c551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:11.991591 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91129f85-a73d-4978-9c5c-8de1b483c551 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:11.996442 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14587e2-4e4f-4c65-941f-4ca639677f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:11.997357 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14587e2-4e4f-4c65-941f-4ca639677f45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:11.997648 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14587e2-4e4f-4c65-941f-4ca639677f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:11.997920 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14587e2-4e4f-4c65-941f-4ca639677f45 admin admin] PATH_INFO: `/v3/projects/b2d47beae76444a3a832c5135771d169` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:11.999675 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14587e2-4e4f-4c65-941f-4ca639677f45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2d47beae76444a3a832c5135771d169)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:12.001893 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14587e2-4e4f-4c65-941f-4ca639677f45 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:12.048836 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c14587e2-4e4f-4c65-941f-4ca639677f45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2d47beae76444a3a832c5135771d169', 'request_id': 'req-c14587e2-4e4f-4c65-941f-4ca639677f45'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:12.054885 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c14587e2-4e4f-4c65-941f-4ca639677f45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2d47beae76444a3a832c5135771d169', 'request_id': 'req-c14587e2-4e4f-4c65-941f-4ca639677f45'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:12.062183 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c14587e2-4e4f-4c65-941f-4ca639677f45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2d47beae76444a3a832c5135771d169', 'request_id': 'req-c14587e2-4e4f-4c65-941f-4ca639677f45'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:12.072953 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c14587e2-4e4f-4c65-941f-4ca639677f45 admin admin] The token cache is being invalidate because project b2d47beae76444a3a832c5135771d169 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:51:12.073288 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c14587e2-4e4f-4c65-941f-4ca639677f45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:12.074414 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c14587e2-4e4f-4c65-941f-4ca639677f45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:12.075949 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1198/2435] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:51:11 2022] DELETE /identity/v3/projects/b2d47beae76444a3a832c5135771d169 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:51:12.079951 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb9600-265c-4507-87d6-ccabefeaa12d service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:12.089404 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb9600-265c-4507-87d6-ccabefeaa12d service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:12.107816 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:51:12.146313 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a4984b-a867-4526-84eb-1d49907ad10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:12.147210 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4984b-a867-4526-84eb-1d49907ad10e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:12.147493 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4984b-a867-4526-84eb-1d49907ad10e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:12.147770 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4984b-a867-4526-84eb-1d49907ad10e admin admin] PATH_INFO: `/v3/users/776b1de861c8402b86281673b93b2a2b` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:12.148983 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a4984b-a867-4526-84eb-1d49907ad10e admin admin] RBAC: Authorizing `identity:delete_user(user_id=776b1de861c8402b86281673b93b2a2b)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:12.150934 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a4984b-a867-4526-84eb-1d49907ad10e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:12.195279 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-95a4984b-a867-4526-84eb-1d49907ad10e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '776b1de861c8402b86281673b93b2a2b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:12.195927 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-95a4984b-a867-4526-84eb-1d49907ad10e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '776b1de861c8402b86281673b93b2a2b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:12.196532 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-95a4984b-a867-4526-84eb-1d49907ad10e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '776b1de861c8402b86281673b93b2a2b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:12.203788 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-95a4984b-a867-4526-84eb-1d49907ad10e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '776b1de861c8402b86281673b93b2a2b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:12.211033 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-95a4984b-a867-4526-84eb-1d49907ad10e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '776b1de861c8402b86281673b93b2a2b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:12.228455 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1238/2436] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:51:12 2022] DELETE /identity/v3/users/776b1de861c8402b86281673b93b2a2b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:51:12.496538 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14587e2-4e4f-4c65-941f-4ca639677f45 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:12.498182 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c14587e2-4e4f-4c65-941f-4ca639677f45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:12.510874 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14587e2-4e4f-4c65-941f-4ca639677f45 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:12.568598 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf563da3-51d2-4973-98ab-cb871656df16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:12.569473 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf563da3-51d2-4973-98ab-cb871656df16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:12.569760 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf563da3-51d2-4973-98ab-cb871656df16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:12.570040 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf563da3-51d2-4973-98ab-cb871656df16 admin admin] PATH_INFO: `/v3/projects/1beab760fb2c4c7c8f48c9282bfff00e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:12.571260 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf563da3-51d2-4973-98ab-cb871656df16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1beab760fb2c4c7c8f48c9282bfff00e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:12.573247 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf563da3-51d2-4973-98ab-cb871656df16 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:12.581814 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:51:12.623414 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-bf563da3-51d2-4973-98ab-cb871656df16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1beab760fb2c4c7c8f48c9282bfff00e', 'request_id': 'req-bf563da3-51d2-4973-98ab-cb871656df16'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:12.629646 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-bf563da3-51d2-4973-98ab-cb871656df16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1beab760fb2c4c7c8f48c9282bfff00e', 'request_id': 'req-bf563da3-51d2-4973-98ab-cb871656df16'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:12.641889 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-bf563da3-51d2-4973-98ab-cb871656df16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1beab760fb2c4c7c8f48c9282bfff00e', 'request_id': 'req-bf563da3-51d2-4973-98ab-cb871656df16'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:12.652586 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-bf563da3-51d2-4973-98ab-cb871656df16 admin admin] The token cache is being invalidate because project 1beab760fb2c4c7c8f48c9282bfff00e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:51:12.652879 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-bf563da3-51d2-4973-98ab-cb871656df16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:12.653540 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-bf563da3-51d2-4973-98ab-cb871656df16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:12.655108 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1199/2437] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:51:12 2022] DELETE /identity/v3/projects/1beab760fb2c4c7c8f48c9282bfff00e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:51:12.660817 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56f000-00d3-40f9-8284-294a00dac9b7 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:12.661282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56f000-00d3-40f9-8284-294a00dac9b7 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:12.661393 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c56f000-00d3-40f9-8284-294a00dac9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:12.680127 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-4c56f000-00d3-40f9-8284-294a00dac9b7 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:51:12.681324 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4c56f000-00d3-40f9-8284-294a00dac9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:12.743569 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1239/2438] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:51:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:51:12.751834 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3779c35-f980-450d-a3a7-0c5e7d547519 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:12.752127 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3779c35-f980-450d-a3a7-0c5e7d547519 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:12.752411 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3779c35-f980-450d-a3a7-0c5e7d547519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:12.770232 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-e3779c35-f980-450d-a3a7-0c5e7d547519 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:51:12.771458 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e3779c35-f980-450d-a3a7-0c5e7d547519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:12.779642 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1200/2439] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:51:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:51:12.783913 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56f000-00d3-40f9-8284-294a00dac9b7 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:12.794289 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c56f000-00d3-40f9-8284-294a00dac9b7 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:12.798834 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6447dce3-9b26-4125-b740-51345666f35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:12.799480 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447dce3-9b26-4125-b740-51345666f35e admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:12.799760 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447dce3-9b26-4125-b740-51345666f35e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:12.800036 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447dce3-9b26-4125-b740-51345666f35e admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:12.800790 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6447dce3-9b26-4125-b740-51345666f35e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:51:12.801096 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6447dce3-9b26-4125-b740-51345666f35e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:12.802693 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6447dce3-9b26-4125-b740-51345666f35e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:12.814450 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1240/2440] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:51:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:51:12.818515 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3779c35-f980-450d-a3a7-0c5e7d547519 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:12.827533 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3779c35-f980-450d-a3a7-0c5e7d547519 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:12.832017 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276b6ca-8e40-4d4b-81ae-10fd2d37378e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:12.832690 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276b6ca-8e40-4d4b-81ae-10fd2d37378e admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:12.832971 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276b6ca-8e40-4d4b-81ae-10fd2d37378e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:12.833243 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276b6ca-8e40-4d4b-81ae-10fd2d37378e admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:12.833949 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0276b6ca-8e40-4d4b-81ae-10fd2d37378e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:12.835840 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0276b6ca-8e40-4d4b-81ae-10fd2d37378e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:12.860691 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1201/2441] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:51:12 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:51:12.864718 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6447dce3-9b26-4125-b740-51345666f35e admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:12.875382 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6447dce3-9b26-4125-b740-51345666f35e admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:12.900551 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:51:12.937780 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9878a078-477d-4033-999b-22a59b782b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:12.938446 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878a078-477d-4033-999b-22a59b782b7b admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:12.938756 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878a078-477d-4033-999b-22a59b782b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:12.939032 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9878a078-477d-4033-999b-22a59b782b7b admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:12.939715 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9878a078-477d-4033-999b-22a59b782b7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:12.941644 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9878a078-477d-4033-999b-22a59b782b7b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:12.962586 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1241/2442] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:51:12 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:51:12.967497 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276b6ca-8e40-4d4b-81ae-10fd2d37378e admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:12.977641 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276b6ca-8e40-4d4b-81ae-10fd2d37378e admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:12.982777 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe3dd0-dda7-4690-adb7-3c49924204af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:12.983437 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe3dd0-dda7-4690-adb7-3c49924204af admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:12.983723 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe3dd0-dda7-4690-adb7-3c49924204af admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:12.984002 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfe3dd0-dda7-4690-adb7-3c49924204af admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:12.984737 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe3dd0-dda7-4690-adb7-3c49924204af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:12.986338 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfe3dd0-dda7-4690-adb7-3c49924204af admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:12.997362 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1202/2443] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:51:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:51:13.001209 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9878a078-477d-4033-999b-22a59b782b7b admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:13.011160 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9878a078-477d-4033-999b-22a59b782b7b admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:13.015983 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd4332f-a4bb-4a7f-90a4-6cebc0ed06a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:13.016649 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4332f-a4bb-4a7f-90a4-6cebc0ed06a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:13.016935 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4332f-a4bb-4a7f-90a4-6cebc0ed06a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:13.017222 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd4332f-a4bb-4a7f-90a4-6cebc0ed06a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:13.017940 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd4332f-a4bb-4a7f-90a4-6cebc0ed06a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:13.019575 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd4332f-a4bb-4a7f-90a4-6cebc0ed06a5 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:13.029571 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1242/2444] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:51:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:51:13.033680 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe3dd0-dda7-4690-adb7-3c49924204af admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:13.044219 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfe3dd0-dda7-4690-adb7-3c49924204af admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:13.048847 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c1e6d-3139-41de-aa50-7098a780adc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:13.049732 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c1e6d-3139-41de-aa50-7098a780adc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:13.050016 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c1e6d-3139-41de-aa50-7098a780adc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:13.050295 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c1e6d-3139-41de-aa50-7098a780adc2 admin admin] PATH_INFO: `/v3/projects/efac5b86e80342469521d94187e990f4/users/60f0d7a093bb41a396dc7ae3eb80d03b/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:13.066780 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c1e6d-3139-41de-aa50-7098a780adc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efac5b86e80342469521d94187e990f4, user_id=60f0d7a093bb41a396dc7ae3eb80d03b, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:13.069478 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c1e6d-3139-41de-aa50-7098a780adc2 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:13.083834 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1203/2445] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:51:13 2022] PUT /identity/v3/projects/efac5b86e80342469521d94187e990f4/users/60f0d7a093bb41a396dc7ae3eb80d03b/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:51:13.095368 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599fb7a-1de1-4ba5-bfec-2c7d708b136d None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:13.095662 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599fb7a-1de1-4ba5-bfec-2c7d708b136d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:13.095946 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599fb7a-1de1-4ba5-bfec-2c7d708b136d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:13.122727 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-8599fb7a-1de1-4ba5-bfec-2c7d708b136d None None] MFA Rules not processed for user `60f0d7a093bb41a396dc7ae3eb80d03b`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:51:13.123949 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8599fb7a-1de1-4ba5-bfec-2c7d708b136d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:13.200664 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1243/2446] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:51:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:51:13.205074 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c1e6d-3139-41de-aa50-7098a780adc2 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:13.277735 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c1e6d-3139-41de-aa50-7098a780adc2 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:13.284181 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5512225-2b42-4170-aa3f-921f07cdbb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:13.284866 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5512225-2b42-4170-aa3f-921f07cdbb68 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:13.285166 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5512225-2b42-4170-aa3f-921f07cdbb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:13.285427 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5512225-2b42-4170-aa3f-921f07cdbb68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:13.286128 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5512225-2b42-4170-aa3f-921f07cdbb68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:13.288126 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5512225-2b42-4170-aa3f-921f07cdbb68 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:13.318184 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1204/2447] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:51:13 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:51:13.319745 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8599fb7a-1de1-4ba5-bfec-2c7d708b136d None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:13.331027 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8599fb7a-1de1-4ba5-bfec-2c7d708b136d None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:13.389775 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82854ec-220e-4f1b-b9ad-587f3cf01f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:13.390483 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82854ec-220e-4f1b-b9ad-587f3cf01f67 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:13.390771 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82854ec-220e-4f1b-b9ad-587f3cf01f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:13.391053 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82854ec-220e-4f1b-b9ad-587f3cf01f67 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:13.391788 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82854ec-220e-4f1b-b9ad-587f3cf01f67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:13.393749 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82854ec-220e-4f1b-b9ad-587f3cf01f67 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:13.417138 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1244/2448] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:51:13 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:51:13.419068 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5512225-2b42-4170-aa3f-921f07cdbb68 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:13.429692 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5512225-2b42-4170-aa3f-921f07cdbb68 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:13.434578 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a40ea-3920-4ff9-bc75-3a39a7ed7c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:13.435280 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a40ea-3920-4ff9-bc75-3a39a7ed7c54 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:13.435569 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a40ea-3920-4ff9-bc75-3a39a7ed7c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:13.435850 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a40ea-3920-4ff9-bc75-3a39a7ed7c54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:13.436579 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a40ea-3920-4ff9-bc75-3a39a7ed7c54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:13.438197 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a40ea-3920-4ff9-bc75-3a39a7ed7c54 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:13.449669 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1205/2449] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:51:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:51:13.453606 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82854ec-220e-4f1b-b9ad-587f3cf01f67 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:13.465891 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82854ec-220e-4f1b-b9ad-587f3cf01f67 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:13.470842 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310405bb-f385-4ea5-893d-677b7cbfe8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:13.471719 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310405bb-f385-4ea5-893d-677b7cbfe8e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:13.472007 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310405bb-f385-4ea5-893d-677b7cbfe8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:13.472282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310405bb-f385-4ea5-893d-677b7cbfe8e0 admin admin] PATH_INFO: `/v3/projects/d0f40a4212bd4f7cbea31a0bcc7cf9a7/users/46170cc63a574a99be8925bc2c7cfeea/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:13.486758 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310405bb-f385-4ea5-893d-677b7cbfe8e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0f40a4212bd4f7cbea31a0bcc7cf9a7, user_id=46170cc63a574a99be8925bc2c7cfeea, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:13.489386 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310405bb-f385-4ea5-893d-677b7cbfe8e0 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:13.501608 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1245/2450] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:51:13 2022] PUT /identity/v3/projects/d0f40a4212bd4f7cbea31a0bcc7cf9a7/users/46170cc63a574a99be8925bc2c7cfeea/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:51:13.505558 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a40ea-3920-4ff9-bc75-3a39a7ed7c54 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:13.516064 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a40ea-3920-4ff9-bc75-3a39a7ed7c54 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:13.519679 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:51:13.575774 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53580d5f-37e1-400b-963c-0d7b7ffee965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:13.576429 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53580d5f-37e1-400b-963c-0d7b7ffee965 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:13.576715 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53580d5f-37e1-400b-963c-0d7b7ffee965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:13.576995 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53580d5f-37e1-400b-963c-0d7b7ffee965 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:13.577722 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53580d5f-37e1-400b-963c-0d7b7ffee965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:13.579391 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53580d5f-37e1-400b-963c-0d7b7ffee965 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:13.588973 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1206/2451] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:51:13 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:51:13.593766 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310405bb-f385-4ea5-893d-677b7cbfe8e0 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:13.599283 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:51:13.605717 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310405bb-f385-4ea5-893d-677b7cbfe8e0 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:13.610640 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7bbbe-ba9d-41b0-be3e-c943c74093df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:13.611474 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7bbbe-ba9d-41b0-be3e-c943c74093df admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:13.611763 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7bbbe-ba9d-41b0-be3e-c943c74093df admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:13.612044 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f7bbbe-ba9d-41b0-be3e-c943c74093df admin admin] PATH_INFO: `/v3/projects/d0f40a4212bd4f7cbea31a0bcc7cf9a7/users/46170cc63a574a99be8925bc2c7cfeea/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:13.614101 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7bbbe-ba9d-41b0-be3e-c943c74093df admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0f40a4212bd4f7cbea31a0bcc7cf9a7, user_id=46170cc63a574a99be8925bc2c7cfeea, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:13.616790 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f7bbbe-ba9d-41b0-be3e-c943c74093df admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:13.627452 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1246/2452] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:51:13 2022] PUT /identity/v3/projects/d0f40a4212bd4f7cbea31a0bcc7cf9a7/users/46170cc63a574a99be8925bc2c7cfeea/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:51:13.641717 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812fa18-a64b-483e-9990-8e5e9ef4b5aa None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:13.642010 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812fa18-a64b-483e-9990-8e5e9ef4b5aa None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:13.642294 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8812fa18-a64b-483e-9990-8e5e9ef4b5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:13.669496 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-8812fa18-a64b-483e-9990-8e5e9ef4b5aa None None] MFA Rules not processed for user `46170cc63a574a99be8925bc2c7cfeea`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:51:13.670755 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8812fa18-a64b-483e-9990-8e5e9ef4b5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:13.737734 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1207/2453] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:51:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:51:13.748764 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7bbbe-ba9d-41b0-be3e-c943c74093df admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:13.750570 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-01f7bbbe-ba9d-41b0-be3e-c943c74093df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:13.809553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f7bbbe-ba9d-41b0-be3e-c943c74093df admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:13.813324 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7cf12-2b0e-4647-87b2-36bbff1472be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:13.813979 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7cf12-2b0e-4647-87b2-36bbff1472be service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:13.814268 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7cf12-2b0e-4647-87b2-36bbff1472be service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:13.814582 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7cf12-2b0e-4647-87b2-36bbff1472be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:13.824019 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de7cf12-2b0e-4647-87b2-36bbff1472be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:13.825988 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de7cf12-2b0e-4647-87b2-36bbff1472be service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:13.835563 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1247/2454] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:51:13 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:51:13.863596 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8812fa18-a64b-483e-9990-8e5e9ef4b5aa None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:13.926382 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8812fa18-a64b-483e-9990-8e5e9ef4b5aa None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:13.930934 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d7573-a430-47ce-b77c-298b92d7b850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:13.931808 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d7573-a430-47ce-b77c-298b92d7b850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:13.932087 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d7573-a430-47ce-b77c-298b92d7b850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:13.932358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508d7573-a430-47ce-b77c-298b92d7b850 admin admin] PATH_INFO: `/v3/users/60f0d7a093bb41a396dc7ae3eb80d03b` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:13.934066 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d7573-a430-47ce-b77c-298b92d7b850 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60f0d7a093bb41a396dc7ae3eb80d03b)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:13.936008 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508d7573-a430-47ce-b77c-298b92d7b850 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:13.969501 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:51:13.983932 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-508d7573-a430-47ce-b77c-298b92d7b850 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60f0d7a093bb41a396dc7ae3eb80d03b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:13.984594 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-508d7573-a430-47ce-b77c-298b92d7b850 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60f0d7a093bb41a396dc7ae3eb80d03b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:13.985211 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-508d7573-a430-47ce-b77c-298b92d7b850 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60f0d7a093bb41a396dc7ae3eb80d03b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:13.993376 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-508d7573-a430-47ce-b77c-298b92d7b850 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60f0d7a093bb41a396dc7ae3eb80d03b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:14.000903 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-508d7573-a430-47ce-b77c-298b92d7b850 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60f0d7a093bb41a396dc7ae3eb80d03b'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:14.018596 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1208/2455] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:51:13 2022] DELETE /identity/v3/users/60f0d7a093bb41a396dc7ae3eb80d03b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:51:14.023057 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f36b46-7f93-45e1-bb26-458d56e01066 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:14.023350 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f36b46-7f93-45e1-bb26-458d56e01066 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:14.023635 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f36b46-7f93-45e1-bb26-458d56e01066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:14.041200 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f8f36b46-7f93-45e1-bb26-458d56e01066 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:51:14.042403 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f8f36b46-7f93-45e1-bb26-458d56e01066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:14.100475 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1248/2456] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:51:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:51:14.110341 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d7573-a430-47ce-b77c-298b92d7b850 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:14.111770 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-508d7573-a430-47ce-b77c-298b92d7b850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:14.168213 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508d7573-a430-47ce-b77c-298b92d7b850 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:14.171800 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f5342a-1836-4189-b856-605636762d63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:14.172444 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5342a-1836-4189-b856-605636762d63 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:14.172724 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5342a-1836-4189-b856-605636762d63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:14.172997 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5342a-1836-4189-b856-605636762d63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:14.181833 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f5342a-1836-4189-b856-605636762d63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:14.183998 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f5342a-1836-4189-b856-605636762d63 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:14.194198 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1209/2457] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:51:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 03:51:14.463539 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f36b46-7f93-45e1-bb26-458d56e01066 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:14.465105 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f8f36b46-7f93-45e1-bb26-458d56e01066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:14.477176 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f36b46-7f93-45e1-bb26-458d56e01066 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:14.482555 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824aef6-510c-40bb-8fb5-85ed506d5976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:14.483430 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824aef6-510c-40bb-8fb5-85ed506d5976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:14.483713 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824aef6-510c-40bb-8fb5-85ed506d5976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:14.483993 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824aef6-510c-40bb-8fb5-85ed506d5976 admin admin] PATH_INFO: `/v3/projects/efac5b86e80342469521d94187e990f4` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:14.485185 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824aef6-510c-40bb-8fb5-85ed506d5976 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efac5b86e80342469521d94187e990f4)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:14.487160 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824aef6-510c-40bb-8fb5-85ed506d5976 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:14.533473 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f824aef6-510c-40bb-8fb5-85ed506d5976 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efac5b86e80342469521d94187e990f4', 'request_id': 'req-f824aef6-510c-40bb-8fb5-85ed506d5976'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:14.541583 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f824aef6-510c-40bb-8fb5-85ed506d5976 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efac5b86e80342469521d94187e990f4', 'request_id': 'req-f824aef6-510c-40bb-8fb5-85ed506d5976'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:14.549867 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f824aef6-510c-40bb-8fb5-85ed506d5976 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efac5b86e80342469521d94187e990f4', 'request_id': 'req-f824aef6-510c-40bb-8fb5-85ed506d5976'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:14.561388 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f824aef6-510c-40bb-8fb5-85ed506d5976 admin admin] The token cache is being invalidate because project efac5b86e80342469521d94187e990f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:51:14.561681 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f824aef6-510c-40bb-8fb5-85ed506d5976 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:14.562314 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-f824aef6-510c-40bb-8fb5-85ed506d5976 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:14.563906 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1249/2458] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:51:14 2022] DELETE /identity/v3/projects/efac5b86e80342469521d94187e990f4 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:51:14.568005 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f5342a-1836-4189-b856-605636762d63 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:14.577960 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f5342a-1836-4189-b856-605636762d63 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:14.632962 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccd6546-bb49-4fcd-8a67-e8d744ae4f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:14.633856 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd6546-bb49-4fcd-8a67-e8d744ae4f05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:14.634143 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd6546-bb49-4fcd-8a67-e8d744ae4f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:14.634421 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccd6546-bb49-4fcd-8a67-e8d744ae4f05 admin admin] PATH_INFO: `/v3/users/46170cc63a574a99be8925bc2c7cfeea` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:14.635650 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd6546-bb49-4fcd-8a67-e8d744ae4f05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46170cc63a574a99be8925bc2c7cfeea)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:14.637617 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccd6546-bb49-4fcd-8a67-e8d744ae4f05 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:14.682206 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5ccd6546-bb49-4fcd-8a67-e8d744ae4f05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46170cc63a574a99be8925bc2c7cfeea'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:14.682772 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5ccd6546-bb49-4fcd-8a67-e8d744ae4f05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46170cc63a574a99be8925bc2c7cfeea'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:14.683420 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5ccd6546-bb49-4fcd-8a67-e8d744ae4f05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46170cc63a574a99be8925bc2c7cfeea'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:14.687815 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:51:14.691312 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5ccd6546-bb49-4fcd-8a67-e8d744ae4f05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46170cc63a574a99be8925bc2c7cfeea'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:14.699032 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5ccd6546-bb49-4fcd-8a67-e8d744ae4f05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46170cc63a574a99be8925bc2c7cfeea'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:14.716807 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1210/2459] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:51:14 2022] DELETE /identity/v3/users/46170cc63a574a99be8925bc2c7cfeea => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:51:14.983288 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824aef6-510c-40bb-8fb5-85ed506d5976 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:14.986230 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f824aef6-510c-40bb-8fb5-85ed506d5976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:15.002083 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824aef6-510c-40bb-8fb5-85ed506d5976 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:15.015125 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:51:15.063655 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa7205b-9e0b-4eca-bd6f-8da66205c583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:15.064654 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7205b-9e0b-4eca-bd6f-8da66205c583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:15.065052 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7205b-9e0b-4eca-bd6f-8da66205c583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:15.065389 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa7205b-9e0b-4eca-bd6f-8da66205c583 admin admin] PATH_INFO: `/v3/projects/d0f40a4212bd4f7cbea31a0bcc7cf9a7` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:15.066606 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa7205b-9e0b-4eca-bd6f-8da66205c583 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0f40a4212bd4f7cbea31a0bcc7cf9a7)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:15.068515 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa7205b-9e0b-4eca-bd6f-8da66205c583 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:15.116293 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-8fa7205b-9e0b-4eca-bd6f-8da66205c583 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0f40a4212bd4f7cbea31a0bcc7cf9a7', 'request_id': 'req-8fa7205b-9e0b-4eca-bd6f-8da66205c583'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:15.122696 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-8fa7205b-9e0b-4eca-bd6f-8da66205c583 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0f40a4212bd4f7cbea31a0bcc7cf9a7', 'request_id': 'req-8fa7205b-9e0b-4eca-bd6f-8da66205c583'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:15.134229 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-8fa7205b-9e0b-4eca-bd6f-8da66205c583 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0f40a4212bd4f7cbea31a0bcc7cf9a7', 'request_id': 'req-8fa7205b-9e0b-4eca-bd6f-8da66205c583'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:15.145912 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-8fa7205b-9e0b-4eca-bd6f-8da66205c583 admin admin] The token cache is being invalidate because project d0f40a4212bd4f7cbea31a0bcc7cf9a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:51:15.146440 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-8fa7205b-9e0b-4eca-bd6f-8da66205c583 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:15.147139 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-8fa7205b-9e0b-4eca-bd6f-8da66205c583 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:15.148750 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1250/2460] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:51:14 2022] DELETE /identity/v3/projects/d0f40a4212bd4f7cbea31a0bcc7cf9a7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:51:15.154199 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf122c-702c-43c8-add7-ddb81264f9ce None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:15.154521 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf122c-702c-43c8-add7-ddb81264f9ce None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:15.154856 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf122c-702c-43c8-add7-ddb81264f9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:15.173197 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-1eaf122c-702c-43c8-add7-ddb81264f9ce None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:51:15.174448 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1eaf122c-702c-43c8-add7-ddb81264f9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:15.242057 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1211/2461] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:51:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:51:15.249772 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27fd4b-a2c4-4aa1-b453-8561cde023fc None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:15.250066 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27fd4b-a2c4-4aa1-b453-8561cde023fc None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:15.250348 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27fd4b-a2c4-4aa1-b453-8561cde023fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:15.269381 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-6d27fd4b-a2c4-4aa1-b453-8561cde023fc None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:51:15.270620 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6d27fd4b-a2c4-4aa1-b453-8561cde023fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:15.279226 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1251/2462] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:51:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:51:15.283461 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf122c-702c-43c8-add7-ddb81264f9ce None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:15.295364 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf122c-702c-43c8-add7-ddb81264f9ce None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:15.300106 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3b8ad-d21f-449d-ac63-e21404ac2739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:15.300776 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3b8ad-d21f-449d-ac63-e21404ac2739 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:15.301062 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3b8ad-d21f-449d-ac63-e21404ac2739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:15.301390 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3b8ad-d21f-449d-ac63-e21404ac2739 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:15.302336 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a3b8ad-d21f-449d-ac63-e21404ac2739 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:51:15.302478 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a3b8ad-d21f-449d-ac63-e21404ac2739 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:15.304395 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a3b8ad-d21f-449d-ac63-e21404ac2739 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:15.318058 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1212/2463] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:51:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:51:15.322228 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27fd4b-a2c4-4aa1-b453-8561cde023fc None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:15.333074 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d27fd4b-a2c4-4aa1-b453-8561cde023fc None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:15.338088 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9dcd2-a612-41a5-b275-ca7b55f2ac9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:15.338809 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9dcd2-a612-41a5-b275-ca7b55f2ac9c admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:15.339106 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9dcd2-a612-41a5-b275-ca7b55f2ac9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:15.339629 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9dcd2-a612-41a5-b275-ca7b55f2ac9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:15.340151 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea9dcd2-a612-41a5-b275-ca7b55f2ac9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:15.342123 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea9dcd2-a612-41a5-b275-ca7b55f2ac9c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:15.367810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1252/2464] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:51:15 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:51:15.372563 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3b8ad-d21f-449d-ac63-e21404ac2739 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:15.383021 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3b8ad-d21f-449d-ac63-e21404ac2739 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:15.441205 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2cf4b3-340f-43e5-8b47-4fb3a6b1dafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:15.441877 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2cf4b3-340f-43e5-8b47-4fb3a6b1dafe admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:15.442166 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2cf4b3-340f-43e5-8b47-4fb3a6b1dafe admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:15.442451 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2cf4b3-340f-43e5-8b47-4fb3a6b1dafe admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:15.443236 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2cf4b3-340f-43e5-8b47-4fb3a6b1dafe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:15.445176 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2cf4b3-340f-43e5-8b47-4fb3a6b1dafe admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:15.467968 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1213/2465] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:51:15 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:51:15.472289 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9dcd2-a612-41a5-b275-ca7b55f2ac9c admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:15.482870 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9dcd2-a612-41a5-b275-ca7b55f2ac9c admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:15.487445 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c966e9-49a2-4ca4-90dc-f9caebfd2458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:15.488104 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c966e9-49a2-4ca4-90dc-f9caebfd2458 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:15.488386 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c966e9-49a2-4ca4-90dc-f9caebfd2458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:15.488668 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c966e9-49a2-4ca4-90dc-f9caebfd2458 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:15.489425 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c966e9-49a2-4ca4-90dc-f9caebfd2458 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:15.491041 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c966e9-49a2-4ca4-90dc-f9caebfd2458 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:15.502999 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1253/2466] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 03:51:15.506990 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2cf4b3-340f-43e5-8b47-4fb3a6b1dafe admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:15.518286 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2cf4b3-340f-43e5-8b47-4fb3a6b1dafe admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:15.522937 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa99a357-f219-4caf-81ef-8e230534dba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:15.524223 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99a357-f219-4caf-81ef-8e230534dba6 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:15.524542 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99a357-f219-4caf-81ef-8e230534dba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:15.524820 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa99a357-f219-4caf-81ef-8e230534dba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:15.525547 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa99a357-f219-4caf-81ef-8e230534dba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:15.527213 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa99a357-f219-4caf-81ef-8e230534dba6 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:15.538191 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1214/2467] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:51:15.542714 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c966e9-49a2-4ca4-90dc-f9caebfd2458 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:15.553054 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c966e9-49a2-4ca4-90dc-f9caebfd2458 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:15.557771 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46487984-17ea-403d-afca-ccfa29dec762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:15.559226 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46487984-17ea-403d-afca-ccfa29dec762 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:15.559536 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46487984-17ea-403d-afca-ccfa29dec762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:15.559818 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46487984-17ea-403d-afca-ccfa29dec762 admin admin] PATH_INFO: `/v3/projects/a02541355a644dada4127568700a3e7b/users/564c8f3134ea4569bf686ab334275c38/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:15.575958 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46487984-17ea-403d-afca-ccfa29dec762 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a02541355a644dada4127568700a3e7b, user_id=564c8f3134ea4569bf686ab334275c38, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:15.578640 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46487984-17ea-403d-afca-ccfa29dec762 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:15.591912 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1254/2468] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:51:15 2022] PUT /identity/v3/projects/a02541355a644dada4127568700a3e7b/users/564c8f3134ea4569bf686ab334275c38/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:51:15.656803 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a1925-8d05-4ccb-bfaf-0e2468cb29a9 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:15.657344 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a1925-8d05-4ccb-bfaf-0e2468cb29a9 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:15.657439 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a1925-8d05-4ccb-bfaf-0e2468cb29a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:15.685772 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-266a1925-8d05-4ccb-bfaf-0e2468cb29a9 None None] MFA Rules not processed for user `564c8f3134ea4569bf686ab334275c38`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:51:15.686680 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-266a1925-8d05-4ccb-bfaf-0e2468cb29a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:15.720430 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:51:15.764161 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1215/2469] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:51:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:51:15.768861 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46487984-17ea-403d-afca-ccfa29dec762 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:15.814699 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:51:15.835906 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46487984-17ea-403d-afca-ccfa29dec762 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:15.841616 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb36227-3aab-4eea-8b8e-425c72838c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:15.842394 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb36227-3aab-4eea-8b8e-425c72838c9e admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:15.842722 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb36227-3aab-4eea-8b8e-425c72838c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:15.843011 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb36227-3aab-4eea-8b8e-425c72838c9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:15.843724 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb36227-3aab-4eea-8b8e-425c72838c9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:15.845638 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb36227-3aab-4eea-8b8e-425c72838c9e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:15.874105 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1255/2470] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:51:15 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:51:15.876145 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a1925-8d05-4ccb-bfaf-0e2468cb29a9 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:15.887473 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266a1925-8d05-4ccb-bfaf-0e2468cb29a9 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:15.945128 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7763daf-7f5b-4f60-96c0-6933eb2c3ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:15.945814 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7763daf-7f5b-4f60-96c0-6933eb2c3ff9 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:15.946107 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7763daf-7f5b-4f60-96c0-6933eb2c3ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:15.946391 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7763daf-7f5b-4f60-96c0-6933eb2c3ff9 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:15.947167 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7763daf-7f5b-4f60-96c0-6933eb2c3ff9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:15.949662 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7763daf-7f5b-4f60-96c0-6933eb2c3ff9 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:15.970445 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1216/2471] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:51:15 2022] POST /identity/v3/users => generated 297 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:51:15.974596 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb36227-3aab-4eea-8b8e-425c72838c9e admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:15.985019 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb36227-3aab-4eea-8b8e-425c72838c9e admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:15.989765 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9348c0-08d6-4fef-ab09-34e2b23abacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:15.990471 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9348c0-08d6-4fef-ab09-34e2b23abacc admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:15.990855 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9348c0-08d6-4fef-ab09-34e2b23abacc admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:15.991204 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9348c0-08d6-4fef-ab09-34e2b23abacc admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:15.992005 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9348c0-08d6-4fef-ab09-34e2b23abacc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:15.993773 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9348c0-08d6-4fef-ab09-34e2b23abacc admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:16.005909 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1256/2472] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 03:51:16.010333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7763daf-7f5b-4f60-96c0-6933eb2c3ff9 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:16.020883 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7763daf-7f5b-4f60-96c0-6933eb2c3ff9 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:16.026297 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c18571-ddf4-402d-a2f5-878ec5ca31e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:16.027772 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c18571-ddf4-402d-a2f5-878ec5ca31e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:16.028060 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c18571-ddf4-402d-a2f5-878ec5ca31e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:16.028334 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c18571-ddf4-402d-a2f5-878ec5ca31e8 admin admin] PATH_INFO: `/v3/projects/7d55a5dab4c44a98a661db8f6e0e58bd/users/0d8d14788b07417181cab426f60e356b/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:16.044036 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c18571-ddf4-402d-a2f5-878ec5ca31e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d55a5dab4c44a98a661db8f6e0e58bd, user_id=0d8d14788b07417181cab426f60e356b, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:16.046769 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c18571-ddf4-402d-a2f5-878ec5ca31e8 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:16.061406 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1217/2473] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:51:16 2022] PUT /identity/v3/projects/7d55a5dab4c44a98a661db8f6e0e58bd/users/0d8d14788b07417181cab426f60e356b/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:51:16.065341 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9348c0-08d6-4fef-ab09-34e2b23abacc admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:16.075952 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9348c0-08d6-4fef-ab09-34e2b23abacc admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:16.134687 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc12655-5227-4906-ab1f-b8e3a31c5cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:16.135368 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc12655-5227-4906-ab1f-b8e3a31c5cab admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:16.135689 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc12655-5227-4906-ab1f-b8e3a31c5cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:16.135934 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc12655-5227-4906-ab1f-b8e3a31c5cab admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:16.137227 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc12655-5227-4906-ab1f-b8e3a31c5cab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:16.138875 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc12655-5227-4906-ab1f-b8e3a31c5cab admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:16.150731 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1257/2474] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 03:51:16.155733 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c18571-ddf4-402d-a2f5-878ec5ca31e8 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:16.167017 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c18571-ddf4-402d-a2f5-878ec5ca31e8 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:16.173510 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9d5f5-4986-4fbf-ace7-242858a34c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:16.174432 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9d5f5-4986-4fbf-ace7-242858a34c22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:16.174746 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9d5f5-4986-4fbf-ace7-242858a34c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:16.175029 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9d5f5-4986-4fbf-ace7-242858a34c22 admin admin] PATH_INFO: `/v3/projects/7d55a5dab4c44a98a661db8f6e0e58bd/users/0d8d14788b07417181cab426f60e356b/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:16.177077 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc9d5f5-4986-4fbf-ace7-242858a34c22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d55a5dab4c44a98a661db8f6e0e58bd, user_id=0d8d14788b07417181cab426f60e356b, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:16.179919 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc9d5f5-4986-4fbf-ace7-242858a34c22 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:16.192346 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1218/2475] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:51:16 2022] PUT /identity/v3/projects/7d55a5dab4c44a98a661db8f6e0e58bd/users/0d8d14788b07417181cab426f60e356b/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:51:16.204823 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b2818-e667-479f-abd4-9cb47107c4f6 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:16.205211 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b2818-e667-479f-abd4-9cb47107c4f6 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:16.206259 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b2818-e667-479f-abd4-9cb47107c4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:16.238822 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-bc7b2818-e667-479f-abd4-9cb47107c4f6 None None] MFA Rules not processed for user `0d8d14788b07417181cab426f60e356b`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:51:16.240341 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-bc7b2818-e667-479f-abd4-9cb47107c4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:16.322261 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1258/2476] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:51:16 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:51:16.330932 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9d5f5-4986-4fbf-ace7-242858a34c22 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:16.332701 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fcc9d5f5-4986-4fbf-ace7-242858a34c22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:16.395750 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9d5f5-4986-4fbf-ace7-242858a34c22 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:16.400868 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76213973-9b92-4f64-aa1e-d87081872fd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:16.400868 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76213973-9b92-4f64-aa1e-d87081872fd4 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:16.400868 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76213973-9b92-4f64-aa1e-d87081872fd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:16.401184 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76213973-9b92-4f64-aa1e-d87081872fd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:16.411727 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76213973-9b92-4f64-aa1e-d87081872fd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:16.413375 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76213973-9b92-4f64-aa1e-d87081872fd4 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:16.424991 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1219/2477] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:51:16 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 03:51:16.532367 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b2818-e667-479f-abd4-9cb47107c4f6 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:16.544826 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b2818-e667-479f-abd4-9cb47107c4f6 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:16.548713 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8909eed-ac69-48d4-8c6f-9114e25f4a77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:16.549399 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8909eed-ac69-48d4-8c6f-9114e25f4a77 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:16.549691 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8909eed-ac69-48d4-8c6f-9114e25f4a77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:16.549974 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8909eed-ac69-48d4-8c6f-9114e25f4a77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:16.587044 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:51:16.618278 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8909eed-ac69-48d4-8c6f-9114e25f4a77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:16.619863 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8909eed-ac69-48d4-8c6f-9114e25f4a77 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:16.630008 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1259/2478] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:51:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:51:18.131536 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76213973-9b92-4f64-aa1e-d87081872fd4 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:18.133009 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-76213973-9b92-4f64-aa1e-d87081872fd4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:18.157178 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:51:18.197176 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76213973-9b92-4f64-aa1e-d87081872fd4 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:18.201580 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f45d7-cf9e-4c13-80a5-022701f4d56e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:18.202234 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f45d7-cf9e-4c13-80a5-022701f4d56e service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:18.202548 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f45d7-cf9e-4c13-80a5-022701f4d56e service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:18.202827 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f45d7-cf9e-4c13-80a5-022701f4d56e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:18.204665 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a82f45d7-cf9e-4c13-80a5-022701f4d56e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:18.265856 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82f45d7-cf9e-4c13-80a5-022701f4d56e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:18.267298 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82f45d7-cf9e-4c13-80a5-022701f4d56e service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:18.276444 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1220/2479] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:51:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 03:51:19.255684 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8909eed-ac69-48d4-8c6f-9114e25f4a77 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:19.328329 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8909eed-ac69-48d4-8c6f-9114e25f4a77 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:19.333254 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f469d7-c974-42fa-802d-789e04ea9db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:19.334237 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f469d7-c974-42fa-802d-789e04ea9db7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:19.334642 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f469d7-c974-42fa-802d-789e04ea9db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:19.335104 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f469d7-c974-42fa-802d-789e04ea9db7 admin admin] PATH_INFO: `/v3/users/564c8f3134ea4569bf686ab334275c38` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:19.337305 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f469d7-c974-42fa-802d-789e04ea9db7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=564c8f3134ea4569bf686ab334275c38)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:19.338672 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f469d7-c974-42fa-802d-789e04ea9db7 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:19.396422 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b0f469d7-c974-42fa-802d-789e04ea9db7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '564c8f3134ea4569bf686ab334275c38'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:19.397329 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b0f469d7-c974-42fa-802d-789e04ea9db7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '564c8f3134ea4569bf686ab334275c38'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:19.398037 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b0f469d7-c974-42fa-802d-789e04ea9db7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '564c8f3134ea4569bf686ab334275c38'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:19.407805 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b0f469d7-c974-42fa-802d-789e04ea9db7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '564c8f3134ea4569bf686ab334275c38'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:19.418130 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b0f469d7-c974-42fa-802d-789e04ea9db7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '564c8f3134ea4569bf686ab334275c38'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:19.441207 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1260/2480] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:51:19 2022] DELETE /identity/v3/users/564c8f3134ea4569bf686ab334275c38 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:51:19.445620 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea2b6b-f276-4f72-8658-919d9b380ad1 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:19.446090 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea2b6b-f276-4f72-8658-919d9b380ad1 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:19.446188 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea2b6b-f276-4f72-8658-919d9b380ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:19.463735 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-e6ea2b6b-f276-4f72-8658-919d9b380ad1 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:51:19.465685 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e6ea2b6b-f276-4f72-8658-919d9b380ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:19.525840 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1221/2481] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:51:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:51:19.536474 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f469d7-c974-42fa-802d-789e04ea9db7 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:19.538180 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b0f469d7-c974-42fa-802d-789e04ea9db7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:19.596411 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f469d7-c974-42fa-802d-789e04ea9db7 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:19.600240 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da90cc3-f4e7-4f4d-a2cf-18f7b44dfcb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:19.600893 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da90cc3-f4e7-4f4d-a2cf-18f7b44dfcb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:19.601175 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da90cc3-f4e7-4f4d-a2cf-18f7b44dfcb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:19.601451 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da90cc3-f4e7-4f4d-a2cf-18f7b44dfcb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:19.610700 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da90cc3-f4e7-4f4d-a2cf-18f7b44dfcb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:19.612166 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da90cc3-f4e7-4f4d-a2cf-18f7b44dfcb7 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:19.616068 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:51:19.630395 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1261/2482] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:51:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:51:19.910286 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea2b6b-f276-4f72-8658-919d9b380ad1 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:19.911870 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e6ea2b6b-f276-4f72-8658-919d9b380ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:19.927178 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea2b6b-f276-4f72-8658-919d9b380ad1 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:19.932226 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9434cc14-f9df-48c8-9b4d-49bf39a869de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:19.933779 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434cc14-f9df-48c8-9b4d-49bf39a869de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:19.934855 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434cc14-f9df-48c8-9b4d-49bf39a869de admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:19.936126 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9434cc14-f9df-48c8-9b4d-49bf39a869de admin admin] PATH_INFO: `/v3/projects/a02541355a644dada4127568700a3e7b` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:19.937431 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9434cc14-f9df-48c8-9b4d-49bf39a869de admin admin] RBAC: Authorizing `identity:delete_project(project_id=a02541355a644dada4127568700a3e7b)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:19.939758 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9434cc14-f9df-48c8-9b4d-49bf39a869de admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:19.989744 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9434cc14-f9df-48c8-9b4d-49bf39a869de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a02541355a644dada4127568700a3e7b', 'request_id': 'req-9434cc14-f9df-48c8-9b4d-49bf39a869de'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:19.997095 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9434cc14-f9df-48c8-9b4d-49bf39a869de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a02541355a644dada4127568700a3e7b', 'request_id': 'req-9434cc14-f9df-48c8-9b4d-49bf39a869de'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:20.007225 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9434cc14-f9df-48c8-9b4d-49bf39a869de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a02541355a644dada4127568700a3e7b', 'request_id': 'req-9434cc14-f9df-48c8-9b4d-49bf39a869de'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:20.014542 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:51:20.023087 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9434cc14-f9df-48c8-9b4d-49bf39a869de admin admin] The token cache is being invalidate because project a02541355a644dada4127568700a3e7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:51:20.024210 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9434cc14-f9df-48c8-9b4d-49bf39a869de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:20.025707 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9434cc14-f9df-48c8-9b4d-49bf39a869de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:20.027427 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1222/2483] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:51:19 2022] DELETE /identity/v3/projects/a02541355a644dada4127568700a3e7b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:51:20.031389 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da90cc3-f4e7-4f4d-a2cf-18f7b44dfcb7 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:20.041779 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da90cc3-f4e7-4f4d-a2cf-18f7b44dfcb7 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:20.099886 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1df006-cd0d-4e2c-a150-de0bcdf2c5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:20.100807 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1df006-cd0d-4e2c-a150-de0bcdf2c5c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:20.101091 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1df006-cd0d-4e2c-a150-de0bcdf2c5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:20.101365 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1df006-cd0d-4e2c-a150-de0bcdf2c5c1 admin admin] PATH_INFO: `/v3/users/0d8d14788b07417181cab426f60e356b` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:20.102617 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1df006-cd0d-4e2c-a150-de0bcdf2c5c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d8d14788b07417181cab426f60e356b)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:20.104559 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1df006-cd0d-4e2c-a150-de0bcdf2c5c1 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:20.153565 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-da1df006-cd0d-4e2c-a150-de0bcdf2c5c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d8d14788b07417181cab426f60e356b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:20.154219 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-da1df006-cd0d-4e2c-a150-de0bcdf2c5c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d8d14788b07417181cab426f60e356b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:20.154840 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-da1df006-cd0d-4e2c-a150-de0bcdf2c5c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d8d14788b07417181cab426f60e356b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:20.162138 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-da1df006-cd0d-4e2c-a150-de0bcdf2c5c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d8d14788b07417181cab426f60e356b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:20.170362 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-da1df006-cd0d-4e2c-a150-de0bcdf2c5c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d8d14788b07417181cab426f60e356b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:20.188910 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1262/2484] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:51:20 2022] DELETE /identity/v3/users/0d8d14788b07417181cab426f60e356b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:51:20.458318 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9434cc14-f9df-48c8-9b4d-49bf39a869de admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:20.459815 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9434cc14-f9df-48c8-9b4d-49bf39a869de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:20.473394 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9434cc14-f9df-48c8-9b4d-49bf39a869de admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:20.563262 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719a891-3f39-4996-a8e0-fd555c484488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:20.564473 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719a891-3f39-4996-a8e0-fd555c484488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:20.564964 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719a891-3f39-4996-a8e0-fd555c484488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:20.565430 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719a891-3f39-4996-a8e0-fd555c484488 admin admin] PATH_INFO: `/v3/projects/7d55a5dab4c44a98a661db8f6e0e58bd` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:20.567911 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4719a891-3f39-4996-a8e0-fd555c484488 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d55a5dab4c44a98a661db8f6e0e58bd)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:20.570098 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4719a891-3f39-4996-a8e0-fd555c484488 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:20.624221 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4719a891-3f39-4996-a8e0-fd555c484488 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d55a5dab4c44a98a661db8f6e0e58bd', 'request_id': 'req-4719a891-3f39-4996-a8e0-fd555c484488'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:20.630765 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4719a891-3f39-4996-a8e0-fd555c484488 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d55a5dab4c44a98a661db8f6e0e58bd', 'request_id': 'req-4719a891-3f39-4996-a8e0-fd555c484488'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:20.638860 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4719a891-3f39-4996-a8e0-fd555c484488 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d55a5dab4c44a98a661db8f6e0e58bd', 'request_id': 'req-4719a891-3f39-4996-a8e0-fd555c484488'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:20.649593 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4719a891-3f39-4996-a8e0-fd555c484488 admin admin] The token cache is being invalidate because project 7d55a5dab4c44a98a661db8f6e0e58bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:51:20.649867 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4719a891-3f39-4996-a8e0-fd555c484488 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:20.650539 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4719a891-3f39-4996-a8e0-fd555c484488 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:20.652660 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1223/2485] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:51:20 2022] DELETE /identity/v3/projects/7d55a5dab4c44a98a661db8f6e0e58bd => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:51:20.657449 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307358e0-aa20-4f92-b65b-7b68a103edba None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:20.657929 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307358e0-aa20-4f92-b65b-7b68a103edba None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:20.658020 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307358e0-aa20-4f92-b65b-7b68a103edba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:20.676843 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-307358e0-aa20-4f92-b65b-7b68a103edba None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:51:20.678123 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-307358e0-aa20-4f92-b65b-7b68a103edba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:20.744506 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1263/2486] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:51:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:51:20.752569 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ace3a-a9f1-44f0-bfbf-54b6cd24b531 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:20.752895 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ace3a-a9f1-44f0-bfbf-54b6cd24b531 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:20.753181 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4ace3a-a9f1-44f0-bfbf-54b6cd24b531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:20.772417 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-1b4ace3a-a9f1-44f0-bfbf-54b6cd24b531 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:51:20.773555 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1b4ace3a-a9f1-44f0-bfbf-54b6cd24b531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:20.782358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1224/2487] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:51:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:51:20.786877 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307358e0-aa20-4f92-b65b-7b68a103edba None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:20.797115 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307358e0-aa20-4f92-b65b-7b68a103edba None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:20.801772 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768b730-b7a8-4985-9463-5d1fca2f45f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:20.802431 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768b730-b7a8-4985-9463-5d1fca2f45f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:20.802753 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768b730-b7a8-4985-9463-5d1fca2f45f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:20.803033 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768b730-b7a8-4985-9463-5d1fca2f45f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:20.803770 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d768b730-b7a8-4985-9463-5d1fca2f45f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:51:20.804084 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d768b730-b7a8-4985-9463-5d1fca2f45f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:20.805691 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d768b730-b7a8-4985-9463-5d1fca2f45f6 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:20.817774 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1264/2488] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:51:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:51:20.822057 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ace3a-a9f1-44f0-bfbf-54b6cd24b531 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:20.831283 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4ace3a-a9f1-44f0-bfbf-54b6cd24b531 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:20.835939 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18f648-abc8-480c-8e22-6a74187fa0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:20.836598 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18f648-abc8-480c-8e22-6a74187fa0a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:20.836880 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18f648-abc8-480c-8e22-6a74187fa0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:20.837155 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18f648-abc8-480c-8e22-6a74187fa0a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:20.837849 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18f648-abc8-480c-8e22-6a74187fa0a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:20.840267 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18f648-abc8-480c-8e22-6a74187fa0a4 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:20.865863 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1225/2489] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:51:20 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:51:20.870040 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768b730-b7a8-4985-9463-5d1fca2f45f6 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:20.876618 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:51:20.880714 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768b730-b7a8-4985-9463-5d1fca2f45f6 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:20.939753 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21465eb7-d8a1-4ad7-88e4-21f01dc7b631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:20.940425 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21465eb7-d8a1-4ad7-88e4-21f01dc7b631 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:20.940714 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21465eb7-d8a1-4ad7-88e4-21f01dc7b631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:20.940993 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21465eb7-d8a1-4ad7-88e4-21f01dc7b631 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:20.941687 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21465eb7-d8a1-4ad7-88e4-21f01dc7b631 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:20.943662 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21465eb7-d8a1-4ad7-88e4-21f01dc7b631 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:20.968920 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1265/2490] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:51:20 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:51:20.970318 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18f648-abc8-480c-8e22-6a74187fa0a4 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:20.981044 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18f648-abc8-480c-8e22-6a74187fa0a4 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:20.985740 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad5897d-3fde-49c3-9eb9-563d50cf6dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:20.986403 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5897d-3fde-49c3-9eb9-563d50cf6dfb admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:20.986733 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5897d-3fde-49c3-9eb9-563d50cf6dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:20.986994 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad5897d-3fde-49c3-9eb9-563d50cf6dfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:20.987875 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad5897d-3fde-49c3-9eb9-563d50cf6dfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:20.989479 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad5897d-3fde-49c3-9eb9-563d50cf6dfb admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:20.999889 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1226/2491] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:51:21.003777 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21465eb7-d8a1-4ad7-88e4-21f01dc7b631 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:21.014864 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21465eb7-d8a1-4ad7-88e4-21f01dc7b631 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:21.019489 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1760cbc-7068-4ff5-8834-e70962902d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:21.020140 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1760cbc-7068-4ff5-8834-e70962902d6a admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:21.020429 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1760cbc-7068-4ff5-8834-e70962902d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:21.020795 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1760cbc-7068-4ff5-8834-e70962902d6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:21.021522 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1760cbc-7068-4ff5-8834-e70962902d6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:21.023211 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1760cbc-7068-4ff5-8834-e70962902d6a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:21.036431 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1266/2492] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:51:21.040211 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad5897d-3fde-49c3-9eb9-563d50cf6dfb admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:21.050491 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad5897d-3fde-49c3-9eb9-563d50cf6dfb admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:21.055242 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484ad68-653f-4d6f-8491-9d0108eeb0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:21.056136 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484ad68-653f-4d6f-8491-9d0108eeb0a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:21.056425 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484ad68-653f-4d6f-8491-9d0108eeb0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:21.056853 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6484ad68-653f-4d6f-8491-9d0108eeb0a8 admin admin] PATH_INFO: `/v3/projects/d25a2dfe7b9542278056127a2f55f1b0/users/ea5e2fa0c9b149a5beac56bf17d4473e/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:21.074785 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6484ad68-653f-4d6f-8491-9d0108eeb0a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d25a2dfe7b9542278056127a2f55f1b0, user_id=ea5e2fa0c9b149a5beac56bf17d4473e, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:21.077499 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6484ad68-653f-4d6f-8491-9d0108eeb0a8 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:21.091237 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1227/2493] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:51:21 2022] PUT /identity/v3/projects/d25a2dfe7b9542278056127a2f55f1b0/users/ea5e2fa0c9b149a5beac56bf17d4473e/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:51:21.096267 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56edae64-34c3-429e-bdfa-9a352c27563c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:21.096556 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56edae64-34c3-429e-bdfa-9a352c27563c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:21.096833 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56edae64-34c3-429e-bdfa-9a352c27563c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:21.113325 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-56edae64-34c3-429e-bdfa-9a352c27563c None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:51:21.114562 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-56edae64-34c3-429e-bdfa-9a352c27563c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:21.170952 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1267/2494] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:51:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:51:21.180703 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484ad68-653f-4d6f-8491-9d0108eeb0a8 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:21.182388 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6484ad68-653f-4d6f-8491-9d0108eeb0a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:21.209967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:51:21.241839 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6484ad68-653f-4d6f-8491-9d0108eeb0a8 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:21.245499 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caaac4e-bde4-4955-b4a5-3afa953476b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:21.246150 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caaac4e-bde4-4955-b4a5-3afa953476b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:21.246437 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caaac4e-bde4-4955-b4a5-3afa953476b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:21.246745 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caaac4e-bde4-4955-b4a5-3afa953476b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:21.259187 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caaac4e-bde4-4955-b4a5-3afa953476b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:21.261954 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caaac4e-bde4-4955-b4a5-3afa953476b2 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:21.272982 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1228/2495] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:51:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:51:21.328649 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56edae64-34c3-429e-bdfa-9a352c27563c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:21.330185 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-56edae64-34c3-429e-bdfa-9a352c27563c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:21.409818 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56edae64-34c3-429e-bdfa-9a352c27563c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:21.415521 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dacd8cd-dae8-49e5-aa7b-8d8d915bf39e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:21.416171 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacd8cd-dae8-49e5-aa7b-8d8d915bf39e service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:21.416456 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacd8cd-dae8-49e5-aa7b-8d8d915bf39e service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:21.416732 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dacd8cd-dae8-49e5-aa7b-8d8d915bf39e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:21.418550 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7dacd8cd-dae8-49e5-aa7b-8d8d915bf39e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:21.441810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:51:21.485296 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dacd8cd-dae8-49e5-aa7b-8d8d915bf39e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:21.486930 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dacd8cd-dae8-49e5-aa7b-8d8d915bf39e service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:21.497373 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1268/2496] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:51:21 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:51:22.202939 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4f448-b464-4bb2-ae80-37750bb3bfef None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:22.203461 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4f448-b464-4bb2-ae80-37750bb3bfef None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:22.203639 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4f448-b464-4bb2-ae80-37750bb3bfef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:22.232869 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-23e4f448-b464-4bb2-ae80-37750bb3bfef None None] MFA Rules not processed for user `ea5e2fa0c9b149a5beac56bf17d4473e`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:51:22.234387 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-23e4f448-b464-4bb2-ae80-37750bb3bfef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:22.307491 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1229/2497] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:51:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:51:22.311849 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dacd8cd-dae8-49e5-aa7b-8d8d915bf39e service nova] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:22.322378 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dacd8cd-dae8-49e5-aa7b-8d8d915bf39e service nova] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:22.327482 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe970a-6d32-41b1-9872-3528e59f8492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:22.328165 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe970a-6d32-41b1-9872-3528e59f8492 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:22.328424 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe970a-6d32-41b1-9872-3528e59f8492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:22.328702 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efe970a-6d32-41b1-9872-3528e59f8492 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:22.329395 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe970a-6d32-41b1-9872-3528e59f8492 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:22.331398 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efe970a-6d32-41b1-9872-3528e59f8492 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:22.365324 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1269/2498] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:51:22 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:51:22.369398 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4f448-b464-4bb2-ae80-37750bb3bfef None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:22.383464 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4f448-b464-4bb2-ae80-37750bb3bfef None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:22.453725 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f5ae5-0ae0-45a8-bce3-e71c8952c680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:22.454632 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f5ae5-0ae0-45a8-bce3-e71c8952c680 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:22.454920 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f5ae5-0ae0-45a8-bce3-e71c8952c680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:22.455194 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09f5ae5-0ae0-45a8-bce3-e71c8952c680 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:22.455895 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09f5ae5-0ae0-45a8-bce3-e71c8952c680 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:22.458320 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09f5ae5-0ae0-45a8-bce3-e71c8952c680 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:22.484145 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1230/2499] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:51:22 2022] POST /identity/v3/users => generated 292 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:51:22.485019 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe970a-6d32-41b1-9872-3528e59f8492 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:22.496925 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efe970a-6d32-41b1-9872-3528e59f8492 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:22.503194 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5b6cd-a972-4a14-b313-1c6b458985e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:22.503755 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5b6cd-a972-4a14-b313-1c6b458985e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:22.504048 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5b6cd-a972-4a14-b313-1c6b458985e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:22.504293 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5b6cd-a972-4a14-b313-1c6b458985e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:22.505169 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e5b6cd-a972-4a14-b313-1c6b458985e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:22.506856 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e5b6cd-a972-4a14-b313-1c6b458985e3 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:22.522499 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1270/2500] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 03:51:22.524383 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f5ae5-0ae0-45a8-bce3-e71c8952c680 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:22.536348 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09f5ae5-0ae0-45a8-bce3-e71c8952c680 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:22.542010 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d17e7-d84d-4202-93e0-b46c37c058a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:22.543316 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d17e7-d84d-4202-93e0-b46c37c058a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:22.543734 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d17e7-d84d-4202-93e0-b46c37c058a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:22.544113 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d17e7-d84d-4202-93e0-b46c37c058a5 admin admin] PATH_INFO: `/v3/projects/eeabd0a01bd54030b69ef10cebf979ab/users/1c424842035446b2a492e84cb6f19529/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:22.560009 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d17e7-d84d-4202-93e0-b46c37c058a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeabd0a01bd54030b69ef10cebf979ab, user_id=1c424842035446b2a492e84cb6f19529, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:22.562940 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d17e7-d84d-4202-93e0-b46c37c058a5 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:22.577738 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1231/2501] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:51:22 2022] PUT /identity/v3/projects/eeabd0a01bd54030b69ef10cebf979ab/users/1c424842035446b2a492e84cb6f19529/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:51:22.581342 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5b6cd-a972-4a14-b313-1c6b458985e3 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:22.591821 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5b6cd-a972-4a14-b313-1c6b458985e3 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:22.648931 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96749953-175a-4a4c-89a3-2fd9679a1484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:22.649593 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96749953-175a-4a4c-89a3-2fd9679a1484 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:22.649880 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96749953-175a-4a4c-89a3-2fd9679a1484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:22.650156 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96749953-175a-4a4c-89a3-2fd9679a1484 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:22.650907 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96749953-175a-4a4c-89a3-2fd9679a1484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:22.653146 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96749953-175a-4a4c-89a3-2fd9679a1484 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:22.662979 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1271/2502] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:51:22.667160 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d17e7-d84d-4202-93e0-b46c37c058a5 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:22.677605 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d17e7-d84d-4202-93e0-b46c37c058a5 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:22.682227 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c65787c-da8f-4645-b2f1-0a95c4e37fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:22.683140 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65787c-da8f-4645-b2f1-0a95c4e37fa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:22.683421 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65787c-da8f-4645-b2f1-0a95c4e37fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:22.683696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65787c-da8f-4645-b2f1-0a95c4e37fa9 admin admin] PATH_INFO: `/v3/projects/eeabd0a01bd54030b69ef10cebf979ab/users/1c424842035446b2a492e84cb6f19529/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:22.685697 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c65787c-da8f-4645-b2f1-0a95c4e37fa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeabd0a01bd54030b69ef10cebf979ab, user_id=1c424842035446b2a492e84cb6f19529, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:22.688425 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c65787c-da8f-4645-b2f1-0a95c4e37fa9 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:22.699718 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1232/2503] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:51:22 2022] PUT /identity/v3/projects/eeabd0a01bd54030b69ef10cebf979ab/users/1c424842035446b2a492e84cb6f19529/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:51:23.380664 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc835e3-1292-4508-943e-bd62a051bd66 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:23.381181 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc835e3-1292-4508-943e-bd62a051bd66 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:23.381357 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc835e3-1292-4508-943e-bd62a051bd66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:23.407056 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-bdc835e3-1292-4508-943e-bd62a051bd66 None None] MFA Rules not processed for user `1c424842035446b2a492e84cb6f19529`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:51:23.408280 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-bdc835e3-1292-4508-943e-bd62a051bd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:23.477879 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1272/2504] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:51:23 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:51:23.489631 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a6fcd-6eee-4db2-9203-aad087ba90d6 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:23.490160 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a6fcd-6eee-4db2-9203-aad087ba90d6 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:23.490160 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a6fcd-6eee-4db2-9203-aad087ba90d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:23.507861 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-993a6fcd-6eee-4db2-9203-aad087ba90d6 None None] MFA Rules not processed for user `ea5e2fa0c9b149a5beac56bf17d4473e`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:51:23.509063 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-993a6fcd-6eee-4db2-9203-aad087ba90d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:23.514596 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:51:23.568310 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1233/2505] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:51:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:51:23.579406 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc835e3-1292-4508-943e-bd62a051bd66 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:23.589057 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:51:23.649960 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc835e3-1292-4508-943e-bd62a051bd66 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:23.655867 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb02be90-3639-4cbd-8db9-2da9a6108ac7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:23.656509 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02be90-3639-4cbd-8db9-2da9a6108ac7 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:23.656795 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02be90-3639-4cbd-8db9-2da9a6108ac7 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:23.657071 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb02be90-3639-4cbd-8db9-2da9a6108ac7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:23.665079 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb02be90-3639-4cbd-8db9-2da9a6108ac7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:23.666681 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb02be90-3639-4cbd-8db9-2da9a6108ac7 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:23.675911 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1273/2506] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:51:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:51:23.903713 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a6fcd-6eee-4db2-9203-aad087ba90d6 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:23.959912 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a6fcd-6eee-4db2-9203-aad087ba90d6 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:23.963583 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c843ec-1f37-4c39-ab71-2af3f19f33fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:23.964247 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c843ec-1f37-4c39-ab71-2af3f19f33fb service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:23.965104 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c843ec-1f37-4c39-ab71-2af3f19f33fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:23.965387 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c843ec-1f37-4c39-ab71-2af3f19f33fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:23.967200 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c6c843ec-1f37-4c39-ab71-2af3f19f33fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:23.976802 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c843ec-1f37-4c39-ab71-2af3f19f33fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:23.978225 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c843ec-1f37-4c39-ab71-2af3f19f33fb service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:23.986762 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1234/2507] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:51:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:51:24.430089 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb02be90-3639-4cbd-8db9-2da9a6108ac7 service nova] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:24.440296 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb02be90-3639-4cbd-8db9-2da9a6108ac7 service nova] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:24.443973 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44bbf15-3f44-4b62-bd40-d9270d058134 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:24.444717 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bbf15-3f44-4b62-bd40-d9270d058134 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:24.444924 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bbf15-3f44-4b62-bd40-d9270d058134 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:24.445204 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bbf15-3f44-4b62-bd40-d9270d058134 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:24.447013 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f44bbf15-3f44-4b62-bd40-d9270d058134 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:24.517720 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44bbf15-3f44-4b62-bd40-d9270d058134 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:24.519195 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44bbf15-3f44-4b62-bd40-d9270d058134 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:24.528944 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1274/2508] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:51:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:51:32.032040 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c843ec-1f37-4c39-ab71-2af3f19f33fb service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:32.033560 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c6c843ec-1f37-4c39-ab71-2af3f19f33fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:32.053833 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c843ec-1f37-4c39-ab71-2af3f19f33fb service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:32.060155 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5004af29-3873-44d5-a5f1-d1670fb3a6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:32.061053 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004af29-3873-44d5-a5f1-d1670fb3a6fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:32.061401 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004af29-3873-44d5-a5f1-d1670fb3a6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:32.061593 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004af29-3873-44d5-a5f1-d1670fb3a6fc admin admin] PATH_INFO: `/v3/users/a14245daf0a34f93a1ed94a33798e051` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:32.065987 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5004af29-3873-44d5-a5f1-d1670fb3a6fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=a14245daf0a34f93a1ed94a33798e051)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:32.068060 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5004af29-3873-44d5-a5f1-d1670fb3a6fc admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:32.135699 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5004af29-3873-44d5-a5f1-d1670fb3a6fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a14245daf0a34f93a1ed94a33798e051'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:32.137229 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5004af29-3873-44d5-a5f1-d1670fb3a6fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a14245daf0a34f93a1ed94a33798e051'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:32.137901 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5004af29-3873-44d5-a5f1-d1670fb3a6fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a14245daf0a34f93a1ed94a33798e051'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:32.145672 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5004af29-3873-44d5-a5f1-d1670fb3a6fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a14245daf0a34f93a1ed94a33798e051'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:32.153255 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5004af29-3873-44d5-a5f1-d1670fb3a6fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a14245daf0a34f93a1ed94a33798e051'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:32.171878 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1235/2509] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:51:32 2022] DELETE /identity/v3/users/a14245daf0a34f93a1ed94a33798e051 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:51:32.344896 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44bbf15-3f44-4b62-bd40-d9270d058134 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:32.355720 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44bbf15-3f44-4b62-bd40-d9270d058134 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:32.412758 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40107b-fcf2-44ce-aca4-e766cb22441c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:32.413650 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40107b-fcf2-44ce-aca4-e766cb22441c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:32.413940 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40107b-fcf2-44ce-aca4-e766cb22441c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:32.414238 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40107b-fcf2-44ce-aca4-e766cb22441c admin admin] PATH_INFO: `/v3/projects/d53f2cf71221415e91213e447497f38d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:32.415477 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40107b-fcf2-44ce-aca4-e766cb22441c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d53f2cf71221415e91213e447497f38d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:32.417932 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40107b-fcf2-44ce-aca4-e766cb22441c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:32.450386 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:51:32.463234 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ed40107b-fcf2-44ce-aca4-e766cb22441c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd53f2cf71221415e91213e447497f38d', 'request_id': 'req-ed40107b-fcf2-44ce-aca4-e766cb22441c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:32.469263 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ed40107b-fcf2-44ce-aca4-e766cb22441c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd53f2cf71221415e91213e447497f38d', 'request_id': 'req-ed40107b-fcf2-44ce-aca4-e766cb22441c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:32.476492 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ed40107b-fcf2-44ce-aca4-e766cb22441c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd53f2cf71221415e91213e447497f38d', 'request_id': 'req-ed40107b-fcf2-44ce-aca4-e766cb22441c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:32.487222 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ed40107b-fcf2-44ce-aca4-e766cb22441c admin admin] The token cache is being invalidate because project d53f2cf71221415e91213e447497f38d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:51:32.487511 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ed40107b-fcf2-44ce-aca4-e766cb22441c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:32.488131 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ed40107b-fcf2-44ce-aca4-e766cb22441c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:32.489652 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1275/2510] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:51:32 2022] DELETE /identity/v3/projects/d53f2cf71221415e91213e447497f38d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:51:32.493620 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5004af29-3873-44d5-a5f1-d1670fb3a6fc admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:32.495050 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5004af29-3873-44d5-a5f1-d1670fb3a6fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:32.508998 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5004af29-3873-44d5-a5f1-d1670fb3a6fc admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:32.536897 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:51:32.574694 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9084654-0df8-476a-9fa8-737624ef57b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:32.575639 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9084654-0df8-476a-9fa8-737624ef57b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:32.575941 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9084654-0df8-476a-9fa8-737624ef57b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:32.576220 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9084654-0df8-476a-9fa8-737624ef57b6 admin admin] PATH_INFO: `/v3/users/1797ca9a94b144cfad94a45ef2d612f3` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:32.577439 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9084654-0df8-476a-9fa8-737624ef57b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1797ca9a94b144cfad94a45ef2d612f3)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:32.579579 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9084654-0df8-476a-9fa8-737624ef57b6 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:32.635037 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c9084654-0df8-476a-9fa8-737624ef57b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1797ca9a94b144cfad94a45ef2d612f3'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:32.635801 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c9084654-0df8-476a-9fa8-737624ef57b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1797ca9a94b144cfad94a45ef2d612f3'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:32.637015 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c9084654-0df8-476a-9fa8-737624ef57b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1797ca9a94b144cfad94a45ef2d612f3'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:32.646862 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c9084654-0df8-476a-9fa8-737624ef57b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1797ca9a94b144cfad94a45ef2d612f3'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:32.655541 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c9084654-0df8-476a-9fa8-737624ef57b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1797ca9a94b144cfad94a45ef2d612f3'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:32.673892 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1236/2511] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:51:32 2022] DELETE /identity/v3/users/1797ca9a94b144cfad94a45ef2d612f3 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:51:32.845602 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40107b-fcf2-44ce-aca4-e766cb22441c admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:32.847077 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ed40107b-fcf2-44ce-aca4-e766cb22441c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:32.861475 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40107b-fcf2-44ce-aca4-e766cb22441c admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:32.919636 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05831249-baee-4b45-a817-66683eb4dc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:32.920524 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05831249-baee-4b45-a817-66683eb4dc3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:32.920805 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05831249-baee-4b45-a817-66683eb4dc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:32.921077 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05831249-baee-4b45-a817-66683eb4dc3c admin admin] PATH_INFO: `/v3/projects/4242a04d93a3461db06bcd331cdb0d50` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:32.922249 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05831249-baee-4b45-a817-66683eb4dc3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4242a04d93a3461db06bcd331cdb0d50)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:32.924225 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05831249-baee-4b45-a817-66683eb4dc3c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:32.969235 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-05831249-baee-4b45-a817-66683eb4dc3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4242a04d93a3461db06bcd331cdb0d50', 'request_id': 'req-05831249-baee-4b45-a817-66683eb4dc3c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:32.975226 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-05831249-baee-4b45-a817-66683eb4dc3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4242a04d93a3461db06bcd331cdb0d50', 'request_id': 'req-05831249-baee-4b45-a817-66683eb4dc3c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:32.982169 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-05831249-baee-4b45-a817-66683eb4dc3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4242a04d93a3461db06bcd331cdb0d50', 'request_id': 'req-05831249-baee-4b45-a817-66683eb4dc3c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:32.992207 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-05831249-baee-4b45-a817-66683eb4dc3c admin admin] The token cache is being invalidate because project 4242a04d93a3461db06bcd331cdb0d50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:51:32.992492 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-05831249-baee-4b45-a817-66683eb4dc3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:32.993108 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-05831249-baee-4b45-a817-66683eb4dc3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:32.994646 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1276/2512] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:51:32 2022] DELETE /identity/v3/projects/4242a04d93a3461db06bcd331cdb0d50 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:51:37.830582 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9084654-0df8-476a-9fa8-737624ef57b6 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:37.831995 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c9084654-0df8-476a-9fa8-737624ef57b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:37.920731 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9084654-0df8-476a-9fa8-737624ef57b6 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:37.954255 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:51:37.978054 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8d4bf-f838-4637-9bc9-1c354deee1fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:37.978674 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8d4bf-f838-4637-9bc9-1c354deee1fa service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:37.978966 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8d4bf-f838-4637-9bc9-1c354deee1fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:37.979267 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8d4bf-f838-4637-9bc9-1c354deee1fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:37.981080 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-87d8d4bf-f838-4637-9bc9-1c354deee1fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:38.064973 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d8d4bf-f838-4637-9bc9-1c354deee1fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:38.066417 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d8d4bf-f838-4637-9bc9-1c354deee1fa service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:38.076884 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1237/2513] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:51:37 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:51:42.989348 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=64,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:51:44.391525 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed551a-46d5-4a3f-9f2e-269f3923d96b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:44.392108 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed551a-46d5-4a3f-9f2e-269f3923d96b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:44.392108 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed551a-46d5-4a3f-9f2e-269f3923d96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:44.420696 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d7ed551a-46d5-4a3f-9f2e-269f3923d96b None None] MFA Rules not processed for user `73fad109df9f449e8ac5f38749c01ace`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:51:44.421901 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d7ed551a-46d5-4a3f-9f2e-269f3923d96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:44.482359 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1277/2514] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jul 21 03:51:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:51:44.529143 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8d4bf-f838-4637-9bc9-1c354deee1fa service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:44.530581 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-87d8d4bf-f838-4637-9bc9-1c354deee1fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:44.600960 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8d4bf-f838-4637-9bc9-1c354deee1fa service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:44.606487 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022ab9d-68f8-48c5-83a3-f0c372636bde service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8bc228892e45c0a7d1b529c2f9a8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:44.607141 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022ab9d-68f8-48c5-83a3-f0c372636bde service swift] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:44.607426 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022ab9d-68f8-48c5-83a3-f0c372636bde service swift] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:44.607696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022ab9d-68f8-48c5-83a3-f0c372636bde service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:44.615790 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022ab9d-68f8-48c5-83a3-f0c372636bde service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:44.617365 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022ab9d-68f8-48c5-83a3-f0c372636bde service swift] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:44.625346 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1238/2515] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jul 21 03:51:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 03:51:51.756184 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed551a-46d5-4a3f-9f2e-269f3923d96b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:51.758905 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d7ed551a-46d5-4a3f-9f2e-269f3923d96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:51.873049 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed551a-46d5-4a3f-9f2e-269f3923d96b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:51.878850 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8bb75-78e8-4cea-a599-111a89fc10aa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb39129b3ed04db28ed01860b37bd714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:51.879605 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8bb75-78e8-4cea-a599-111a89fc10aa service placement] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:51.880178 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8bb75-78e8-4cea-a599-111a89fc10aa service placement] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:51.880531 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8bb75-78e8-4cea-a599-111a89fc10aa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:51.882475 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-87d8bb75-78e8-4cea-a599-111a89fc10aa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:51.896428 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d8bb75-78e8-4cea-a599-111a89fc10aa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:51.898150 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d8bb75-78e8-4cea-a599-111a89fc10aa service placement] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:51.911173 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1278/2516] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:51:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:51:54.622074 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=75 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:51:57.773491 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022ab9d-68f8-48c5-83a3-f0c372636bde service swift] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:57.787888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022ab9d-68f8-48c5-83a3-f0c372636bde service swift] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:57.797279 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdcabc0-a5da-43e9-8460-8d050837b780 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb39129b3ed04db28ed01860b37bd714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:57.798296 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcabc0-a5da-43e9-8460-8d050837b780 service placement] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:57.798687 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcabc0-a5da-43e9-8460-8d050837b780 service placement] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:57.799118 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcabc0-a5da-43e9-8460-8d050837b780 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:57.801214 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9bdcabc0-a5da-43e9-8460-8d050837b780 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:57.818994 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdcabc0-a5da-43e9-8460-8d050837b780 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:57.820680 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdcabc0-a5da-43e9-8460-8d050837b780 service placement] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:57.837793 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1239/2517] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:51:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:51:58.046624 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e003a-3ffb-4272-9463-187f4c915b4e None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:58.047220 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e003a-3ffb-4272-9463-187f4c915b4e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:58.047220 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e003a-3ffb-4272-9463-187f4c915b4e None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:58.049502 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1279/2518] 10.222.0.20 () {54 vars in 921 bytes} [Thu Jul 21 03:51:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:51:58.056904 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eeca00-b407-422f-80ed-43d97d907969 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:58.057196 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eeca00-b407-422f-80ed-43d97d907969 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:58.059741 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eeca00-b407-422f-80ed-43d97d907969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:58.109816 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-08eeca00-b407-422f-80ed-43d97d907969 None None] MFA Rules not processed for user `cefbe2d0c739428ab0d4dfeaed6c37ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:51:58.111063 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-08eeca00-b407-422f-80ed-43d97d907969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:58.197037 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1240/2519] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Jul 21 03:51:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:51:58.208979 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e003a-3ffb-4272-9463-187f4c915b4e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:58.210663 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-433e003a-3ffb-4272-9463-187f4c915b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:58.270066 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e003a-3ffb-4272-9463-187f4c915b4e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:58.273647 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9486bfd-0609-4662-ab57-37027ebe4e9d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a567cddc98164bd39317a245626d0f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:58.274296 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9486bfd-0609-4662-ab57-37027ebe4e9d service glance] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:58.275046 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9486bfd-0609-4662-ab57-37027ebe4e9d service glance] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:58.275046 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9486bfd-0609-4662-ab57-37027ebe4e9d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:58.285696 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9486bfd-0609-4662-ab57-37027ebe4e9d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:58.287154 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9486bfd-0609-4662-ab57-37027ebe4e9d service glance] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:58.298520 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1280/2520] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:51:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:51:58.367836 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eeca00-b407-422f-80ed-43d97d907969 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:58.369918 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-08eeca00-b407-422f-80ed-43d97d907969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:58.381619 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa9ab7-d449-4d2f-8cef-567f0e94ce7e None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:58.381920 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa9ab7-d449-4d2f-8cef-567f0e94ce7e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:58.382273 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa9ab7-d449-4d2f-8cef-567f0e94ce7e None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:58.383737 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1281/2521] 10.222.0.20 () {54 vars in 921 bytes} [Thu Jul 21 03:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 03:51:58.389185 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643dd13-de0b-4063-b7f8-0625c32aa495 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:58.389473 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643dd13-de0b-4063-b7f8-0625c32aa495 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:58.390058 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643dd13-de0b-4063-b7f8-0625c32aa495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:58.397131 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:51:58.423389 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-9643dd13-de0b-4063-b7f8-0625c32aa495 None None] MFA Rules not processed for user `b68c257254de483ab65eb5dc5684a704`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:51:58.424620 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9643dd13-de0b-4063-b7f8-0625c32aa495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:58.472913 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eeca00-b407-422f-80ed-43d97d907969 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:58.477562 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6126b20-acf6-4fdd-bc5d-bd7ecb9d46b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:58.478475 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6126b20-acf6-4fdd-bc5d-bd7ecb9d46b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:58.478789 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6126b20-acf6-4fdd-bc5d-bd7ecb9d46b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:58.479068 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6126b20-acf6-4fdd-bc5d-bd7ecb9d46b0 admin admin] PATH_INFO: `/v3/users/ea5e2fa0c9b149a5beac56bf17d4473e` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:58.480879 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6126b20-acf6-4fdd-bc5d-bd7ecb9d46b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea5e2fa0c9b149a5beac56bf17d4473e)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:58.482874 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6126b20-acf6-4fdd-bc5d-bd7ecb9d46b0 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:58.486066 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1282/2522] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Jul 21 03:51:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:51:58.498737 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643dd13-de0b-4063-b7f8-0625c32aa495 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:58.500463 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9643dd13-de0b-4063-b7f8-0625c32aa495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:58.508010 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:51:58.511364 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643dd13-de0b-4063-b7f8-0625c32aa495 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:58.517472 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735be63-dcc8-4f35-8294-306dedae72bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:58.518380 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735be63-dcc8-4f35-8294-306dedae72bd service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:58.518670 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735be63-dcc8-4f35-8294-306dedae72bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:58.518949 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735be63-dcc8-4f35-8294-306dedae72bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:58.527326 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5735be63-dcc8-4f35-8294-306dedae72bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:58.529218 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5735be63-dcc8-4f35-8294-306dedae72bd service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:58.534581 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f6126b20-acf6-4fdd-bc5d-bd7ecb9d46b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea5e2fa0c9b149a5beac56bf17d4473e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:58.535237 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f6126b20-acf6-4fdd-bc5d-bd7ecb9d46b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea5e2fa0c9b149a5beac56bf17d4473e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:58.535841 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f6126b20-acf6-4fdd-bc5d-bd7ecb9d46b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea5e2fa0c9b149a5beac56bf17d4473e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:58.538243 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1283/2523] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:51:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 03:51:58.544054 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f6126b20-acf6-4fdd-bc5d-bd7ecb9d46b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea5e2fa0c9b149a5beac56bf17d4473e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:58.551994 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f6126b20-acf6-4fdd-bc5d-bd7ecb9d46b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea5e2fa0c9b149a5beac56bf17d4473e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:58.570189 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1241/2524] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:51:58 2022] DELETE /identity/v3/users/ea5e2fa0c9b149a5beac56bf17d4473e => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:51:58.624463 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78e098-3bb5-48e9-b220-a9cb3f05e2f6 None None] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:58.624760 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78e098-3bb5-48e9-b220-a9cb3f05e2f6 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:58.625076 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78e098-3bb5-48e9-b220-a9cb3f05e2f6 None None] PATH_INFO: `/` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:58.626653 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1284/2525] 10.222.0.20 () {54 vars in 921 bytes} [Thu Jul 21 03:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 03:51:58.632665 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08d75f-b4cc-41fd-bf6b-aa591a4c6e3b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:58.632959 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08d75f-b4cc-41fd-bf6b-aa591a4c6e3b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:58.633243 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08d75f-b4cc-41fd-bf6b-aa591a4c6e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:58.650963 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-2a08d75f-b4cc-41fd-bf6b-aa591a4c6e3b None None] MFA Rules not processed for user `cefbe2d0c739428ab0d4dfeaed6c37ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:51:58.652319 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2a08d75f-b4cc-41fd-bf6b-aa591a4c6e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:58.722627 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1242/2526] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Jul 21 03:51:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:51:58.734662 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78e098-3bb5-48e9-b220-a9cb3f05e2f6 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:58.737100 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-af78e098-3bb5-48e9-b220-a9cb3f05e2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:58.756758 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a08d75f-b4cc-41fd-bf6b-aa591a4c6e3b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:58.758301 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2a08d75f-b4cc-41fd-bf6b-aa591a4c6e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:58.803096 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78e098-3bb5-48e9-b220-a9cb3f05e2f6 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:58.806790 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a423454-174c-4549-abe2-d470077caa70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:58.807435 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a423454-174c-4549-abe2-d470077caa70 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:58.807720 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a423454-174c-4549-abe2-d470077caa70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:58.807995 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a423454-174c-4549-abe2-d470077caa70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:58.818036 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a423454-174c-4549-abe2-d470077caa70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:58.819483 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a423454-174c-4549-abe2-d470077caa70 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:58.830528 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1285/2527] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:51:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 03:51:58.833733 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a08d75f-b4cc-41fd-bf6b-aa591a4c6e3b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:58.838382 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79bd49-4a8b-413d-8fbe-c65b94c3a720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:58.839289 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79bd49-4a8b-413d-8fbe-c65b94c3a720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:58.840270 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79bd49-4a8b-413d-8fbe-c65b94c3a720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:58.840556 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79bd49-4a8b-413d-8fbe-c65b94c3a720 admin admin] PATH_INFO: `/v3/projects/d25a2dfe7b9542278056127a2f55f1b0` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:58.842796 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79bd49-4a8b-413d-8fbe-c65b94c3a720 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d25a2dfe7b9542278056127a2f55f1b0)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:58.844882 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79bd49-4a8b-413d-8fbe-c65b94c3a720 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:58.885254 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:51:58.898275 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2f79bd49-4a8b-413d-8fbe-c65b94c3a720 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd25a2dfe7b9542278056127a2f55f1b0', 'request_id': 'req-2f79bd49-4a8b-413d-8fbe-c65b94c3a720'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:58.904986 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2f79bd49-4a8b-413d-8fbe-c65b94c3a720 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd25a2dfe7b9542278056127a2f55f1b0', 'request_id': 'req-2f79bd49-4a8b-413d-8fbe-c65b94c3a720'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:58.912992 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2f79bd49-4a8b-413d-8fbe-c65b94c3a720 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd25a2dfe7b9542278056127a2f55f1b0', 'request_id': 'req-2f79bd49-4a8b-413d-8fbe-c65b94c3a720'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:58.924714 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2f79bd49-4a8b-413d-8fbe-c65b94c3a720 admin admin] The token cache is being invalidate because project d25a2dfe7b9542278056127a2f55f1b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:51:58.925025 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2f79bd49-4a8b-413d-8fbe-c65b94c3a720 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:58.925697 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2f79bd49-4a8b-413d-8fbe-c65b94c3a720 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:58.927314 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1243/2528] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:51:58 2022] DELETE /identity/v3/projects/d25a2dfe7b9542278056127a2f55f1b0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:51:58.931366 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a423454-174c-4549-abe2-d470077caa70 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:58.942249 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a423454-174c-4549-abe2-d470077caa70 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:59.004822 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11790bf-fb81-43cf-8e68-d3129a6eab43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:59.005697 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11790bf-fb81-43cf-8e68-d3129a6eab43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:59.005982 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11790bf-fb81-43cf-8e68-d3129a6eab43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:59.006261 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11790bf-fb81-43cf-8e68-d3129a6eab43 admin admin] PATH_INFO: `/v3/users/1c424842035446b2a492e84cb6f19529` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:59.011142 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11790bf-fb81-43cf-8e68-d3129a6eab43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c424842035446b2a492e84cb6f19529)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:59.011142 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11790bf-fb81-43cf-8e68-d3129a6eab43 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:59.038523 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:51:59.065458 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d11790bf-fb81-43cf-8e68-d3129a6eab43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c424842035446b2a492e84cb6f19529'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:59.066184 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d11790bf-fb81-43cf-8e68-d3129a6eab43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c424842035446b2a492e84cb6f19529'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:59.066824 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d11790bf-fb81-43cf-8e68-d3129a6eab43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c424842035446b2a492e84cb6f19529'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:59.073919 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d11790bf-fb81-43cf-8e68-d3129a6eab43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c424842035446b2a492e84cb6f19529'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:59.081882 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d11790bf-fb81-43cf-8e68-d3129a6eab43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c424842035446b2a492e84cb6f19529'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:59.103037 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1286/2529] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:51:58 2022] DELETE /identity/v3/users/1c424842035446b2a492e84cb6f19529 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:51:59.363217 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79bd49-4a8b-413d-8fbe-c65b94c3a720 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:59.364730 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-2f79bd49-4a8b-413d-8fbe-c65b94c3a720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:59.389431 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79bd49-4a8b-413d-8fbe-c65b94c3a720 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:59.474897 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faf54b0-560d-4196-86f2-13a8448e8ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:59.475871 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf54b0-560d-4196-86f2-13a8448e8ea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:59.476244 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf54b0-560d-4196-86f2-13a8448e8ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:59.476527 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faf54b0-560d-4196-86f2-13a8448e8ea6 admin admin] PATH_INFO: `/v3/projects/eeabd0a01bd54030b69ef10cebf979ab` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:59.477729 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf54b0-560d-4196-86f2-13a8448e8ea6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeabd0a01bd54030b69ef10cebf979ab)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:59.479752 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faf54b0-560d-4196-86f2-13a8448e8ea6 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:59.532055 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5faf54b0-560d-4196-86f2-13a8448e8ea6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeabd0a01bd54030b69ef10cebf979ab', 'request_id': 'req-5faf54b0-560d-4196-86f2-13a8448e8ea6'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:59.538894 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5faf54b0-560d-4196-86f2-13a8448e8ea6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeabd0a01bd54030b69ef10cebf979ab', 'request_id': 'req-5faf54b0-560d-4196-86f2-13a8448e8ea6'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:59.547143 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5faf54b0-560d-4196-86f2-13a8448e8ea6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeabd0a01bd54030b69ef10cebf979ab', 'request_id': 'req-5faf54b0-560d-4196-86f2-13a8448e8ea6'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:59.560629 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5faf54b0-560d-4196-86f2-13a8448e8ea6 admin admin] The token cache is being invalidate because project eeabd0a01bd54030b69ef10cebf979ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:51:59.560919 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5faf54b0-560d-4196-86f2-13a8448e8ea6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:59.561552 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5faf54b0-560d-4196-86f2-13a8448e8ea6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:51:59.563294 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1244/2530] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:51:59 2022] DELETE /identity/v3/projects/eeabd0a01bd54030b69ef10cebf979ab => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:51:59.568357 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2288bb-f71d-4f6f-b7a0-f80b00ee6a62 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:59.568661 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2288bb-f71d-4f6f-b7a0-f80b00ee6a62 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:59.568943 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2288bb-f71d-4f6f-b7a0-f80b00ee6a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:59.617078 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-0c2288bb-f71d-4f6f-b7a0-f80b00ee6a62 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:51:59.618528 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0c2288bb-f71d-4f6f-b7a0-f80b00ee6a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:59.680726 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1287/2531] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:51:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:51:59.689288 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb591f4-4cef-48df-9486-7a38c6ba44d7 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:59.689533 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb591f4-4cef-48df-9486-7a38c6ba44d7 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:59.689861 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb591f4-4cef-48df-9486-7a38c6ba44d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:59.719714 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-8bb591f4-4cef-48df-9486-7a38c6ba44d7 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:51:59.720920 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8bb591f4-4cef-48df-9486-7a38c6ba44d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:51:59.728838 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1245/2532] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:51:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:51:59.733401 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2288bb-f71d-4f6f-b7a0-f80b00ee6a62 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:59.745233 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2288bb-f71d-4f6f-b7a0-f80b00ee6a62 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:59.752324 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde54db0-ce8c-4960-b66e-0c57bdd5d91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:59.752974 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde54db0-ce8c-4960-b66e-0c57bdd5d91e admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:59.753254 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde54db0-ce8c-4960-b66e-0c57bdd5d91e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:59.753528 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde54db0-ce8c-4960-b66e-0c57bdd5d91e admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:59.754254 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde54db0-ce8c-4960-b66e-0c57bdd5d91e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:51:59.754596 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde54db0-ce8c-4960-b66e-0c57bdd5d91e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:59.756213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde54db0-ce8c-4960-b66e-0c57bdd5d91e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:59.770738 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1288/2533] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:51:59.775365 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb591f4-4cef-48df-9486-7a38c6ba44d7 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:59.785460 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb591f4-4cef-48df-9486-7a38c6ba44d7 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:59.790236 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea6d34-45aa-4f61-bc72-d6182e0fa395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:59.791053 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea6d34-45aa-4f61-bc72-d6182e0fa395 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:59.791338 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea6d34-45aa-4f61-bc72-d6182e0fa395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:59.791616 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea6d34-45aa-4f61-bc72-d6182e0fa395 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:59.792736 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea6d34-45aa-4f61-bc72-d6182e0fa395 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:59.794366 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea6d34-45aa-4f61-bc72-d6182e0fa395 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:59.844158 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1246/2534] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:51:59 2022] POST /identity/v3/projects => generated 389 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:51:59.846303 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde54db0-ce8c-4960-b66e-0c57bdd5d91e admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:59.857336 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde54db0-ce8c-4960-b66e-0c57bdd5d91e admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:59.924422 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd630a8-a531-4909-bd82-807dd7be1672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:59.925104 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd630a8-a531-4909-bd82-807dd7be1672 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:59.925418 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd630a8-a531-4909-bd82-807dd7be1672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:59.925662 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd630a8-a531-4909-bd82-807dd7be1672 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:59.926353 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd630a8-a531-4909-bd82-807dd7be1672 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:59.928335 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd630a8-a531-4909-bd82-807dd7be1672 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:59.939597 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:51:59.951626 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1289/2535] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:51:59 2022] POST /identity/v3/users => generated 295 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:51:59.956259 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea6d34-45aa-4f61-bc72-d6182e0fa395 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:51:59.967608 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea6d34-45aa-4f61-bc72-d6182e0fa395 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:51:59.972291 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890b84f-87f3-43ec-838e-e9a57d51ff41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:51:59.972973 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890b84f-87f3-43ec-838e-e9a57d51ff41 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:51:59.973257 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890b84f-87f3-43ec-838e-e9a57d51ff41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:51:59.973533 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890b84f-87f3-43ec-838e-e9a57d51ff41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:51:59.974255 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7890b84f-87f3-43ec-838e-e9a57d51ff41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:51:59.975899 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7890b84f-87f3-43ec-838e-e9a57d51ff41 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:51:59.987019 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1247/2536] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:51:59.991534 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd630a8-a531-4909-bd82-807dd7be1672 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:52:00.002758 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd630a8-a531-4909-bd82-807dd7be1672 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:52:00.007498 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e6c51-8b20-4f6e-abeb-b5653b999f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:52:00.008184 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e6c51-8b20-4f6e-abeb-b5653b999f93 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:00.008471 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e6c51-8b20-4f6e-abeb-b5653b999f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:00.008748 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e6c51-8b20-4f6e-abeb-b5653b999f93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:00.009478 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e6c51-8b20-4f6e-abeb-b5653b999f93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:52:00.011101 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e6c51-8b20-4f6e-abeb-b5653b999f93 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:52:00.021172 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1290/2537] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:51:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 03:52:00.025532 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890b84f-87f3-43ec-838e-e9a57d51ff41 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:52:00.035822 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890b84f-87f3-43ec-838e-e9a57d51ff41 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:52:00.040573 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d272c3-f7e8-48b2-89d8-ef8b03598932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:52:00.041536 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d272c3-f7e8-48b2-89d8-ef8b03598932 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:00.041818 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d272c3-f7e8-48b2-89d8-ef8b03598932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:00.042091 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d272c3-f7e8-48b2-89d8-ef8b03598932 admin admin] PATH_INFO: `/v3/projects/9201ee9923a24f3f9b49346df27d0d97/users/0c4cc3d8cdd645029e5839809e3fc065/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:00.054081 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:52:00.058366 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d272c3-f7e8-48b2-89d8-ef8b03598932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9201ee9923a24f3f9b49346df27d0d97, user_id=0c4cc3d8cdd645029e5839809e3fc065, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:52:00.062272 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d272c3-f7e8-48b2-89d8-ef8b03598932 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:52:00.077049 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1248/2538] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:52:00 2022] PUT /identity/v3/projects/9201ee9923a24f3f9b49346df27d0d97/users/0c4cc3d8cdd645029e5839809e3fc065/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:52:00.087693 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97de3c7-a1cf-4368-8b5a-df91676e29dd None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:00.088202 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97de3c7-a1cf-4368-8b5a-df91676e29dd None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:00.088317 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97de3c7-a1cf-4368-8b5a-df91676e29dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:00.115607 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-a97de3c7-a1cf-4368-8b5a-df91676e29dd None None] MFA Rules not processed for user `0c4cc3d8cdd645029e5839809e3fc065`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:52:00.116826 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a97de3c7-a1cf-4368-8b5a-df91676e29dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:52:00.182814 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1291/2539] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:52:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:52:00.194737 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d272c3-f7e8-48b2-89d8-ef8b03598932 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:52:00.196628 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c0d272c3-f7e8-48b2-89d8-ef8b03598932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:52:00.253313 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d272c3-f7e8-48b2-89d8-ef8b03598932 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:52:00.257022 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd874474-80f5-48e0-8587-0db6542a6243 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:52:00.257672 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd874474-80f5-48e0-8587-0db6542a6243 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:00.257955 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd874474-80f5-48e0-8587-0db6542a6243 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:00.258229 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd874474-80f5-48e0-8587-0db6542a6243 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:00.267049 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd874474-80f5-48e0-8587-0db6542a6243 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:52:00.268530 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd874474-80f5-48e0-8587-0db6542a6243 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:52:00.281175 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1249/2540] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:52:00 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 03:52:00.631183 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e532289-9558-4eda-8d14-a7606ca96466 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:00.631811 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e532289-9558-4eda-8d14-a7606ca96466 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:00.632096 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e532289-9558-4eda-8d14-a7606ca96466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:00.651618 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-3e532289-9558-4eda-8d14-a7606ca96466 None None] MFA Rules not processed for user `73fad109df9f449e8ac5f38749c01ace`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:52:00.653410 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3e532289-9558-4eda-8d14-a7606ca96466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:52:00.708613 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1292/2541] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jul 21 03:52:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:52:00.721128 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd874474-80f5-48e0-8587-0db6542a6243 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:52:00.722559 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fd874474-80f5-48e0-8587-0db6542a6243 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:52:00.791384 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd874474-80f5-48e0-8587-0db6542a6243 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:52:00.796540 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09d4d23-0582-41ff-850c-6886ec33dc20 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8bc228892e45c0a7d1b529c2f9a8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:52:00.797296 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d4d23-0582-41ff-850c-6886ec33dc20 service swift] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:00.797590 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d4d23-0582-41ff-850c-6886ec33dc20 service swift] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:00.797876 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09d4d23-0582-41ff-850c-6886ec33dc20 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:00.805968 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d4d23-0582-41ff-850c-6886ec33dc20 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:52:00.807601 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09d4d23-0582-41ff-850c-6886ec33dc20 service swift] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:52:00.815752 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1250/2542] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jul 21 03:52:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 03:52:10.493569 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e532289-9558-4eda-8d14-a7606ca96466 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:52:10.568913 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e532289-9558-4eda-8d14-a7606ca96466 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:52:10.573438 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77ac4f-882d-4785-8ab4-b64a94d09d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:52:10.574354 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77ac4f-882d-4785-8ab4-b64a94d09d13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:10.574666 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77ac4f-882d-4785-8ab4-b64a94d09d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:10.574941 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d77ac4f-882d-4785-8ab4-b64a94d09d13 admin admin] PATH_INFO: `/v3/users/0c4cc3d8cdd645029e5839809e3fc065` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:10.576196 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d77ac4f-882d-4785-8ab4-b64a94d09d13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c4cc3d8cdd645029e5839809e3fc065)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:52:10.578104 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d77ac4f-882d-4785-8ab4-b64a94d09d13 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:52:10.600452 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:52:10.628128 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-6d77ac4f-882d-4785-8ab4-b64a94d09d13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c4cc3d8cdd645029e5839809e3fc065'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:52:10.628881 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-6d77ac4f-882d-4785-8ab4-b64a94d09d13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c4cc3d8cdd645029e5839809e3fc065'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:52:10.629496 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-6d77ac4f-882d-4785-8ab4-b64a94d09d13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c4cc3d8cdd645029e5839809e3fc065'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:52:10.636892 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-6d77ac4f-882d-4785-8ab4-b64a94d09d13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c4cc3d8cdd645029e5839809e3fc065'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:52:10.644029 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-6d77ac4f-882d-4785-8ab4-b64a94d09d13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c4cc3d8cdd645029e5839809e3fc065'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:52:10.661627 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1293/2543] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:52:10 2022] DELETE /identity/v3/users/0c4cc3d8cdd645029e5839809e3fc065 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:52:10.665933 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19868265-e8f3-4675-9324-77376375d8c9 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:10.666445 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19868265-e8f3-4675-9324-77376375d8c9 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:10.666572 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19868265-e8f3-4675-9324-77376375d8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:10.684705 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-19868265-e8f3-4675-9324-77376375d8c9 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:52:10.685915 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-19868265-e8f3-4675-9324-77376375d8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:52:10.744265 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1251/2544] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:52:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:52:10.754520 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77ac4f-882d-4785-8ab4-b64a94d09d13 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:52:10.756353 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6d77ac4f-882d-4785-8ab4-b64a94d09d13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:52:10.815518 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d77ac4f-882d-4785-8ab4-b64a94d09d13 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:52:10.819219 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d94af39-0623-456b-8202-a17577eae1ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:52:10.819815 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94af39-0623-456b-8202-a17577eae1ee service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:10.820102 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94af39-0623-456b-8202-a17577eae1ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:10.820379 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d94af39-0623-456b-8202-a17577eae1ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:10.829317 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94af39-0623-456b-8202-a17577eae1ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:52:10.830846 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d94af39-0623-456b-8202-a17577eae1ee service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:52:10.840647 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1294/2545] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:52:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:52:11.106344 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19868265-e8f3-4675-9324-77376375d8c9 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:52:11.107968 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-19868265-e8f3-4675-9324-77376375d8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:52:11.119990 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19868265-e8f3-4675-9324-77376375d8c9 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:52:11.124594 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84678ebf-e0ee-4dfa-ba72-197bc5200bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:52:11.125454 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84678ebf-e0ee-4dfa-ba72-197bc5200bab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:11.125735 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84678ebf-e0ee-4dfa-ba72-197bc5200bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:11.126012 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84678ebf-e0ee-4dfa-ba72-197bc5200bab admin admin] PATH_INFO: `/v3/projects/9201ee9923a24f3f9b49346df27d0d97` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:11.127243 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84678ebf-e0ee-4dfa-ba72-197bc5200bab admin admin] RBAC: Authorizing `identity:delete_project(project_id=9201ee9923a24f3f9b49346df27d0d97)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:52:11.129165 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84678ebf-e0ee-4dfa-ba72-197bc5200bab admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:52:11.148356 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:52:11.178311 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-84678ebf-e0ee-4dfa-ba72-197bc5200bab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9201ee9923a24f3f9b49346df27d0d97', 'request_id': 'req-84678ebf-e0ee-4dfa-ba72-197bc5200bab'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:52:11.184418 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-84678ebf-e0ee-4dfa-ba72-197bc5200bab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9201ee9923a24f3f9b49346df27d0d97', 'request_id': 'req-84678ebf-e0ee-4dfa-ba72-197bc5200bab'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:52:11.192032 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-84678ebf-e0ee-4dfa-ba72-197bc5200bab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9201ee9923a24f3f9b49346df27d0d97', 'request_id': 'req-84678ebf-e0ee-4dfa-ba72-197bc5200bab'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:52:11.202750 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-84678ebf-e0ee-4dfa-ba72-197bc5200bab admin admin] The token cache is being invalidate because project 9201ee9923a24f3f9b49346df27d0d97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:52:11.203037 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-84678ebf-e0ee-4dfa-ba72-197bc5200bab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:52:11.203658 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-84678ebf-e0ee-4dfa-ba72-197bc5200bab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:52:11.205197 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1252/2546] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:52:11 2022] DELETE /identity/v3/projects/9201ee9923a24f3f9b49346df27d0d97 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:52:20.835882 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:DELETE=7,keystone:SELECT=46,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:52:21.199905 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=17,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:52:22.189780 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc25e0d-f5bd-44e7-b4fa-59ac90a31e11 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:22.190281 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc25e0d-f5bd-44e7-b4fa-59ac90a31e11 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:22.190411 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc25e0d-f5bd-44e7-b4fa-59ac90a31e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:22.207989 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-9cc25e0d-f5bd-44e7-b4fa-59ac90a31e11 None None] MFA Rules not processed for user `73fad109df9f449e8ac5f38749c01ace`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:52:22.209255 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9cc25e0d-f5bd-44e7-b4fa-59ac90a31e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:52:22.264174 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1295/2547] 10.222.0.20 () {58 vars in 967 bytes} [Thu Jul 21 03:52:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:52:22.276483 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84678ebf-e0ee-4dfa-ba72-197bc5200bab admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:52:22.278413 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-84678ebf-e0ee-4dfa-ba72-197bc5200bab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:52:22.346101 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84678ebf-e0ee-4dfa-ba72-197bc5200bab admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:52:22.351008 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9b289-9b09-4304-b9b6-d3f7b1d2859b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8bc228892e45c0a7d1b529c2f9a8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:52:22.351648 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9b289-9b09-4304-b9b6-d3f7b1d2859b service swift] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:22.351931 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9b289-9b09-4304-b9b6-d3f7b1d2859b service swift] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:22.352205 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9b289-9b09-4304-b9b6-d3f7b1d2859b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:22.360892 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9b289-9b09-4304-b9b6-d3f7b1d2859b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:52:22.362480 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9b289-9b09-4304-b9b6-d3f7b1d2859b service swift] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:52:22.370599 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1253/2548] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jul 21 03:52:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 03:52:32.257045 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=25 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:52:32.367351 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=32 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:52:37.247136 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc25e0d-f5bd-44e7-b4fa-59ac90a31e11 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:52:37.248538 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9cc25e0d-f5bd-44e7-b4fa-59ac90a31e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:52:37.304035 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc25e0d-f5bd-44e7-b4fa-59ac90a31e11 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:52:37.307629 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc2444-9fea-4970-912d-3b55df00ca8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:52:37.308273 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc2444-9fea-4970-912d-3b55df00ca8e service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:37.308559 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc2444-9fea-4970-912d-3b55df00ca8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:37.309336 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc2444-9fea-4970-912d-3b55df00ca8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:37.311121 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-cabc2444-9fea-4970-912d-3b55df00ca8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:52:37.372234 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc2444-9fea-4970-912d-3b55df00ca8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:52:37.373651 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc2444-9fea-4970-912d-3b55df00ca8e service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:52:37.383228 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1296/2549] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:52:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:52:40.433301 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9b289-9b09-4304-b9b6-d3f7b1d2859b service swift] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:52:40.434780 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-85f9b289-9b09-4304-b9b6-d3f7b1d2859b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:52:40.448453 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9b289-9b09-4304-b9b6-d3f7b1d2859b service swift] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:52:40.453703 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2587169-4f88-46c8-aec0-dbb32a8d53a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:52:40.454675 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2587169-4f88-46c8-aec0-dbb32a8d53a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:40.454963 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2587169-4f88-46c8-aec0-dbb32a8d53a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:40.455243 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2587169-4f88-46c8-aec0-dbb32a8d53a4 admin admin] PATH_INFO: `/v3/users/9f13db57fa094debba1664160b6c4b46` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:40.456442 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2587169-4f88-46c8-aec0-dbb32a8d53a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f13db57fa094debba1664160b6c4b46)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:52:40.458418 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2587169-4f88-46c8-aec0-dbb32a8d53a4 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:52:40.503980 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a2587169-4f88-46c8-aec0-dbb32a8d53a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f13db57fa094debba1664160b6c4b46'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:52:40.504613 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a2587169-4f88-46c8-aec0-dbb32a8d53a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f13db57fa094debba1664160b6c4b46'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:52:40.505215 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a2587169-4f88-46c8-aec0-dbb32a8d53a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f13db57fa094debba1664160b6c4b46'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:52:40.512440 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a2587169-4f88-46c8-aec0-dbb32a8d53a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f13db57fa094debba1664160b6c4b46'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:52:40.519407 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a2587169-4f88-46c8-aec0-dbb32a8d53a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f13db57fa094debba1664160b6c4b46'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:52:40.543213 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1254/2550] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:52:40 2022] DELETE /identity/v3/users/9f13db57fa094debba1664160b6c4b46 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:52:40.714126 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc2444-9fea-4970-912d-3b55df00ca8e service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:52:40.725134 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc2444-9fea-4970-912d-3b55df00ca8e service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:52:40.783542 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5481497-7ff3-40bf-8b4f-717cef056814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:52:40.784659 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5481497-7ff3-40bf-8b4f-717cef056814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:40.784945 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5481497-7ff3-40bf-8b4f-717cef056814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:40.785224 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5481497-7ff3-40bf-8b4f-717cef056814 admin admin] PATH_INFO: `/v3/projects/ad4573721ab64d3fafd600f9ef4f966a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:40.786401 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5481497-7ff3-40bf-8b4f-717cef056814 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad4573721ab64d3fafd600f9ef4f966a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:52:40.788380 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5481497-7ff3-40bf-8b4f-717cef056814 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:52:40.833263 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a5481497-7ff3-40bf-8b4f-717cef056814 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad4573721ab64d3fafd600f9ef4f966a', 'request_id': 'req-a5481497-7ff3-40bf-8b4f-717cef056814'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:52:40.835109 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:52:40.840502 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a5481497-7ff3-40bf-8b4f-717cef056814 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad4573721ab64d3fafd600f9ef4f966a', 'request_id': 'req-a5481497-7ff3-40bf-8b4f-717cef056814'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:52:40.848147 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a5481497-7ff3-40bf-8b4f-717cef056814 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad4573721ab64d3fafd600f9ef4f966a', 'request_id': 'req-a5481497-7ff3-40bf-8b4f-717cef056814'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:52:40.859240 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a5481497-7ff3-40bf-8b4f-717cef056814 admin admin] The token cache is being invalidate because project ad4573721ab64d3fafd600f9ef4f966a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:52:40.859530 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a5481497-7ff3-40bf-8b4f-717cef056814 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:52:40.860184 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-a5481497-7ff3-40bf-8b4f-717cef056814 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:52:40.861681 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1297/2551] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:52:40 2022] DELETE /identity/v3/projects/ad4573721ab64d3fafd600f9ef4f966a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:52:40.866720 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10863789-cf94-4c66-8dde-3407ca40564f None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:40.867017 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10863789-cf94-4c66-8dde-3407ca40564f None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:40.867299 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10863789-cf94-4c66-8dde-3407ca40564f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:40.885374 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-10863789-cf94-4c66-8dde-3407ca40564f None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:52:40.886627 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-10863789-cf94-4c66-8dde-3407ca40564f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:52:40.944758 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1255/2552] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:52:40.952913 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5834b-2c5f-4f62-8002-f9455069e9d0 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:40.953207 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5834b-2c5f-4f62-8002-f9455069e9d0 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:40.953492 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5834b-2c5f-4f62-8002-f9455069e9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:40.971889 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-73a5834b-2c5f-4f62-8002-f9455069e9d0 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:52:40.973095 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-73a5834b-2c5f-4f62-8002-f9455069e9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:52:40.981651 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1298/2553] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:52:40.985592 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10863789-cf94-4c66-8dde-3407ca40564f None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:52:40.995162 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10863789-cf94-4c66-8dde-3407ca40564f None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:52:40.999708 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85320b23-0b5f-4b48-a693-f59e57470f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:52:41.000357 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85320b23-0b5f-4b48-a693-f59e57470f0c admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:41.000642 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85320b23-0b5f-4b48-a693-f59e57470f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:41.000918 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85320b23-0b5f-4b48-a693-f59e57470f0c admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:41.001642 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85320b23-0b5f-4b48-a693-f59e57470f0c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:52:41.001951 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85320b23-0b5f-4b48-a693-f59e57470f0c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:52:41.003604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85320b23-0b5f-4b48-a693-f59e57470f0c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:52:41.014859 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1256/2554] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:52:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:52:41.018930 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5834b-2c5f-4f62-8002-f9455069e9d0 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:52:41.028581 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5834b-2c5f-4f62-8002-f9455069e9d0 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:52:41.033287 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0646d6-30b6-4751-9ec2-b0fd726516f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:52:41.033933 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0646d6-30b6-4751-9ec2-b0fd726516f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:41.034223 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0646d6-30b6-4751-9ec2-b0fd726516f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:41.034805 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0646d6-30b6-4751-9ec2-b0fd726516f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:41.035504 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0646d6-30b6-4751-9ec2-b0fd726516f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:52:41.037395 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0646d6-30b6-4751-9ec2-b0fd726516f8 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:52:41.062657 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1299/2555] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:52:41 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:52:41.066377 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85320b23-0b5f-4b48-a693-f59e57470f0c admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:52:41.076046 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85320b23-0b5f-4b48-a693-f59e57470f0c admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:52:41.138001 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b7934-fc59-4a53-98e6-57abb7ae44b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:52:41.138697 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b7934-fc59-4a53-98e6-57abb7ae44b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:41.138986 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b7934-fc59-4a53-98e6-57abb7ae44b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:41.139262 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b7934-fc59-4a53-98e6-57abb7ae44b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:41.139985 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b7934-fc59-4a53-98e6-57abb7ae44b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:52:41.141907 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b7934-fc59-4a53-98e6-57abb7ae44b2 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:52:41.148519 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:52:41.164496 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1257/2556] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:52:41 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:52:41.168716 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0646d6-30b6-4751-9ec2-b0fd726516f8 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:52:41.179012 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0646d6-30b6-4751-9ec2-b0fd726516f8 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:52:41.183799 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c63a2-0edc-47ae-9d9f-0d2ab7b69dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:52:41.184457 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c63a2-0edc-47ae-9d9f-0d2ab7b69dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:41.184750 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c63a2-0edc-47ae-9d9f-0d2ab7b69dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:41.185027 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c63a2-0edc-47ae-9d9f-0d2ab7b69dd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:41.185759 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c63a2-0edc-47ae-9d9f-0d2ab7b69dd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:52:41.187415 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c63a2-0edc-47ae-9d9f-0d2ab7b69dd8 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:52:41.197727 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1300/2557] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:52:41.201930 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b7934-fc59-4a53-98e6-57abb7ae44b2 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:52:41.211629 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b7934-fc59-4a53-98e6-57abb7ae44b2 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:52:41.216887 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6550f0-f45d-4ec3-acac-4dd6cd7bbec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:52:41.217531 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6550f0-f45d-4ec3-acac-4dd6cd7bbec5 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:41.217817 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6550f0-f45d-4ec3-acac-4dd6cd7bbec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:41.218094 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6550f0-f45d-4ec3-acac-4dd6cd7bbec5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:41.218845 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6550f0-f45d-4ec3-acac-4dd6cd7bbec5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:52:41.220443 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6550f0-f45d-4ec3-acac-4dd6cd7bbec5 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:52:41.230056 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1258/2558] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:52:41.234017 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c63a2-0edc-47ae-9d9f-0d2ab7b69dd8 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:52:41.243753 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c63a2-0edc-47ae-9d9f-0d2ab7b69dd8 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:52:41.248426 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d415609-8862-492c-8c6f-e1617f54741a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:52:41.249296 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d415609-8862-492c-8c6f-e1617f54741a admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:41.249582 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d415609-8862-492c-8c6f-e1617f54741a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:41.249859 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d415609-8862-492c-8c6f-e1617f54741a admin admin] PATH_INFO: `/v3/projects/c9bbd6f61f3b46b8b614d4b2bac65d29/users/dabb10c1b61b4df297db87e54732087c/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:41.264861 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d415609-8862-492c-8c6f-e1617f54741a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9bbd6f61f3b46b8b614d4b2bac65d29, user_id=dabb10c1b61b4df297db87e54732087c, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:52:41.267579 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d415609-8862-492c-8c6f-e1617f54741a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:52:41.280340 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1301/2559] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:52:41 2022] PUT /identity/v3/projects/c9bbd6f61f3b46b8b614d4b2bac65d29/users/dabb10c1b61b4df297db87e54732087c/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:52:41.290428 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a8d6f-673a-4b39-a1fd-df79ae37421d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:41.290749 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a8d6f-673a-4b39-a1fd-df79ae37421d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:41.291029 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60a8d6f-673a-4b39-a1fd-df79ae37421d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:41.316598 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c60a8d6f-673a-4b39-a1fd-df79ae37421d None None] MFA Rules not processed for user `dabb10c1b61b4df297db87e54732087c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:52:41.317879 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c60a8d6f-673a-4b39-a1fd-df79ae37421d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:52:41.380604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1259/2560] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:52:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:52:41.384972 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d415609-8862-492c-8c6f-e1617f54741a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:52:41.445369 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d415609-8862-492c-8c6f-e1617f54741a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:52:41.450675 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638c869-8fec-4459-9a6d-c6c9980f379f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:52:41.451263 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638c869-8fec-4459-9a6d-c6c9980f379f admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:41.451552 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638c869-8fec-4459-9a6d-c6c9980f379f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:41.451888 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638c869-8fec-4459-9a6d-c6c9980f379f admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:41.452579 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7638c869-8fec-4459-9a6d-c6c9980f379f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:52:41.454511 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7638c869-8fec-4459-9a6d-c6c9980f379f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:52:41.480461 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1302/2561] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:52:41 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:52:41.484639 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a8d6f-673a-4b39-a1fd-df79ae37421d None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:52:41.503078 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60a8d6f-673a-4b39-a1fd-df79ae37421d None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:52:41.559540 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb656b70-d8b3-4fbe-8414-1e9415c3a027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:52:41.560233 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb656b70-d8b3-4fbe-8414-1e9415c3a027 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:41.560518 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb656b70-d8b3-4fbe-8414-1e9415c3a027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:41.560794 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb656b70-d8b3-4fbe-8414-1e9415c3a027 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:41.561491 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb656b70-d8b3-4fbe-8414-1e9415c3a027 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:52:41.563441 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb656b70-d8b3-4fbe-8414-1e9415c3a027 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:52:41.582640 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1260/2562] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:52:41 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:52:41.586602 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638c869-8fec-4459-9a6d-c6c9980f379f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:52:41.596729 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638c869-8fec-4459-9a6d-c6c9980f379f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:52:41.601314 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b75171-ff51-4b65-9af5-2458a57f6096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:52:41.601966 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b75171-ff51-4b65-9af5-2458a57f6096 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:41.602254 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b75171-ff51-4b65-9af5-2458a57f6096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:41.602562 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b75171-ff51-4b65-9af5-2458a57f6096 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:41.603295 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b75171-ff51-4b65-9af5-2458a57f6096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:52:41.604884 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b75171-ff51-4b65-9af5-2458a57f6096 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:52:41.615226 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1303/2563] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:52:41.619053 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb656b70-d8b3-4fbe-8414-1e9415c3a027 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:52:41.629373 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb656b70-d8b3-4fbe-8414-1e9415c3a027 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:52:41.633947 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da22ed5-18f2-44e7-8eb8-86e1b33fd407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:52:41.634962 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da22ed5-18f2-44e7-8eb8-86e1b33fd407 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:41.635248 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da22ed5-18f2-44e7-8eb8-86e1b33fd407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:41.635527 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da22ed5-18f2-44e7-8eb8-86e1b33fd407 admin admin] PATH_INFO: `/v3/projects/2d33b5c1288246f8851fa7437e375d64/users/507458985c494f67bdd3d9101d3de8f9/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:41.650612 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da22ed5-18f2-44e7-8eb8-86e1b33fd407 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d33b5c1288246f8851fa7437e375d64, user_id=507458985c494f67bdd3d9101d3de8f9, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:52:41.653257 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da22ed5-18f2-44e7-8eb8-86e1b33fd407 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:52:41.666297 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1261/2564] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:52:41 2022] PUT /identity/v3/projects/2d33b5c1288246f8851fa7437e375d64/users/507458985c494f67bdd3d9101d3de8f9/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:52:41.670160 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b75171-ff51-4b65-9af5-2458a57f6096 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:52:41.680320 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b75171-ff51-4b65-9af5-2458a57f6096 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:52:41.727021 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:52:41.737773 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422aba0-dca2-48e1-9520-424634233752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:52:41.738441 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422aba0-dca2-48e1-9520-424634233752 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:41.738765 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422aba0-dca2-48e1-9520-424634233752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:41.739044 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422aba0-dca2-48e1-9520-424634233752 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:41.739769 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7422aba0-dca2-48e1-9520-424634233752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:52:41.741415 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7422aba0-dca2-48e1-9520-424634233752 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:52:41.751493 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1304/2565] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:52:41 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:52:41.755764 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da22ed5-18f2-44e7-8eb8-86e1b33fd407 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:52:41.766770 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da22ed5-18f2-44e7-8eb8-86e1b33fd407 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:52:41.771313 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf7020-cc32-427d-8a38-4d622dafd0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:52:41.772221 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf7020-cc32-427d-8a38-4d622dafd0c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:41.772510 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf7020-cc32-427d-8a38-4d622dafd0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:41.772784 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf7020-cc32-427d-8a38-4d622dafd0c8 admin admin] PATH_INFO: `/v3/projects/2d33b5c1288246f8851fa7437e375d64/users/507458985c494f67bdd3d9101d3de8f9/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:41.774845 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf7020-cc32-427d-8a38-4d622dafd0c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d33b5c1288246f8851fa7437e375d64, user_id=507458985c494f67bdd3d9101d3de8f9, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:52:41.777542 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf7020-cc32-427d-8a38-4d622dafd0c8 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:52:41.788091 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1262/2566] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:52:41 2022] PUT /identity/v3/projects/2d33b5c1288246f8851fa7437e375d64/users/507458985c494f67bdd3d9101d3de8f9/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:52:41.798235 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059305e-aa83-42e3-9e8f-fe80510181a4 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:41.798565 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059305e-aa83-42e3-9e8f-fe80510181a4 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:41.798852 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059305e-aa83-42e3-9e8f-fe80510181a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:41.826351 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f059305e-aa83-42e3-9e8f-fe80510181a4 None None] MFA Rules not processed for user `507458985c494f67bdd3d9101d3de8f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:52:41.827608 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f059305e-aa83-42e3-9e8f-fe80510181a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:52:41.894361 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1305/2567] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:52:41 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:52:41.906498 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf7020-cc32-427d-8a38-4d622dafd0c8 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:52:41.908207 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-aaaf7020-cc32-427d-8a38-4d622dafd0c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:52:41.933081 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:52:41.988244 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf7020-cc32-427d-8a38-4d622dafd0c8 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:52:41.991840 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77aa9f1-80fd-4538-b892-5d1c4fc0b0fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:52:41.992487 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77aa9f1-80fd-4538-b892-5d1c4fc0b0fb service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:41.992772 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77aa9f1-80fd-4538-b892-5d1c4fc0b0fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:41.993045 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77aa9f1-80fd-4538-b892-5d1c4fc0b0fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:42.048755 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77aa9f1-80fd-4538-b892-5d1c4fc0b0fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:52:42.050186 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77aa9f1-80fd-4538-b892-5d1c4fc0b0fb service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:52:42.059673 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1263/2568] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:52:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:52:44.594194 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059305e-aa83-42e3-9e8f-fe80510181a4 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:52:44.595618 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f059305e-aa83-42e3-9e8f-fe80510181a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:52:44.608051 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059305e-aa83-42e3-9e8f-fe80510181a4 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:52:44.611738 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974488a2-215e-4905-896c-49be603d6726 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:52:44.612389 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974488a2-215e-4905-896c-49be603d6726 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:44.612677 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974488a2-215e-4905-896c-49be603d6726 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:44.612958 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974488a2-215e-4905-896c-49be603d6726 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:44.622810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974488a2-215e-4905-896c-49be603d6726 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:52:44.624386 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974488a2-215e-4905-896c-49be603d6726 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:52:44.634914 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1306/2569] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:52:44 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:52:52.055332 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=48 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:52:54.630349 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=46 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:52:57.120980 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77aa9f1-80fd-4538-b892-5d1c4fc0b0fb service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:52:57.181513 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77aa9f1-80fd-4538-b892-5d1c4fc0b0fb service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:52:57.185922 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c15a73-a6f2-4fcd-90c5-1a8be378ea14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:52:57.186812 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c15a73-a6f2-4fcd-90c5-1a8be378ea14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:57.187580 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c15a73-a6f2-4fcd-90c5-1a8be378ea14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:57.187851 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c15a73-a6f2-4fcd-90c5-1a8be378ea14 admin admin] PATH_INFO: `/v3/users/dabb10c1b61b4df297db87e54732087c` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:57.189021 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c15a73-a6f2-4fcd-90c5-1a8be378ea14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dabb10c1b61b4df297db87e54732087c)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:52:57.190970 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c15a73-a6f2-4fcd-90c5-1a8be378ea14 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:52:57.235173 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-95c15a73-a6f2-4fcd-90c5-1a8be378ea14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dabb10c1b61b4df297db87e54732087c'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:52:57.235809 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-95c15a73-a6f2-4fcd-90c5-1a8be378ea14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dabb10c1b61b4df297db87e54732087c'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:52:57.236408 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-95c15a73-a6f2-4fcd-90c5-1a8be378ea14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dabb10c1b61b4df297db87e54732087c'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:52:57.243138 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-95c15a73-a6f2-4fcd-90c5-1a8be378ea14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dabb10c1b61b4df297db87e54732087c'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:52:57.251085 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-95c15a73-a6f2-4fcd-90c5-1a8be378ea14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dabb10c1b61b4df297db87e54732087c'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:52:57.268568 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1264/2570] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:52:57 2022] DELETE /identity/v3/users/dabb10c1b61b4df297db87e54732087c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:52:57.273136 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db863d-60f1-4c12-b091-914f896be243 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:57.273599 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db863d-60f1-4c12-b091-914f896be243 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:57.273695 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db863d-60f1-4c12-b091-914f896be243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:57.292075 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-85db863d-60f1-4c12-b091-914f896be243 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:52:57.293257 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-85db863d-60f1-4c12-b091-914f896be243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:52:57.350351 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1307/2571] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:52:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:52:57.359689 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c15a73-a6f2-4fcd-90c5-1a8be378ea14 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:52:57.361104 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-95c15a73-a6f2-4fcd-90c5-1a8be378ea14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:52:57.417557 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c15a73-a6f2-4fcd-90c5-1a8be378ea14 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:52:57.421110 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7295df-0756-4a89-85df-f4e49d9d02b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:52:57.421750 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7295df-0756-4a89-85df-f4e49d9d02b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:57.422028 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7295df-0756-4a89-85df-f4e49d9d02b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:57.422302 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7295df-0756-4a89-85df-f4e49d9d02b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:57.431166 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7295df-0756-4a89-85df-f4e49d9d02b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:52:57.432589 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7295df-0756-4a89-85df-f4e49d9d02b1 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:52:57.442309 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1265/2572] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:52:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:52:57.683215 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db863d-60f1-4c12-b091-914f896be243 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:52:57.693471 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db863d-60f1-4c12-b091-914f896be243 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:52:57.698302 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629df422-e6ec-41e5-876c-a5261ccec2fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:52:57.699147 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629df422-e6ec-41e5-876c-a5261ccec2fd service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:57.699504 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629df422-e6ec-41e5-876c-a5261ccec2fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:57.699774 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629df422-e6ec-41e5-876c-a5261ccec2fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:57.701862 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-629df422-e6ec-41e5-876c-a5261ccec2fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:52:57.715295 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629df422-e6ec-41e5-876c-a5261ccec2fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:52:57.716200 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629df422-e6ec-41e5-876c-a5261ccec2fd service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:52:57.726497 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1308/2573] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:52:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:52:57.727053 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7295df-0756-4a89-85df-f4e49d9d02b1 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:52:57.728539 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fa7295df-0756-4a89-85df-f4e49d9d02b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:52:57.741717 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7295df-0756-4a89-85df-f4e49d9d02b1 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:52:57.746399 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da05755-480b-4161-aaa5-19dcbf4c5745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:52:57.747295 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da05755-480b-4161-aaa5-19dcbf4c5745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:57.747586 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da05755-480b-4161-aaa5-19dcbf4c5745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:57.747862 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da05755-480b-4161-aaa5-19dcbf4c5745 admin admin] PATH_INFO: `/v3/projects/c9bbd6f61f3b46b8b614d4b2bac65d29` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:57.749068 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da05755-480b-4161-aaa5-19dcbf4c5745 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9bbd6f61f3b46b8b614d4b2bac65d29)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:52:57.751614 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da05755-480b-4161-aaa5-19dcbf4c5745 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:52:57.771686 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:52:57.806024 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0da05755-480b-4161-aaa5-19dcbf4c5745 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9bbd6f61f3b46b8b614d4b2bac65d29', 'request_id': 'req-0da05755-480b-4161-aaa5-19dcbf4c5745'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:52:57.812818 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0da05755-480b-4161-aaa5-19dcbf4c5745 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9bbd6f61f3b46b8b614d4b2bac65d29', 'request_id': 'req-0da05755-480b-4161-aaa5-19dcbf4c5745'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:52:57.819993 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0da05755-480b-4161-aaa5-19dcbf4c5745 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9bbd6f61f3b46b8b614d4b2bac65d29', 'request_id': 'req-0da05755-480b-4161-aaa5-19dcbf4c5745'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:52:57.831515 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0da05755-480b-4161-aaa5-19dcbf4c5745 admin admin] The token cache is being invalidate because project c9bbd6f61f3b46b8b614d4b2bac65d29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:52:57.831807 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0da05755-480b-4161-aaa5-19dcbf4c5745 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:52:57.832446 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-0da05755-480b-4161-aaa5-19dcbf4c5745 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:52:57.834039 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1266/2574] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:52:57 2022] DELETE /identity/v3/projects/c9bbd6f61f3b46b8b614d4b2bac65d29 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:52:57.838143 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629df422-e6ec-41e5-876c-a5261ccec2fd service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:52:57.847898 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629df422-e6ec-41e5-876c-a5261ccec2fd service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:52:57.903851 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec730b9-e4d6-4e37-a9ee-0f98b9b31849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:52:57.904752 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec730b9-e4d6-4e37-a9ee-0f98b9b31849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:57.905106 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec730b9-e4d6-4e37-a9ee-0f98b9b31849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:57.905458 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec730b9-e4d6-4e37-a9ee-0f98b9b31849 admin admin] PATH_INFO: `/v3/users/507458985c494f67bdd3d9101d3de8f9` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:57.907277 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec730b9-e4d6-4e37-a9ee-0f98b9b31849 admin admin] RBAC: Authorizing `identity:delete_user(user_id=507458985c494f67bdd3d9101d3de8f9)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:52:57.909195 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec730b9-e4d6-4e37-a9ee-0f98b9b31849 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:52:57.958861 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-aec730b9-e4d6-4e37-a9ee-0f98b9b31849 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '507458985c494f67bdd3d9101d3de8f9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:52:57.959553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-aec730b9-e4d6-4e37-a9ee-0f98b9b31849 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '507458985c494f67bdd3d9101d3de8f9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:52:57.960183 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-aec730b9-e4d6-4e37-a9ee-0f98b9b31849 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '507458985c494f67bdd3d9101d3de8f9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:52:57.967097 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-aec730b9-e4d6-4e37-a9ee-0f98b9b31849 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '507458985c494f67bdd3d9101d3de8f9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:52:57.976084 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-aec730b9-e4d6-4e37-a9ee-0f98b9b31849 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '507458985c494f67bdd3d9101d3de8f9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:52:57.994269 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1309/2575] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:52:57 2022] DELETE /identity/v3/users/507458985c494f67bdd3d9101d3de8f9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:52:58.474213 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da05755-480b-4161-aaa5-19dcbf4c5745 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:52:58.475831 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0da05755-480b-4161-aaa5-19dcbf4c5745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:52:58.490614 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da05755-480b-4161-aaa5-19dcbf4c5745 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:52:58.555137 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24286dd2-a23d-4588-8549-100ec8613ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:52:58.556085 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24286dd2-a23d-4588-8549-100ec8613ca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:58.556466 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24286dd2-a23d-4588-8549-100ec8613ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:58.556813 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24286dd2-a23d-4588-8549-100ec8613ca4 admin admin] PATH_INFO: `/v3/projects/2d33b5c1288246f8851fa7437e375d64` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:58.558086 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24286dd2-a23d-4588-8549-100ec8613ca4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d33b5c1288246f8851fa7437e375d64)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:52:58.560036 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24286dd2-a23d-4588-8549-100ec8613ca4 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:52:58.608194 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-24286dd2-a23d-4588-8549-100ec8613ca4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d33b5c1288246f8851fa7437e375d64', 'request_id': 'req-24286dd2-a23d-4588-8549-100ec8613ca4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:52:58.614408 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-24286dd2-a23d-4588-8549-100ec8613ca4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d33b5c1288246f8851fa7437e375d64', 'request_id': 'req-24286dd2-a23d-4588-8549-100ec8613ca4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:52:58.622037 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-24286dd2-a23d-4588-8549-100ec8613ca4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d33b5c1288246f8851fa7437e375d64', 'request_id': 'req-24286dd2-a23d-4588-8549-100ec8613ca4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:52:58.634249 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-24286dd2-a23d-4588-8549-100ec8613ca4 admin admin] The token cache is being invalidate because project 2d33b5c1288246f8851fa7437e375d64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:52:58.634583 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-24286dd2-a23d-4588-8549-100ec8613ca4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:52:58.635234 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-24286dd2-a23d-4588-8549-100ec8613ca4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:52:58.636799 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1267/2576] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:52:58 2022] DELETE /identity/v3/projects/2d33b5c1288246f8851fa7437e375d64 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:52:58.642246 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54fe06-5116-4fe0-a0ba-c1cf0cb633c8 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:58.642760 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54fe06-5116-4fe0-a0ba-c1cf0cb633c8 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:58.642899 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54fe06-5116-4fe0-a0ba-c1cf0cb633c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:58.655646 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:52:58.663281 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-7f54fe06-5116-4fe0-a0ba-c1cf0cb633c8 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:52:58.665367 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7f54fe06-5116-4fe0-a0ba-c1cf0cb633c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:52:58.736477 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1310/2577] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:52:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:52:58.744300 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1918339-8bbb-4f3c-8974-8bc35f044b9b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:58.744427 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1918339-8bbb-4f3c-8974-8bc35f044b9b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:58.744688 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1918339-8bbb-4f3c-8974-8bc35f044b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:58.769084 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-f1918339-8bbb-4f3c-8974-8bc35f044b9b None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:52:58.770333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f1918339-8bbb-4f3c-8974-8bc35f044b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:52:58.779011 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1268/2578] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:52:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:52:58.783514 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54fe06-5116-4fe0-a0ba-c1cf0cb633c8 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:52:58.795088 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54fe06-5116-4fe0-a0ba-c1cf0cb633c8 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:52:58.800145 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab29f6-fd37-479d-b5dc-b8073d721e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:52:58.801048 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab29f6-fd37-479d-b5dc-b8073d721e4a admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:58.801431 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab29f6-fd37-479d-b5dc-b8073d721e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:58.801809 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab29f6-fd37-479d-b5dc-b8073d721e4a admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:58.802699 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ab29f6-fd37-479d-b5dc-b8073d721e4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:52:58.803213 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ab29f6-fd37-479d-b5dc-b8073d721e4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:52:58.804923 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ab29f6-fd37-479d-b5dc-b8073d721e4a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:52:58.820867 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1311/2579] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:52:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:52:58.825290 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1918339-8bbb-4f3c-8974-8bc35f044b9b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:52:58.836093 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1918339-8bbb-4f3c-8974-8bc35f044b9b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:52:58.841107 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6372bbce-6086-43dc-9ee3-423fcda0fbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:52:58.841932 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372bbce-6086-43dc-9ee3-423fcda0fbf6 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:58.842336 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372bbce-6086-43dc-9ee3-423fcda0fbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:58.842701 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6372bbce-6086-43dc-9ee3-423fcda0fbf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:58.843566 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6372bbce-6086-43dc-9ee3-423fcda0fbf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:52:58.845719 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6372bbce-6086-43dc-9ee3-423fcda0fbf6 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:52:58.879553 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1269/2580] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:52:58 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:52:58.883624 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab29f6-fd37-479d-b5dc-b8073d721e4a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:52:58.894398 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab29f6-fd37-479d-b5dc-b8073d721e4a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:52:58.956651 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c13d99a-1e53-4775-97fb-b9100581b721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:52:58.957329 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13d99a-1e53-4775-97fb-b9100581b721 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:58.957617 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13d99a-1e53-4775-97fb-b9100581b721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:58.957905 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c13d99a-1e53-4775-97fb-b9100581b721 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:58.958627 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c13d99a-1e53-4775-97fb-b9100581b721 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:52:58.960950 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c13d99a-1e53-4775-97fb-b9100581b721 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:52:58.983323 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1312/2581] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:52:58 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:52:58.987939 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6372bbce-6086-43dc-9ee3-423fcda0fbf6 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:52:58.998896 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6372bbce-6086-43dc-9ee3-423fcda0fbf6 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:52:59.003652 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863a731-2ee6-4244-97c7-6a3fd359e8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:52:59.004345 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863a731-2ee6-4244-97c7-6a3fd359e8ed admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:59.004684 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863a731-2ee6-4244-97c7-6a3fd359e8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:59.004941 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6863a731-2ee6-4244-97c7-6a3fd359e8ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:59.005678 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863a731-2ee6-4244-97c7-6a3fd359e8ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:52:59.007327 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6863a731-2ee6-4244-97c7-6a3fd359e8ed admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:52:59.008621 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:52:59.024046 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1270/2582] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:52:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:52:59.024549 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c13d99a-1e53-4775-97fb-b9100581b721 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:52:59.036224 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c13d99a-1e53-4775-97fb-b9100581b721 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:52:59.040857 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb789fe0-a7cd-4ec9-a623-b5aba8b428b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:52:59.041525 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb789fe0-a7cd-4ec9-a623-b5aba8b428b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:59.041812 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb789fe0-a7cd-4ec9-a623-b5aba8b428b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:59.042090 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb789fe0-a7cd-4ec9-a623-b5aba8b428b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:59.042912 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb789fe0-a7cd-4ec9-a623-b5aba8b428b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:52:59.044504 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb789fe0-a7cd-4ec9-a623-b5aba8b428b2 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:52:59.054973 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1313/2583] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 03:52:59.059104 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863a731-2ee6-4244-97c7-6a3fd359e8ed admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:52:59.069080 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6863a731-2ee6-4244-97c7-6a3fd359e8ed admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:52:59.073682 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13ca15-de40-40e8-af4d-56c249c62e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:52:59.074615 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13ca15-de40-40e8-af4d-56c249c62e4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:59.074921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13ca15-de40-40e8-af4d-56c249c62e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:59.075183 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13ca15-de40-40e8-af4d-56c249c62e4c admin admin] PATH_INFO: `/v3/projects/c2b48b766093404ca0997aa914fab2ab/users/cb1e742aeb6d4fcb9b80774f20f3d9c1/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:59.091074 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb13ca15-de40-40e8-af4d-56c249c62e4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2b48b766093404ca0997aa914fab2ab, user_id=cb1e742aeb6d4fcb9b80774f20f3d9c1, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:52:59.094419 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb13ca15-de40-40e8-af4d-56c249c62e4c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:52:59.110243 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1271/2584] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:52:59 2022] PUT /identity/v3/projects/c2b48b766093404ca0997aa914fab2ab/users/cb1e742aeb6d4fcb9b80774f20f3d9c1/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:52:59.120541 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aff2cc-536f-42fa-b913-bbf898ec5d62 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:59.120834 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aff2cc-536f-42fa-b913-bbf898ec5d62 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:59.121111 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aff2cc-536f-42fa-b913-bbf898ec5d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:59.148127 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b8aff2cc-536f-42fa-b913-bbf898ec5d62 None None] MFA Rules not processed for user `cb1e742aeb6d4fcb9b80774f20f3d9c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:52:59.149367 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b8aff2cc-536f-42fa-b913-bbf898ec5d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:52:59.216090 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1314/2585] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:52:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:52:59.221237 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13ca15-de40-40e8-af4d-56c249c62e4c admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:52:59.286485 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13ca15-de40-40e8-af4d-56c249c62e4c admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:52:59.291185 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db900be1-03b3-45c5-aa96-e140315ac246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:52:59.291872 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db900be1-03b3-45c5-aa96-e140315ac246 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:59.292161 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db900be1-03b3-45c5-aa96-e140315ac246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:59.292445 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db900be1-03b3-45c5-aa96-e140315ac246 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:59.293169 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db900be1-03b3-45c5-aa96-e140315ac246 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:52:59.295155 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db900be1-03b3-45c5-aa96-e140315ac246 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:52:59.325162 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1272/2586] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:52:59 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:52:59.326337 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aff2cc-536f-42fa-b913-bbf898ec5d62 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:52:59.332477 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:52:59.340373 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aff2cc-536f-42fa-b913-bbf898ec5d62 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:52:59.398019 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb37ff5-438c-4adb-a4a9-99adb5f2e9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:52:59.398726 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb37ff5-438c-4adb-a4a9-99adb5f2e9c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:59.399012 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb37ff5-438c-4adb-a4a9-99adb5f2e9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:59.399280 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb37ff5-438c-4adb-a4a9-99adb5f2e9c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:59.399980 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb37ff5-438c-4adb-a4a9-99adb5f2e9c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:52:59.401890 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb37ff5-438c-4adb-a4a9-99adb5f2e9c8 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:52:59.425403 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1315/2587] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:52:59 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:52:59.426768 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db900be1-03b3-45c5-aa96-e140315ac246 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:52:59.437668 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db900be1-03b3-45c5-aa96-e140315ac246 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:52:59.442545 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71174fac-222b-44a0-8d84-aee5e57c4284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:52:59.443306 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71174fac-222b-44a0-8d84-aee5e57c4284 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:59.443761 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71174fac-222b-44a0-8d84-aee5e57c4284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:59.444112 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71174fac-222b-44a0-8d84-aee5e57c4284 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:59.444918 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71174fac-222b-44a0-8d84-aee5e57c4284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:52:59.448921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71174fac-222b-44a0-8d84-aee5e57c4284 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:52:59.461301 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1273/2588] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:52:59.465496 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb37ff5-438c-4adb-a4a9-99adb5f2e9c8 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:52:59.477147 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb37ff5-438c-4adb-a4a9-99adb5f2e9c8 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:52:59.481975 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821785c0-96d9-43eb-8fd5-a5e3d21d1819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:52:59.483035 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821785c0-96d9-43eb-8fd5-a5e3d21d1819 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:59.483387 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821785c0-96d9-43eb-8fd5-a5e3d21d1819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:59.483780 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821785c0-96d9-43eb-8fd5-a5e3d21d1819 admin admin] PATH_INFO: `/v3/projects/b685281252364195ac55ed73924f8931/users/614e86cfe22b4d659f9eb76008bfd5d6/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:59.500341 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821785c0-96d9-43eb-8fd5-a5e3d21d1819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b685281252364195ac55ed73924f8931, user_id=614e86cfe22b4d659f9eb76008bfd5d6, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:52:59.503157 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821785c0-96d9-43eb-8fd5-a5e3d21d1819 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:52:59.521810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1316/2589] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:52:59 2022] PUT /identity/v3/projects/b685281252364195ac55ed73924f8931/users/614e86cfe22b4d659f9eb76008bfd5d6/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:52:59.523043 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71174fac-222b-44a0-8d84-aee5e57c4284 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:52:59.534164 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71174fac-222b-44a0-8d84-aee5e57c4284 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:52:59.604966 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59801ca-a326-4421-a36f-699194c299c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:52:59.605785 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59801ca-a326-4421-a36f-699194c299c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:59.606082 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59801ca-a326-4421-a36f-699194c299c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:59.606358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59801ca-a326-4421-a36f-699194c299c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:59.607155 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59801ca-a326-4421-a36f-699194c299c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:52:59.608838 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59801ca-a326-4421-a36f-699194c299c4 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:52:59.620398 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1274/2590] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:52:59.625595 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821785c0-96d9-43eb-8fd5-a5e3d21d1819 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:52:59.636585 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821785c0-96d9-43eb-8fd5-a5e3d21d1819 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:52:59.642924 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c8bed-beef-4f37-87b5-ff1c7aa2bf5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:52:59.644510 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c8bed-beef-4f37-87b5-ff1c7aa2bf5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:59.644952 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c8bed-beef-4f37-87b5-ff1c7aa2bf5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:59.645407 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c8bed-beef-4f37-87b5-ff1c7aa2bf5b admin admin] PATH_INFO: `/v3/projects/b685281252364195ac55ed73924f8931/users/614e86cfe22b4d659f9eb76008bfd5d6/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:59.647700 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965c8bed-beef-4f37-87b5-ff1c7aa2bf5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b685281252364195ac55ed73924f8931, user_id=614e86cfe22b4d659f9eb76008bfd5d6, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:52:59.650451 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965c8bed-beef-4f37-87b5-ff1c7aa2bf5b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:52:59.662871 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1317/2591] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:52:59 2022] PUT /identity/v3/projects/b685281252364195ac55ed73924f8931/users/614e86cfe22b4d659f9eb76008bfd5d6/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:52:59.674184 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0625b-a84c-4e46-8a66-842b65548438 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:59.674519 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0625b-a84c-4e46-8a66-842b65548438 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:59.674799 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b0625b-a84c-4e46-8a66-842b65548438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:59.716258 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-68b0625b-a84c-4e46-8a66-842b65548438 None None] MFA Rules not processed for user `614e86cfe22b4d659f9eb76008bfd5d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:52:59.717627 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-68b0625b-a84c-4e46-8a66-842b65548438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:52:59.748489 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:52:59.797804 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1275/2592] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:52:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:52:59.805702 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c8bed-beef-4f37-87b5-ff1c7aa2bf5b admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:52:59.808070 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-965c8bed-beef-4f37-87b5-ff1c7aa2bf5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:52:59.874972 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c8bed-beef-4f37-87b5-ff1c7aa2bf5b admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:52:59.879840 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42d53f-a8b5-43ff-b6be-71da42961f6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:52:59.880627 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42d53f-a8b5-43ff-b6be-71da42961f6a service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:52:59.880920 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42d53f-a8b5-43ff-b6be-71da42961f6a service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:52:59.881274 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42d53f-a8b5-43ff-b6be-71da42961f6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:52:59.892002 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c42d53f-a8b5-43ff-b6be-71da42961f6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:52:59.893523 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c42d53f-a8b5-43ff-b6be-71da42961f6a service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:52:59.904102 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1318/2593] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:52:59 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:52:59.972024 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b0625b-a84c-4e46-8a66-842b65548438 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:00.049578 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b0625b-a84c-4e46-8a66-842b65548438 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:00.054224 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65a8f4-72e1-4798-969c-e23347e573fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:00.055087 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65a8f4-72e1-4798-969c-e23347e573fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:00.055372 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65a8f4-72e1-4798-969c-e23347e573fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:00.055656 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d65a8f4-72e1-4798-969c-e23347e573fe admin admin] PATH_INFO: `/v3/users/cb1e742aeb6d4fcb9b80774f20f3d9c1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:00.056874 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d65a8f4-72e1-4798-969c-e23347e573fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb1e742aeb6d4fcb9b80774f20f3d9c1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:00.058838 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d65a8f4-72e1-4798-969c-e23347e573fe admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:00.126119 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4d65a8f4-72e1-4798-969c-e23347e573fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb1e742aeb6d4fcb9b80774f20f3d9c1'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:00.126894 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4d65a8f4-72e1-4798-969c-e23347e573fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb1e742aeb6d4fcb9b80774f20f3d9c1'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:00.127517 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4d65a8f4-72e1-4798-969c-e23347e573fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb1e742aeb6d4fcb9b80774f20f3d9c1'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:00.134396 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4d65a8f4-72e1-4798-969c-e23347e573fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb1e742aeb6d4fcb9b80774f20f3d9c1'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:00.141803 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-4d65a8f4-72e1-4798-969c-e23347e573fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb1e742aeb6d4fcb9b80774f20f3d9c1'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:00.160322 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1276/2594] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:52:59 2022] DELETE /identity/v3/users/cb1e742aeb6d4fcb9b80774f20f3d9c1 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:53:00.164823 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee986990-67a1-41fb-aef2-e8374bcd817a None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:00.165123 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee986990-67a1-41fb-aef2-e8374bcd817a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:00.165410 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee986990-67a1-41fb-aef2-e8374bcd817a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:00.185331 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-ee986990-67a1-41fb-aef2-e8374bcd817a None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:00.186640 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ee986990-67a1-41fb-aef2-e8374bcd817a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:00.238775 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:00.249822 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1319/2595] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:53:00.259596 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65a8f4-72e1-4798-969c-e23347e573fe admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:00.261021 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4d65a8f4-72e1-4798-969c-e23347e573fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:00.316034 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:00.322588 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d65a8f4-72e1-4798-969c-e23347e573fe admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:00.327139 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e3036-44f2-40f8-aef3-a96cfb2136b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:00.328063 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e3036-44f2-40f8-aef3-a96cfb2136b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:00.328400 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e3036-44f2-40f8-aef3-a96cfb2136b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:00.328977 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e3036-44f2-40f8-aef3-a96cfb2136b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:00.338304 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e3036-44f2-40f8-aef3-a96cfb2136b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:00.339859 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e3036-44f2-40f8-aef3-a96cfb2136b9 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:00.351241 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1277/2596] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:53:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:53:00.666929 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee986990-67a1-41fb-aef2-e8374bcd817a None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:00.668709 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ee986990-67a1-41fb-aef2-e8374bcd817a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:00.694505 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee986990-67a1-41fb-aef2-e8374bcd817a None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:00.699528 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9908d2-6a95-4494-9b60-5f527d2ffe2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:00.700872 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9908d2-6a95-4494-9b60-5f527d2ffe2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:00.701236 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9908d2-6a95-4494-9b60-5f527d2ffe2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:00.701518 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9908d2-6a95-4494-9b60-5f527d2ffe2c admin admin] PATH_INFO: `/v3/projects/c2b48b766093404ca0997aa914fab2ab` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:00.703517 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9908d2-6a95-4494-9b60-5f527d2ffe2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2b48b766093404ca0997aa914fab2ab)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:00.705952 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9908d2-6a95-4494-9b60-5f527d2ffe2c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:00.761391 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fe9908d2-6a95-4494-9b60-5f527d2ffe2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2b48b766093404ca0997aa914fab2ab', 'request_id': 'req-fe9908d2-6a95-4494-9b60-5f527d2ffe2c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:00.768304 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fe9908d2-6a95-4494-9b60-5f527d2ffe2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2b48b766093404ca0997aa914fab2ab', 'request_id': 'req-fe9908d2-6a95-4494-9b60-5f527d2ffe2c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:00.776671 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fe9908d2-6a95-4494-9b60-5f527d2ffe2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2b48b766093404ca0997aa914fab2ab', 'request_id': 'req-fe9908d2-6a95-4494-9b60-5f527d2ffe2c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:00.789150 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fe9908d2-6a95-4494-9b60-5f527d2ffe2c admin admin] The token cache is being invalidate because project c2b48b766093404ca0997aa914fab2ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:53:00.789442 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fe9908d2-6a95-4494-9b60-5f527d2ffe2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:00.790253 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fe9908d2-6a95-4494-9b60-5f527d2ffe2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:00.791868 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1320/2597] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:53:00 2022] DELETE /identity/v3/projects/c2b48b766093404ca0997aa914fab2ab => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:53:00.795804 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e3036-44f2-40f8-aef3-a96cfb2136b9 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:00.806882 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e3036-44f2-40f8-aef3-a96cfb2136b9 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:00.872783 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331fef7-38bd-4bd0-b1af-9e25f70db509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:00.873691 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331fef7-38bd-4bd0-b1af-9e25f70db509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:00.874024 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331fef7-38bd-4bd0-b1af-9e25f70db509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:00.874362 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331fef7-38bd-4bd0-b1af-9e25f70db509 admin admin] PATH_INFO: `/v3/users/614e86cfe22b4d659f9eb76008bfd5d6` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:00.875576 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331fef7-38bd-4bd0-b1af-9e25f70db509 admin admin] RBAC: Authorizing `identity:delete_user(user_id=614e86cfe22b4d659f9eb76008bfd5d6)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:00.877526 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331fef7-38bd-4bd0-b1af-9e25f70db509 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:00.951155 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b331fef7-38bd-4bd0-b1af-9e25f70db509 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '614e86cfe22b4d659f9eb76008bfd5d6'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:00.952105 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b331fef7-38bd-4bd0-b1af-9e25f70db509 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '614e86cfe22b4d659f9eb76008bfd5d6'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:00.953866 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b331fef7-38bd-4bd0-b1af-9e25f70db509 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '614e86cfe22b4d659f9eb76008bfd5d6'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:00.975267 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b331fef7-38bd-4bd0-b1af-9e25f70db509 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '614e86cfe22b4d659f9eb76008bfd5d6'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:00.986928 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b331fef7-38bd-4bd0-b1af-9e25f70db509 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '614e86cfe22b4d659f9eb76008bfd5d6'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:01.014933 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1278/2598] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:53:00 2022] DELETE /identity/v3/users/614e86cfe22b4d659f9eb76008bfd5d6 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:53:01.126446 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9908d2-6a95-4494-9b60-5f527d2ffe2c admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:01.129303 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-fe9908d2-6a95-4494-9b60-5f527d2ffe2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:01.150390 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9908d2-6a95-4494-9b60-5f527d2ffe2c admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:01.218423 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5688b2-9b6b-4e5e-af3a-7ecec4b0c6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:01.219943 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5688b2-9b6b-4e5e-af3a-7ecec4b0c6d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:01.220444 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5688b2-9b6b-4e5e-af3a-7ecec4b0c6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:01.220720 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5688b2-9b6b-4e5e-af3a-7ecec4b0c6d1 admin admin] PATH_INFO: `/v3/users/52f492a1c5f5474d86a6ac8f0348321b` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:01.221966 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5688b2-9b6b-4e5e-af3a-7ecec4b0c6d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52f492a1c5f5474d86a6ac8f0348321b)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:01.224322 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5688b2-9b6b-4e5e-af3a-7ecec4b0c6d1 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:01.289422 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-8f5688b2-9b6b-4e5e-af3a-7ecec4b0c6d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52f492a1c5f5474d86a6ac8f0348321b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:01.290181 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-8f5688b2-9b6b-4e5e-af3a-7ecec4b0c6d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52f492a1c5f5474d86a6ac8f0348321b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:01.291060 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-8f5688b2-9b6b-4e5e-af3a-7ecec4b0c6d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52f492a1c5f5474d86a6ac8f0348321b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:01.300625 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-8f5688b2-9b6b-4e5e-af3a-7ecec4b0c6d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52f492a1c5f5474d86a6ac8f0348321b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:01.312842 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-8f5688b2-9b6b-4e5e-af3a-7ecec4b0c6d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52f492a1c5f5474d86a6ac8f0348321b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:01.329349 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:01.334565 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1321/2599] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:53:01 2022] DELETE /identity/v3/users/52f492a1c5f5474d86a6ac8f0348321b => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:53:01.361650 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331fef7-38bd-4bd0-b1af-9e25f70db509 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:01.363115 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b331fef7-38bd-4bd0-b1af-9e25f70db509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:01.376868 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331fef7-38bd-4bd0-b1af-9e25f70db509 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:01.443075 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e749b52-4dc7-4a36-a065-26197f2eef2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:01.443962 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e749b52-4dc7-4a36-a065-26197f2eef2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:01.444248 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e749b52-4dc7-4a36-a065-26197f2eef2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:01.444533 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e749b52-4dc7-4a36-a065-26197f2eef2f admin admin] PATH_INFO: `/v3/projects/b685281252364195ac55ed73924f8931` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:01.445812 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e749b52-4dc7-4a36-a065-26197f2eef2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b685281252364195ac55ed73924f8931)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:01.448352 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e749b52-4dc7-4a36-a065-26197f2eef2f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:01.459773 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:01.500784 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9e749b52-4dc7-4a36-a065-26197f2eef2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b685281252364195ac55ed73924f8931', 'request_id': 'req-9e749b52-4dc7-4a36-a065-26197f2eef2f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:01.507340 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9e749b52-4dc7-4a36-a065-26197f2eef2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b685281252364195ac55ed73924f8931', 'request_id': 'req-9e749b52-4dc7-4a36-a065-26197f2eef2f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:01.515742 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9e749b52-4dc7-4a36-a065-26197f2eef2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b685281252364195ac55ed73924f8931', 'request_id': 'req-9e749b52-4dc7-4a36-a065-26197f2eef2f'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:01.528646 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9e749b52-4dc7-4a36-a065-26197f2eef2f admin admin] The token cache is being invalidate because project b685281252364195ac55ed73924f8931 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:53:01.528996 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9e749b52-4dc7-4a36-a065-26197f2eef2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:01.529629 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9e749b52-4dc7-4a36-a065-26197f2eef2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:01.531407 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1279/2600] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:53:01 2022] DELETE /identity/v3/projects/b685281252364195ac55ed73924f8931 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:53:01.536611 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f496ef-8e86-4253-b2fb-e6e08c78634a None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:01.537028 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f496ef-8e86-4253-b2fb-e6e08c78634a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:01.537473 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f496ef-8e86-4253-b2fb-e6e08c78634a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:01.539691 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e749b52-4dc7-4a36-a065-26197f2eef2f admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:01.541020 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9e749b52-4dc7-4a36-a065-26197f2eef2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:01.557737 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d8f496ef-8e86-4253-b2fb-e6e08c78634a None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:01.559037 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d8f496ef-8e86-4253-b2fb-e6e08c78634a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:01.613269 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e749b52-4dc7-4a36-a065-26197f2eef2f admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:01.617886 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832645d6-78a6-42c4-9653-91ba9ef1ee8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:01.618781 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832645d6-78a6-42c4-9653-91ba9ef1ee8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:01.619060 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832645d6-78a6-42c4-9653-91ba9ef1ee8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:01.619360 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832645d6-78a6-42c4-9653-91ba9ef1ee8c admin admin] PATH_INFO: `/v3/projects/2ec8416eb9644c858b0bf3556ad0dfd2` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:01.620571 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832645d6-78a6-42c4-9653-91ba9ef1ee8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ec8416eb9644c858b0bf3556ad0dfd2)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:01.622503 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832645d6-78a6-42c4-9653-91ba9ef1ee8c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:01.622629 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1322/2601] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:53:01.631156 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c34763-d1e9-4db9-8011-d8a75541de53 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:01.631469 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c34763-d1e9-4db9-8011-d8a75541de53 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:01.631764 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c34763-d1e9-4db9-8011-d8a75541de53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:01.650154 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-95c34763-d1e9-4db9-8011-d8a75541de53 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:01.651879 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-95c34763-d1e9-4db9-8011-d8a75541de53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:01.660999 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1323/2602] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:53:01.665719 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c34763-d1e9-4db9-8011-d8a75541de53 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:01.672205 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-832645d6-78a6-42c4-9653-91ba9ef1ee8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ec8416eb9644c858b0bf3556ad0dfd2', 'request_id': 'req-832645d6-78a6-42c4-9653-91ba9ef1ee8c'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:01.675302 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c34763-d1e9-4db9-8011-d8a75541de53 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:01.678614 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-832645d6-78a6-42c4-9653-91ba9ef1ee8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ec8416eb9644c858b0bf3556ad0dfd2', 'request_id': 'req-832645d6-78a6-42c4-9653-91ba9ef1ee8c'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:01.686046 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-832645d6-78a6-42c4-9653-91ba9ef1ee8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ec8416eb9644c858b0bf3556ad0dfd2', 'request_id': 'req-832645d6-78a6-42c4-9653-91ba9ef1ee8c'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:01.697018 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-832645d6-78a6-42c4-9653-91ba9ef1ee8c admin admin] The token cache is being invalidate because project 2ec8416eb9644c858b0bf3556ad0dfd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:53:01.697319 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-832645d6-78a6-42c4-9653-91ba9ef1ee8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:01.698034 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-832645d6-78a6-42c4-9653-91ba9ef1ee8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:01.700034 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1280/2603] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:53:01 2022] DELETE /identity/v3/projects/2ec8416eb9644c858b0bf3556ad0dfd2 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:53:01.704598 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528017c7-59e0-41b9-9b19-f0dfcea99bd8 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:01.704896 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528017c7-59e0-41b9-9b19-f0dfcea99bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:01.705178 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528017c7-59e0-41b9-9b19-f0dfcea99bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:01.725059 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-528017c7-59e0-41b9-9b19-f0dfcea99bd8 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:01.726284 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-528017c7-59e0-41b9-9b19-f0dfcea99bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:01.733377 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c007d74-b4f9-4974-a26c-5a9b43375ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:01.734872 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c007d74-b4f9-4974-a26c-5a9b43375ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:01.735155 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c007d74-b4f9-4974-a26c-5a9b43375ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:01.735432 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c007d74-b4f9-4974-a26c-5a9b43375ba2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:01.736159 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c007d74-b4f9-4974-a26c-5a9b43375ba2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:53:01.736474 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c007d74-b4f9-4974-a26c-5a9b43375ba2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:01.738063 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c007d74-b4f9-4974-a26c-5a9b43375ba2 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:01.749812 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1324/2604] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:53:01.751891 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:01.755016 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c007d74-b4f9-4974-a26c-5a9b43375ba2 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:01.757476 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8c007d74-b4f9-4974-a26c-5a9b43375ba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:01.770307 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c007d74-b4f9-4974-a26c-5a9b43375ba2 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:01.775143 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044edfc-91a1-4cea-b8c5-1f19589b2967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:01.775751 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044edfc-91a1-4cea-b8c5-1f19589b2967 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:01.776041 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044edfc-91a1-4cea-b8c5-1f19589b2967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:01.776318 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9044edfc-91a1-4cea-b8c5-1f19589b2967 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:01.777006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9044edfc-91a1-4cea-b8c5-1f19589b2967 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:01.778920 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9044edfc-91a1-4cea-b8c5-1f19589b2967 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:01.792103 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1281/2605] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:53:01.800737 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb9432-42e5-4826-b77f-3ffac490d807 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:01.801331 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb9432-42e5-4826-b77f-3ffac490d807 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:01.801469 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb9432-42e5-4826-b77f-3ffac490d807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:01.811508 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1325/2606] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:53:01 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:53:01.812512 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044edfc-91a1-4cea-b8c5-1f19589b2967 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:01.819994 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-34cb9432-42e5-4826-b77f-3ffac490d807 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:01.821198 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-34cb9432-42e5-4826-b77f-3ffac490d807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:01.873848 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9044edfc-91a1-4cea-b8c5-1f19589b2967 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:01.878659 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e473f2b-eeb4-4fb8-96c9-b5b430bb1587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:01.879336 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e473f2b-eeb4-4fb8-96c9-b5b430bb1587 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:01.879623 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e473f2b-eeb4-4fb8-96c9-b5b430bb1587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:01.879905 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e473f2b-eeb4-4fb8-96c9-b5b430bb1587 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:01.880448 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1282/2607] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:53:01.880633 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e473f2b-eeb4-4fb8-96c9-b5b430bb1587 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:01.882585 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e473f2b-eeb4-4fb8-96c9-b5b430bb1587 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:01.884643 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb9432-42e5-4826-b77f-3ffac490d807 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:01.892435 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:01.894073 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb9432-42e5-4826-b77f-3ffac490d807 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:01.900393 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae56904-edbb-4c60-b55e-eeb27455c6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:01.901202 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae56904-edbb-4c60-b55e-eeb27455c6c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:01.901486 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae56904-edbb-4c60-b55e-eeb27455c6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:01.901783 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae56904-edbb-4c60-b55e-eeb27455c6c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:01.902863 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae56904-edbb-4c60-b55e-eeb27455c6c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:53:01.903155 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae56904-edbb-4c60-b55e-eeb27455c6c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:01.904425 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1326/2608] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:53:01 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:53:01.907235 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae56904-edbb-4c60-b55e-eeb27455c6c2 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:01.908760 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e473f2b-eeb4-4fb8-96c9-b5b430bb1587 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:01.918737 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e473f2b-eeb4-4fb8-96c9-b5b430bb1587 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:01.923867 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1283/2609] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:53:01.924208 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33702c9c-75a2-4720-976a-59b18527770a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:01.924810 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae56904-edbb-4c60-b55e-eeb27455c6c2 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:01.925139 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33702c9c-75a2-4720-976a-59b18527770a admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:01.925503 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33702c9c-75a2-4720-976a-59b18527770a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:01.925859 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33702c9c-75a2-4720-976a-59b18527770a admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:01.926951 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33702c9c-75a2-4720-976a-59b18527770a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:01.928742 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33702c9c-75a2-4720-976a-59b18527770a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:01.938027 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae56904-edbb-4c60-b55e-eeb27455c6c2 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:01.939937 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1327/2610] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 03:53:01.943832 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33702c9c-75a2-4720-976a-59b18527770a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:01.945776 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2556a78-7380-4773-a902-371917100803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:01.946428 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2556a78-7380-4773-a902-371917100803 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:01.946867 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2556a78-7380-4773-a902-371917100803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:01.947142 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2556a78-7380-4773-a902-371917100803 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:01.947853 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2556a78-7380-4773-a902-371917100803 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:01.949743 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2556a78-7380-4773-a902-371917100803 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:01.953319 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33702c9c-75a2-4720-976a-59b18527770a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:01.957951 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ccfcb-f42d-4cda-81d5-13d50db9f7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:01.958626 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ccfcb-f42d-4cda-81d5-13d50db9f7ad admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:01.958914 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ccfcb-f42d-4cda-81d5-13d50db9f7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:01.959188 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ccfcb-f42d-4cda-81d5-13d50db9f7ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:01.959902 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ccfcb-f42d-4cda-81d5-13d50db9f7ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:01.961463 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ccfcb-f42d-4cda-81d5-13d50db9f7ad admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:01.972626 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1328/2611] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 03:53:01.976755 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ccfcb-f42d-4cda-81d5-13d50db9f7ad admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:01.981122 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1284/2612] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:53:01 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:53:01.982078 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2556a78-7380-4773-a902-371917100803 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:01.987635 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ccfcb-f42d-4cda-81d5-13d50db9f7ad admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:02.045588 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2556a78-7380-4773-a902-371917100803 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:02.045801 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acc439-6721-4f9a-bd7d-5fcdc2bd7422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:02.046658 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acc439-6721-4f9a-bd7d-5fcdc2bd7422 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:02.046949 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acc439-6721-4f9a-bd7d-5fcdc2bd7422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:02.047230 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acc439-6721-4f9a-bd7d-5fcdc2bd7422 admin admin] PATH_INFO: `/v3/projects/e8ea5cc8f3c0400a934f947a2712f67f/users/35391b2a76424441baca45ec8e8d52de/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:02.050309 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3dfd9e-f372-4d45-9173-0e6012ed2bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:02.052366 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3dfd9e-f372-4d45-9173-0e6012ed2bce admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:02.052366 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3dfd9e-f372-4d45-9173-0e6012ed2bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:02.052366 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3dfd9e-f372-4d45-9173-0e6012ed2bce admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:02.052366 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3dfd9e-f372-4d45-9173-0e6012ed2bce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:02.054121 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3dfd9e-f372-4d45-9173-0e6012ed2bce admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:02.061864 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acc439-6721-4f9a-bd7d-5fcdc2bd7422 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8ea5cc8f3c0400a934f947a2712f67f, user_id=35391b2a76424441baca45ec8e8d52de, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:02.064531 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acc439-6721-4f9a-bd7d-5fcdc2bd7422 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:02.076045 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1285/2613] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:53:01 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:53:02.080573 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3dfd9e-f372-4d45-9173-0e6012ed2bce admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:02.082358 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1329/2614] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:53:01 2022] PUT /identity/v3/projects/e8ea5cc8f3c0400a934f947a2712f67f/users/35391b2a76424441baca45ec8e8d52de/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:53:02.091018 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3dfd9e-f372-4d45-9173-0e6012ed2bce admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:02.092280 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010a810-8a73-43de-9ba8-00717f672940 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:02.092576 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010a810-8a73-43de-9ba8-00717f672940 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:02.092856 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010a810-8a73-43de-9ba8-00717f672940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:02.112731 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:02.120164 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-8010a810-8a73-43de-9ba8-00717f672940 None None] MFA Rules not processed for user `35391b2a76424441baca45ec8e8d52de`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:02.121393 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8010a810-8a73-43de-9ba8-00717f672940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:02.149725 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35925ef6-a65e-4baa-84a5-f0fd1cc81e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:02.150317 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35925ef6-a65e-4baa-84a5-f0fd1cc81e23 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:02.150647 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35925ef6-a65e-4baa-84a5-f0fd1cc81e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:02.150922 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35925ef6-a65e-4baa-84a5-f0fd1cc81e23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:02.151647 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35925ef6-a65e-4baa-84a5-f0fd1cc81e23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:02.153249 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35925ef6-a65e-4baa-84a5-f0fd1cc81e23 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:02.164101 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1286/2615] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 03:53:02.167941 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35925ef6-a65e-4baa-84a5-f0fd1cc81e23 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:02.177445 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35925ef6-a65e-4baa-84a5-f0fd1cc81e23 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:02.182038 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c2c74-d7a5-46eb-96cd-87f7a29b44b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:02.182729 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c2c74-d7a5-46eb-96cd-87f7a29b44b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:02.183022 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c2c74-d7a5-46eb-96cd-87f7a29b44b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:02.183299 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5c2c74-d7a5-46eb-96cd-87f7a29b44b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:02.184011 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5c2c74-d7a5-46eb-96cd-87f7a29b44b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:02.185587 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5c2c74-d7a5-46eb-96cd-87f7a29b44b2 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:02.186012 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1330/2616] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:53:02.195358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1287/2617] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 03:53:02.196846 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010a810-8a73-43de-9ba8-00717f672940 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:02.198558 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8010a810-8a73-43de-9ba8-00717f672940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:02.199204 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c2c74-d7a5-46eb-96cd-87f7a29b44b2 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:02.208962 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5c2c74-d7a5-46eb-96cd-87f7a29b44b2 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:02.213517 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a558a6-7b7d-4af1-8127-cf76c8e4c32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:02.214380 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a558a6-7b7d-4af1-8127-cf76c8e4c32d admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:02.214698 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a558a6-7b7d-4af1-8127-cf76c8e4c32d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:02.214978 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a558a6-7b7d-4af1-8127-cf76c8e4c32d admin admin] PATH_INFO: `/v3/projects/98771687337c425b95c7081b7ba7107f/users/de4d3e60c0e3473db2bd437a3b0f968b/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:02.230181 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a558a6-7b7d-4af1-8127-cf76c8e4c32d admin admin] RBAC: Authorizing `identity:create_grant(project_id=98771687337c425b95c7081b7ba7107f, user_id=de4d3e60c0e3473db2bd437a3b0f968b, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:02.232869 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a558a6-7b7d-4af1-8127-cf76c8e4c32d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:02.247140 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1288/2618] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:53:02 2022] PUT /identity/v3/projects/98771687337c425b95c7081b7ba7107f/users/de4d3e60c0e3473db2bd437a3b0f968b/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:53:02.256750 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:02.258408 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cafae3-d5ec-4f0e-845c-79fe38cac6c0 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:02.258564 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010a810-8a73-43de-9ba8-00717f672940 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:02.258730 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cafae3-d5ec-4f0e-845c-79fe38cac6c0 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:02.259006 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cafae3-d5ec-4f0e-845c-79fe38cac6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:02.285720 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-70cafae3-d5ec-4f0e-845c-79fe38cac6c0 None None] MFA Rules not processed for user `de4d3e60c0e3473db2bd437a3b0f968b`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:02.286955 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-70cafae3-d5ec-4f0e-845c-79fe38cac6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:02.309879 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b4818-7113-4740-9e78-60ea60451d7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:02.310580 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b4818-7113-4740-9e78-60ea60451d7f service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:02.310886 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b4818-7113-4740-9e78-60ea60451d7f service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:02.311162 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b4818-7113-4740-9e78-60ea60451d7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:02.354722 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1289/2619] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:53:02.365739 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cafae3-d5ec-4f0e-845c-79fe38cac6c0 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:02.367119 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-70cafae3-d5ec-4f0e-845c-79fe38cac6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:02.372122 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b4818-7113-4740-9e78-60ea60451d7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:02.373619 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b4818-7113-4740-9e78-60ea60451d7f service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:02.382831 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1331/2620] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:53:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:53:02.445257 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cafae3-d5ec-4f0e-845c-79fe38cac6c0 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:02.450899 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934cad7-6190-4ef4-b0dd-f3fcd0ad0e50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:02.451545 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934cad7-6190-4ef4-b0dd-f3fcd0ad0e50 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:02.451829 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934cad7-6190-4ef4-b0dd-f3fcd0ad0e50 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:02.452106 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934cad7-6190-4ef4-b0dd-f3fcd0ad0e50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:02.460517 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f934cad7-6190-4ef4-b0dd-f3fcd0ad0e50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:02.462148 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f934cad7-6190-4ef4-b0dd-f3fcd0ad0e50 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:02.466911 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:02.472885 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1290/2621] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:53:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 03:53:05.174605 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b4818-7113-4740-9e78-60ea60451d7f service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:05.232973 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b4818-7113-4740-9e78-60ea60451d7f service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:05.237735 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac88e92-e79b-4b84-8c45-60e11decc60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:05.238643 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac88e92-e79b-4b84-8c45-60e11decc60d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:05.238928 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac88e92-e79b-4b84-8c45-60e11decc60d admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:05.239207 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac88e92-e79b-4b84-8c45-60e11decc60d admin admin] PATH_INFO: `/v3/users/de4d3e60c0e3473db2bd437a3b0f968b` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:05.240424 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac88e92-e79b-4b84-8c45-60e11decc60d admin admin] RBAC: Authorizing `identity:delete_user(user_id=de4d3e60c0e3473db2bd437a3b0f968b)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:05.242351 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac88e92-e79b-4b84-8c45-60e11decc60d admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:05.287406 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4ac88e92-e79b-4b84-8c45-60e11decc60d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de4d3e60c0e3473db2bd437a3b0f968b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:05.288052 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4ac88e92-e79b-4b84-8c45-60e11decc60d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de4d3e60c0e3473db2bd437a3b0f968b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:05.288652 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4ac88e92-e79b-4b84-8c45-60e11decc60d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de4d3e60c0e3473db2bd437a3b0f968b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:05.295620 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4ac88e92-e79b-4b84-8c45-60e11decc60d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de4d3e60c0e3473db2bd437a3b0f968b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:05.298181 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:05.303481 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-4ac88e92-e79b-4b84-8c45-60e11decc60d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de4d3e60c0e3473db2bd437a3b0f968b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:05.323414 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1332/2622] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:53:05 2022] DELETE /identity/v3/users/de4d3e60c0e3473db2bd437a3b0f968b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:53:05.327981 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c22495-f2a6-4199-8166-64db866a1fba None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:05.328471 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c22495-f2a6-4199-8166-64db866a1fba None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:05.328569 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c22495-f2a6-4199-8166-64db866a1fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:05.346587 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-f3c22495-f2a6-4199-8166-64db866a1fba None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:05.347793 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f3c22495-f2a6-4199-8166-64db866a1fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:05.390122 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac88e92-e79b-4b84-8c45-60e11decc60d admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:05.391524 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-4ac88e92-e79b-4b84-8c45-60e11decc60d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:05.407080 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1291/2623] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:53:05.417402 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c22495-f2a6-4199-8166-64db866a1fba None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:05.418798 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f3c22495-f2a6-4199-8166-64db866a1fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:05.458120 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac88e92-e79b-4b84-8c45-60e11decc60d admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:05.462863 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a26e4e-4ad6-4d68-abe3-6e70bc74620c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:05.463738 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a26e4e-4ad6-4d68-abe3-6e70bc74620c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:05.464020 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a26e4e-4ad6-4d68-abe3-6e70bc74620c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:05.464298 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a26e4e-4ad6-4d68-abe3-6e70bc74620c admin admin] PATH_INFO: `/v3/users/35391b2a76424441baca45ec8e8d52de` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:05.465492 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a26e4e-4ad6-4d68-abe3-6e70bc74620c admin admin] RBAC: Authorizing `identity:delete_user(user_id=35391b2a76424441baca45ec8e8d52de)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:05.467453 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a26e4e-4ad6-4d68-abe3-6e70bc74620c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:05.475460 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c22495-f2a6-4199-8166-64db866a1fba None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:05.479068 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d2135-5e0f-41f7-9f79-3d89f49ce40f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:05.479719 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d2135-5e0f-41f7-9f79-3d89f49ce40f service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:05.480004 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d2135-5e0f-41f7-9f79-3d89f49ce40f service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:05.480282 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d2135-5e0f-41f7-9f79-3d89f49ce40f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:05.489292 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170d2135-5e0f-41f7-9f79-3d89f49ce40f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:05.490990 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170d2135-5e0f-41f7-9f79-3d89f49ce40f service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:05.501530 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1292/2624] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:53:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 03:53:05.512728 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-01a26e4e-4ad6-4d68-abe3-6e70bc74620c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35391b2a76424441baca45ec8e8d52de'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:05.513405 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-01a26e4e-4ad6-4d68-abe3-6e70bc74620c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35391b2a76424441baca45ec8e8d52de'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:05.514025 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-01a26e4e-4ad6-4d68-abe3-6e70bc74620c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35391b2a76424441baca45ec8e8d52de'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:05.521674 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-01a26e4e-4ad6-4d68-abe3-6e70bc74620c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35391b2a76424441baca45ec8e8d52de'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:05.528346 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-01a26e4e-4ad6-4d68-abe3-6e70bc74620c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35391b2a76424441baca45ec8e8d52de'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:05.555152 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1333/2625] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:53:05 2022] DELETE /identity/v3/users/35391b2a76424441baca45ec8e8d52de => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:53:05.559864 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d4ff8-f8f7-44a1-bbaf-13d655d6370b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:05.560155 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d4ff8-f8f7-44a1-bbaf-13d655d6370b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:05.560434 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d4ff8-f8f7-44a1-bbaf-13d655d6370b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:05.579180 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-c82d4ff8-f8f7-44a1-bbaf-13d655d6370b None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:05.580933 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c82d4ff8-f8f7-44a1-bbaf-13d655d6370b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:05.640682 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1293/2626] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:53:05.653547 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a26e4e-4ad6-4d68-abe3-6e70bc74620c admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:05.654926 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-01a26e4e-4ad6-4d68-abe3-6e70bc74620c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:05.718827 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a26e4e-4ad6-4d68-abe3-6e70bc74620c admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:05.722790 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b9139-cd64-487d-9042-c2764b47b1d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:05.723582 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b9139-cd64-487d-9042-c2764b47b1d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:05.723883 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b9139-cd64-487d-9042-c2764b47b1d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:05.724294 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b9139-cd64-487d-9042-c2764b47b1d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:05.734547 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b9139-cd64-487d-9042-c2764b47b1d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:05.736641 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b9139-cd64-487d-9042-c2764b47b1d8 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:05.740671 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:05.747353 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1334/2627] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:53:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:53:05.788608 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d4ff8-f8f7-44a1-bbaf-13d655d6370b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:05.790278 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c82d4ff8-f8f7-44a1-bbaf-13d655d6370b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:05.806408 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d4ff8-f8f7-44a1-bbaf-13d655d6370b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:05.813387 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd948841-8b5f-4f3c-8fc3-eaf45bf8c03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:05.814767 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd948841-8b5f-4f3c-8fc3-eaf45bf8c03c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:05.815088 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd948841-8b5f-4f3c-8fc3-eaf45bf8c03c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:05.815654 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd948841-8b5f-4f3c-8fc3-eaf45bf8c03c admin admin] PATH_INFO: `/v3/projects/98771687337c425b95c7081b7ba7107f` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:05.817338 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd948841-8b5f-4f3c-8fc3-eaf45bf8c03c admin admin] RBAC: Authorizing `identity:delete_project(project_id=98771687337c425b95c7081b7ba7107f)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:05.819679 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd948841-8b5f-4f3c-8fc3-eaf45bf8c03c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:05.864153 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:05.873176 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-bd948841-8b5f-4f3c-8fc3-eaf45bf8c03c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98771687337c425b95c7081b7ba7107f', 'request_id': 'req-bd948841-8b5f-4f3c-8fc3-eaf45bf8c03c'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:05.879684 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-bd948841-8b5f-4f3c-8fc3-eaf45bf8c03c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98771687337c425b95c7081b7ba7107f', 'request_id': 'req-bd948841-8b5f-4f3c-8fc3-eaf45bf8c03c'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:05.887259 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-bd948841-8b5f-4f3c-8fc3-eaf45bf8c03c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98771687337c425b95c7081b7ba7107f', 'request_id': 'req-bd948841-8b5f-4f3c-8fc3-eaf45bf8c03c'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:05.901620 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-bd948841-8b5f-4f3c-8fc3-eaf45bf8c03c admin admin] The token cache is being invalidate because project 98771687337c425b95c7081b7ba7107f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:53:05.901923 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-bd948841-8b5f-4f3c-8fc3-eaf45bf8c03c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:05.902630 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-bd948841-8b5f-4f3c-8fc3-eaf45bf8c03c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:05.904260 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1294/2628] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:53:05 2022] DELETE /identity/v3/projects/98771687337c425b95c7081b7ba7107f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:53:05.910728 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cd824-1295-42eb-a777-6083b05404d6 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:05.911050 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cd824-1295-42eb-a777-6083b05404d6 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:05.911347 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cd824-1295-42eb-a777-6083b05404d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:05.931056 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-fc0cd824-1295-42eb-a777-6083b05404d6 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:05.932255 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-fc0cd824-1295-42eb-a777-6083b05404d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:05.992574 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1335/2629] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:53:06.000209 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f8eb9-b93c-4c67-b5d2-ecab8ce689b3 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:06.000502 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f8eb9-b93c-4c67-b5d2-ecab8ce689b3 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:06.000785 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944f8eb9-b93c-4c67-b5d2-ecab8ce689b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:06.020518 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-944f8eb9-b93c-4c67-b5d2-ecab8ce689b3 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:06.021905 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-944f8eb9-b93c-4c67-b5d2-ecab8ce689b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:06.034257 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1295/2630] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:53:06.034931 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cd824-1295-42eb-a777-6083b05404d6 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:06.034931 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-fc0cd824-1295-42eb-a777-6083b05404d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:06.035945 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f8eb9-b93c-4c67-b5d2-ecab8ce689b3 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:06.047523 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cd824-1295-42eb-a777-6083b05404d6 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:06.051696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944f8eb9-b93c-4c67-b5d2-ecab8ce689b3 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:06.052646 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf58f9c-00db-415e-b4c4-96c4a6aaf01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:06.053518 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf58f9c-00db-415e-b4c4-96c4a6aaf01b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:06.053805 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf58f9c-00db-415e-b4c4-96c4a6aaf01b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:06.054084 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf58f9c-00db-415e-b4c4-96c4a6aaf01b admin admin] PATH_INFO: `/v3/projects/e8ea5cc8f3c0400a934f947a2712f67f` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:06.055332 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf58f9c-00db-415e-b4c4-96c4a6aaf01b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8ea5cc8f3c0400a934f947a2712f67f)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:06.057242 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf58f9c-00db-415e-b4c4-96c4a6aaf01b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:06.057376 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3c34f-0687-4a43-a420-71173ccf2698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:06.058038 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3c34f-0687-4a43-a420-71173ccf2698 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:06.058419 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3c34f-0687-4a43-a420-71173ccf2698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:06.058819 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3c34f-0687-4a43-a420-71173ccf2698 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:06.059839 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa3c34f-0687-4a43-a420-71173ccf2698 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:53:06.060030 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa3c34f-0687-4a43-a420-71173ccf2698 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:06.062695 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa3c34f-0687-4a43-a420-71173ccf2698 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:06.075163 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1296/2631] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:53:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:53:06.079391 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3c34f-0687-4a43-a420-71173ccf2698 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:06.090044 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa3c34f-0687-4a43-a420-71173ccf2698 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:06.096598 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a2e3d-2751-4eca-ac24-81917402727b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:06.097253 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a2e3d-2751-4eca-ac24-81917402727b admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:06.097541 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a2e3d-2751-4eca-ac24-81917402727b admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:06.097821 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a2e3d-2751-4eca-ac24-81917402727b admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:06.098546 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a2e3d-2751-4eca-ac24-81917402727b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:06.100477 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a2e3d-2751-4eca-ac24-81917402727b admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:06.108701 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fdf58f9c-00db-415e-b4c4-96c4a6aaf01b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8ea5cc8f3c0400a934f947a2712f67f', 'request_id': 'req-fdf58f9c-00db-415e-b4c4-96c4a6aaf01b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:06.115502 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fdf58f9c-00db-415e-b4c4-96c4a6aaf01b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8ea5cc8f3c0400a934f947a2712f67f', 'request_id': 'req-fdf58f9c-00db-415e-b4c4-96c4a6aaf01b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:06.123354 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fdf58f9c-00db-415e-b4c4-96c4a6aaf01b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8ea5cc8f3c0400a934f947a2712f67f', 'request_id': 'req-fdf58f9c-00db-415e-b4c4-96c4a6aaf01b'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:06.128229 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1297/2632] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:53:06 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:53:06.132196 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a2e3d-2751-4eca-ac24-81917402727b admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:06.136951 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fdf58f9c-00db-415e-b4c4-96c4a6aaf01b admin admin] The token cache is being invalidate because project e8ea5cc8f3c0400a934f947a2712f67f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:53:06.137244 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fdf58f9c-00db-415e-b4c4-96c4a6aaf01b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:06.137899 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-fdf58f9c-00db-415e-b4c4-96c4a6aaf01b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:06.139468 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1336/2633] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:53:06 2022] DELETE /identity/v3/projects/e8ea5cc8f3c0400a934f947a2712f67f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:53:06.144794 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae847d3f-f72a-46d4-ba9a-1b00e35375eb None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:06.145030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae847d3f-f72a-46d4-ba9a-1b00e35375eb None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:06.145314 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae847d3f-f72a-46d4-ba9a-1b00e35375eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:06.163496 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-ae847d3f-f72a-46d4-ba9a-1b00e35375eb None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:06.164703 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ae847d3f-f72a-46d4-ba9a-1b00e35375eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:06.196016 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a2e3d-2751-4eca-ac24-81917402727b admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:06.200744 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05816c-e97f-4b93-8b2f-924789fae0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:06.201409 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05816c-e97f-4b93-8b2f-924789fae0e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:06.201701 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05816c-e97f-4b93-8b2f-924789fae0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:06.201993 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05816c-e97f-4b93-8b2f-924789fae0e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:06.202708 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c05816c-e97f-4b93-8b2f-924789fae0e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:06.204628 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c05816c-e97f-4b93-8b2f-924789fae0e7 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:06.224175 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1337/2634] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:53:06.228245 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1298/2635] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:53:06 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:53:06.229295 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae847d3f-f72a-46d4-ba9a-1b00e35375eb None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:06.230703 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ae847d3f-f72a-46d4-ba9a-1b00e35375eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:06.231435 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245efdd-3c43-4c93-be02-4847d8af2c91 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:06.231728 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245efdd-3c43-4c93-be02-4847d8af2c91 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:06.232006 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5245efdd-3c43-4c93-be02-4847d8af2c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:06.242438 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae847d3f-f72a-46d4-ba9a-1b00e35375eb None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:06.247099 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37e8cf-2937-468d-9641-2b8bd2edac2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:06.247756 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37e8cf-2937-468d-9641-2b8bd2edac2b admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:06.248096 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37e8cf-2937-468d-9641-2b8bd2edac2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:06.248380 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37e8cf-2937-468d-9641-2b8bd2edac2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:06.249105 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f37e8cf-2937-468d-9641-2b8bd2edac2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:06.249448 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-5245efdd-3c43-4c93-be02-4847d8af2c91 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:06.250668 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5245efdd-3c43-4c93-be02-4847d8af2c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:06.250801 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f37e8cf-2937-468d-9641-2b8bd2edac2b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:06.259274 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1299/2636] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:53:06.264161 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1338/2637] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 03:53:06.264316 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5245efdd-3c43-4c93-be02-4847d8af2c91 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:06.265089 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37e8cf-2937-468d-9641-2b8bd2edac2b admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:06.272970 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5245efdd-3c43-4c93-be02-4847d8af2c91 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:06.275486 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37e8cf-2937-468d-9641-2b8bd2edac2b admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:06.277602 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a06481-7400-4b2e-86d4-ab30c27db8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:06.278245 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a06481-7400-4b2e-86d4-ab30c27db8db admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:06.278559 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a06481-7400-4b2e-86d4-ab30c27db8db admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:06.278836 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a06481-7400-4b2e-86d4-ab30c27db8db admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:06.279552 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a06481-7400-4b2e-86d4-ab30c27db8db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:53:06.279857 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a06481-7400-4b2e-86d4-ab30c27db8db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:06.280197 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6518eb4-0548-4917-ac1d-4a22739fd365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:06.280811 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6518eb4-0548-4917-ac1d-4a22739fd365 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:06.281098 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6518eb4-0548-4917-ac1d-4a22739fd365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:06.281379 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6518eb4-0548-4917-ac1d-4a22739fd365 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:06.281476 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a06481-7400-4b2e-86d4-ab30c27db8db admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:06.282092 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6518eb4-0548-4917-ac1d-4a22739fd365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:06.283744 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6518eb4-0548-4917-ac1d-4a22739fd365 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:06.289098 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:06.293558 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1300/2638] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:53:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:53:06.297972 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a06481-7400-4b2e-86d4-ab30c27db8db admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:06.298480 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1339/2639] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:53:06.299311 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6518eb4-0548-4917-ac1d-4a22739fd365 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:06.308581 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a06481-7400-4b2e-86d4-ab30c27db8db admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:06.310293 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6518eb4-0548-4917-ac1d-4a22739fd365 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:06.313682 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9533b-2a71-4ae0-9e88-fd46cb9238ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:06.314861 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9533b-2a71-4ae0-9e88-fd46cb9238ab admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:06.315147 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9533b-2a71-4ae0-9e88-fd46cb9238ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:06.315421 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9533b-2a71-4ae0-9e88-fd46cb9238ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:06.315562 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e469629-0ea8-42c7-bd14-6232c6642778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:06.316104 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad9533b-2a71-4ae0-9e88-fd46cb9238ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:06.316449 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e469629-0ea8-42c7-bd14-6232c6642778 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:06.316731 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e469629-0ea8-42c7-bd14-6232c6642778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:06.317009 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e469629-0ea8-42c7-bd14-6232c6642778 admin admin] PATH_INFO: `/v3/projects/d944164688fb49efacba4bd3b0895ef4/users/8464551613b147539356733b54606f9d/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:06.317998 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad9533b-2a71-4ae0-9e88-fd46cb9238ab admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:06.332542 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e469629-0ea8-42c7-bd14-6232c6642778 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d944164688fb49efacba4bd3b0895ef4, user_id=8464551613b147539356733b54606f9d, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:06.335265 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e469629-0ea8-42c7-bd14-6232c6642778 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:06.348089 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1301/2640] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:53:06 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:53:06.348760 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1340/2641] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:53:06 2022] PUT /identity/v3/projects/d944164688fb49efacba4bd3b0895ef4/users/8464551613b147539356733b54606f9d/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:53:06.349072 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9533b-2a71-4ae0-9e88-fd46cb9238ab admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:06.358695 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda555b-c38b-483b-b84e-e6ed5ea9a306 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:06.358993 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda555b-c38b-483b-b84e-e6ed5ea9a306 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:06.359277 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda555b-c38b-483b-b84e-e6ed5ea9a306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:06.382644 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=6 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:06.385032 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-abda555b-c38b-483b-b84e-e6ed5ea9a306 None None] MFA Rules not processed for user `8464551613b147539356733b54606f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:06.386267 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-abda555b-c38b-483b-b84e-e6ed5ea9a306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:06.413805 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad9533b-2a71-4ae0-9e88-fd46cb9238ab admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:06.419289 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db142783-5035-4710-bce2-aa2421e955ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:06.420423 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db142783-5035-4710-bce2-aa2421e955ed admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:06.420726 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db142783-5035-4710-bce2-aa2421e955ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:06.421068 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db142783-5035-4710-bce2-aa2421e955ed admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:06.421756 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db142783-5035-4710-bce2-aa2421e955ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:06.423805 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db142783-5035-4710-bce2-aa2421e955ed admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:06.444360 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1302/2642] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:53:06 2022] POST /identity/v3/users => generated 285 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:53:06.448418 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db142783-5035-4710-bce2-aa2421e955ed admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:06.457615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1341/2643] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:06 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:53:06.458568 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db142783-5035-4710-bce2-aa2421e955ed admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:06.463270 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0eba19-9f8a-43f3-b8c2-9649249a4697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:06.463918 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0eba19-9f8a-43f3-b8c2-9649249a4697 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:06.464206 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0eba19-9f8a-43f3-b8c2-9649249a4697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:06.464482 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0eba19-9f8a-43f3-b8c2-9649249a4697 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:06.465207 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0eba19-9f8a-43f3-b8c2-9649249a4697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:06.466842 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0eba19-9f8a-43f3-b8c2-9649249a4697 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:06.468170 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda555b-c38b-483b-b84e-e6ed5ea9a306 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:06.469526 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-abda555b-c38b-483b-b84e-e6ed5ea9a306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:06.479916 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1303/2644] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:53:06.480886 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0eba19-9f8a-43f3-b8c2-9649249a4697 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:06.490703 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0eba19-9f8a-43f3-b8c2-9649249a4697 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:06.495273 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c1b2a6-383f-4e95-a8ac-60b442b5c118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:06.495915 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1b2a6-383f-4e95-a8ac-60b442b5c118 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:06.496199 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1b2a6-383f-4e95-a8ac-60b442b5c118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:06.496475 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1b2a6-383f-4e95-a8ac-60b442b5c118 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:06.497195 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c1b2a6-383f-4e95-a8ac-60b442b5c118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:06.498819 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c1b2a6-383f-4e95-a8ac-60b442b5c118 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:06.512753 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1304/2645] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:53:06.514022 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c1b2a6-383f-4e95-a8ac-60b442b5c118 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:06.523278 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c1b2a6-383f-4e95-a8ac-60b442b5c118 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:06.526729 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda555b-c38b-483b-b84e-e6ed5ea9a306 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:06.527781 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ec427-024e-4646-aa49-7742d81ee8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:06.528631 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ec427-024e-4646-aa49-7742d81ee8fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:06.528913 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ec427-024e-4646-aa49-7742d81ee8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:06.529192 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ec427-024e-4646-aa49-7742d81ee8fd admin admin] PATH_INFO: `/v3/projects/eccffa389a0541d4a7830e2433b46552/users/0b692b01c9c74fdc95b2b52e9b6df859/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:06.530391 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61fbd13-4f2e-44ba-b01c-2139153a23f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:06.531066 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fbd13-4f2e-44ba-b01c-2139153a23f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:06.531355 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fbd13-4f2e-44ba-b01c-2139153a23f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:06.531636 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fbd13-4f2e-44ba-b01c-2139153a23f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:06.540508 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61fbd13-4f2e-44ba-b01c-2139153a23f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:06.542203 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61fbd13-4f2e-44ba-b01c-2139153a23f7 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:06.544736 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ec427-024e-4646-aa49-7742d81ee8fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=eccffa389a0541d4a7830e2433b46552, user_id=0b692b01c9c74fdc95b2b52e9b6df859, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:06.547508 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ec427-024e-4646-aa49-7742d81ee8fd admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:06.552313 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1342/2646] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:53:06 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 03:53:06.561774 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1305/2647] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:53:06 2022] PUT /identity/v3/projects/eccffa389a0541d4a7830e2433b46552/users/0b692b01c9c74fdc95b2b52e9b6df859/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:53:06.572247 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a499fe-6aec-4d10-8056-72a21d6d731f None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:06.572539 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a499fe-6aec-4d10-8056-72a21d6d731f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:06.572818 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a499fe-6aec-4d10-8056-72a21d6d731f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:06.599232 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-57a499fe-6aec-4d10-8056-72a21d6d731f None None] MFA Rules not processed for user `0b692b01c9c74fdc95b2b52e9b6df859`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:06.600473 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-57a499fe-6aec-4d10-8056-72a21d6d731f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:06.661549 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:06.674257 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1343/2648] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:06 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:53:06.682722 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ec427-024e-4646-aa49-7742d81ee8fd admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:06.684474 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-df1ec427-024e-4646-aa49-7742d81ee8fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:06.753367 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ec427-024e-4646-aa49-7742d81ee8fd admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:06.757128 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6d94e-6037-4548-8780-e9018b5fc8dd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a567cddc98164bd39317a245626d0f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:06.757781 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6d94e-6037-4548-8780-e9018b5fc8dd service glance] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:06.758072 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6d94e-6037-4548-8780-e9018b5fc8dd service glance] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:06.758467 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6d94e-6037-4548-8780-e9018b5fc8dd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:06.768058 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6d94e-6037-4548-8780-e9018b5fc8dd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:06.769569 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6d94e-6037-4548-8780-e9018b5fc8dd service glance] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:06.778930 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1306/2649] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:53:06 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:53:14.854028 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a499fe-6aec-4d10-8056-72a21d6d731f None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:14.917269 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a499fe-6aec-4d10-8056-72a21d6d731f None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:14.921774 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eabfca-a234-415e-8000-b1c1fac10207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:14.922678 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eabfca-a234-415e-8000-b1c1fac10207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:14.922960 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eabfca-a234-415e-8000-b1c1fac10207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:14.923240 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6eabfca-a234-415e-8000-b1c1fac10207 admin admin] PATH_INFO: `/v3/users/8464551613b147539356733b54606f9d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:14.924999 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eabfca-a234-415e-8000-b1c1fac10207 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8464551613b147539356733b54606f9d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:14.926958 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6eabfca-a234-415e-8000-b1c1fac10207 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:14.972767 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d6eabfca-a234-415e-8000-b1c1fac10207 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8464551613b147539356733b54606f9d'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:14.973417 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d6eabfca-a234-415e-8000-b1c1fac10207 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8464551613b147539356733b54606f9d'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:14.974017 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d6eabfca-a234-415e-8000-b1c1fac10207 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8464551613b147539356733b54606f9d'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:14.980727 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d6eabfca-a234-415e-8000-b1c1fac10207 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8464551613b147539356733b54606f9d'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:14.988981 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d6eabfca-a234-415e-8000-b1c1fac10207 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8464551613b147539356733b54606f9d'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:15.007845 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1344/2650] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:53:14 2022] DELETE /identity/v3/users/8464551613b147539356733b54606f9d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:53:15.012338 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89afd7-933e-4019-8633-51b904e7bf88 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:15.012951 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89afd7-933e-4019-8633-51b904e7bf88 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:15.012951 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd89afd7-933e-4019-8633-51b904e7bf88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:15.030267 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-dd89afd7-933e-4019-8633-51b904e7bf88 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:15.031505 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-dd89afd7-933e-4019-8633-51b904e7bf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:15.089563 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1307/2651] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:53:15.100061 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eabfca-a234-415e-8000-b1c1fac10207 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:15.101601 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d6eabfca-a234-415e-8000-b1c1fac10207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:15.160834 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6eabfca-a234-415e-8000-b1c1fac10207 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:15.164466 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a711073-73ee-40e3-84f4-c6073fdf365c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:15.165145 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a711073-73ee-40e3-84f4-c6073fdf365c service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:15.165425 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a711073-73ee-40e3-84f4-c6073fdf365c service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:15.165700 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a711073-73ee-40e3-84f4-c6073fdf365c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:15.175360 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a711073-73ee-40e3-84f4-c6073fdf365c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:15.176779 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a711073-73ee-40e3-84f4-c6073fdf365c service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:15.186192 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1345/2652] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:53:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:53:15.463606 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd89afd7-933e-4019-8633-51b904e7bf88 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:15.465199 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-dd89afd7-933e-4019-8633-51b904e7bf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:15.481471 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd89afd7-933e-4019-8633-51b904e7bf88 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:15.486154 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9883b72-b06e-4f36-b4ea-af86e01b8132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:15.487064 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9883b72-b06e-4f36-b4ea-af86e01b8132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:15.487352 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9883b72-b06e-4f36-b4ea-af86e01b8132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:15.487633 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9883b72-b06e-4f36-b4ea-af86e01b8132 admin admin] PATH_INFO: `/v3/projects/d944164688fb49efacba4bd3b0895ef4` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:15.488854 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9883b72-b06e-4f36-b4ea-af86e01b8132 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d944164688fb49efacba4bd3b0895ef4)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:15.491685 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9883b72-b06e-4f36-b4ea-af86e01b8132 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:15.507932 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:15.540839 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a9883b72-b06e-4f36-b4ea-af86e01b8132 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd944164688fb49efacba4bd3b0895ef4', 'request_id': 'req-a9883b72-b06e-4f36-b4ea-af86e01b8132'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:15.547954 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a9883b72-b06e-4f36-b4ea-af86e01b8132 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd944164688fb49efacba4bd3b0895ef4', 'request_id': 'req-a9883b72-b06e-4f36-b4ea-af86e01b8132'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:15.556000 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a9883b72-b06e-4f36-b4ea-af86e01b8132 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd944164688fb49efacba4bd3b0895ef4', 'request_id': 'req-a9883b72-b06e-4f36-b4ea-af86e01b8132'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:15.566199 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a9883b72-b06e-4f36-b4ea-af86e01b8132 admin admin] The token cache is being invalidate because project d944164688fb49efacba4bd3b0895ef4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:53:15.566517 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a9883b72-b06e-4f36-b4ea-af86e01b8132 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:15.567138 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-a9883b72-b06e-4f36-b4ea-af86e01b8132 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:15.568677 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1308/2653] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:53:15 2022] DELETE /identity/v3/projects/d944164688fb49efacba4bd3b0895ef4 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:53:15.573389 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64759cc3-1e9f-4c6f-95e2-3153587c738f None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:15.573687 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64759cc3-1e9f-4c6f-95e2-3153587c738f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:15.573971 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64759cc3-1e9f-4c6f-95e2-3153587c738f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:15.596996 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-64759cc3-1e9f-4c6f-95e2-3153587c738f None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:15.598205 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-64759cc3-1e9f-4c6f-95e2-3153587c738f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:15.612014 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:15.664427 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1346/2654] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:53:15.673516 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0eb20-6a45-4522-a15a-398100813c25 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:15.673810 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0eb20-6a45-4522-a15a-398100813c25 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:15.674138 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c0eb20-6a45-4522-a15a-398100813c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:15.692080 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-58c0eb20-6a45-4522-a15a-398100813c25 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:15.693280 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-58c0eb20-6a45-4522-a15a-398100813c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:15.702479 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1309/2655] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:53:15.707127 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64759cc3-1e9f-4c6f-95e2-3153587c738f None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:15.716929 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64759cc3-1e9f-4c6f-95e2-3153587c738f None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:15.722194 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6173d103-acd1-45ce-a093-5c215783d936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:15.722900 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173d103-acd1-45ce-a093-5c215783d936 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:15.723183 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173d103-acd1-45ce-a093-5c215783d936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:15.723461 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6173d103-acd1-45ce-a093-5c215783d936 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:15.724201 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6173d103-acd1-45ce-a093-5c215783d936 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:53:15.724521 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6173d103-acd1-45ce-a093-5c215783d936 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:15.726137 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6173d103-acd1-45ce-a093-5c215783d936 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:15.738186 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1347/2656] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:53:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:53:15.742569 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0eb20-6a45-4522-a15a-398100813c25 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:15.751826 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c0eb20-6a45-4522-a15a-398100813c25 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:15.756525 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d88a6-d9ad-47f3-b7aa-b82067168733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:15.757179 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d88a6-d9ad-47f3-b7aa-b82067168733 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:15.757463 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d88a6-d9ad-47f3-b7aa-b82067168733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:15.757737 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139d88a6-d9ad-47f3-b7aa-b82067168733 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:15.758485 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139d88a6-d9ad-47f3-b7aa-b82067168733 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:15.760381 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139d88a6-d9ad-47f3-b7aa-b82067168733 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:15.790378 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1310/2657] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:53:15 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:53:15.794708 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6173d103-acd1-45ce-a093-5c215783d936 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:15.804594 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6173d103-acd1-45ce-a093-5c215783d936 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:15.862574 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e453e46e-226d-46cc-9d0e-d42253b4baed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:15.863275 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453e46e-226d-46cc-9d0e-d42253b4baed admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:15.863541 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453e46e-226d-46cc-9d0e-d42253b4baed admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:15.863815 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453e46e-226d-46cc-9d0e-d42253b4baed admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:15.864529 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e453e46e-226d-46cc-9d0e-d42253b4baed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:15.866526 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e453e46e-226d-46cc-9d0e-d42253b4baed admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:15.890921 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1348/2658] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:53:15 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:53:15.892204 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d88a6-d9ad-47f3-b7aa-b82067168733 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:15.903118 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139d88a6-d9ad-47f3-b7aa-b82067168733 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:15.907699 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bbf799-4dbd-4ae8-8bbc-35d39dfb45d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:15.908360 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bbf799-4dbd-4ae8-8bbc-35d39dfb45d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:15.908647 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bbf799-4dbd-4ae8-8bbc-35d39dfb45d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:15.908924 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bbf799-4dbd-4ae8-8bbc-35d39dfb45d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:15.909903 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bbf799-4dbd-4ae8-8bbc-35d39dfb45d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:15.911551 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bbf799-4dbd-4ae8-8bbc-35d39dfb45d7 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:15.922554 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1311/2659] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:53:15.926605 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e453e46e-226d-46cc-9d0e-d42253b4baed admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:15.937111 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e453e46e-226d-46cc-9d0e-d42253b4baed admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:15.942258 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b8652-4626-4505-be4b-9c5ee650a1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:15.942947 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b8652-4626-4505-be4b-9c5ee650a1ea admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:15.943232 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b8652-4626-4505-be4b-9c5ee650a1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:15.943507 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b8652-4626-4505-be4b-9c5ee650a1ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:15.944244 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b8652-4626-4505-be4b-9c5ee650a1ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:15.945812 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b8652-4626-4505-be4b-9c5ee650a1ea admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:15.956690 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1349/2660] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:53:15.960878 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bbf799-4dbd-4ae8-8bbc-35d39dfb45d7 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:15.971081 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bbf799-4dbd-4ae8-8bbc-35d39dfb45d7 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:15.976522 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ee6f2-8afe-4b65-9b88-b050024894c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:15.977433 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ee6f2-8afe-4b65-9b88-b050024894c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:15.977719 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ee6f2-8afe-4b65-9b88-b050024894c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:15.977999 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ee6f2-8afe-4b65-9b88-b050024894c9 admin admin] PATH_INFO: `/v3/projects/dd6bccf208ee4d538613bb7adc03e740/users/bfa16c223adf44f8a8b95880fd2b5752/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:15.992979 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ee6f2-8afe-4b65-9b88-b050024894c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd6bccf208ee4d538613bb7adc03e740, user_id=bfa16c223adf44f8a8b95880fd2b5752, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:15.995707 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ee6f2-8afe-4b65-9b88-b050024894c9 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:16.011725 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1312/2661] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:53:15 2022] PUT /identity/v3/projects/dd6bccf208ee4d538613bb7adc03e740/users/bfa16c223adf44f8a8b95880fd2b5752/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:53:16.022362 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b889201-c9d9-45a4-924e-30f5d2f77ad6 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:16.022671 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b889201-c9d9-45a4-924e-30f5d2f77ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:16.022959 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b889201-c9d9-45a4-924e-30f5d2f77ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:16.051065 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-5b889201-c9d9-45a4-924e-30f5d2f77ad6 None None] MFA Rules not processed for user `bfa16c223adf44f8a8b95880fd2b5752`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:16.052314 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5b889201-c9d9-45a4-924e-30f5d2f77ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:16.117647 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1350/2662] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:16 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:53:16.121811 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ee6f2-8afe-4b65-9b88-b050024894c9 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:16.189435 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ee6f2-8afe-4b65-9b88-b050024894c9 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:16.194029 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd920c-442a-47f3-abc3-e77868a8ec88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:16.194724 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd920c-442a-47f3-abc3-e77868a8ec88 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:16.195013 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd920c-442a-47f3-abc3-e77868a8ec88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:16.195296 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd920c-442a-47f3-abc3-e77868a8ec88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:16.196009 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd920c-442a-47f3-abc3-e77868a8ec88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:16.197951 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd920c-442a-47f3-abc3-e77868a8ec88 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:16.231425 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1313/2663] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:53:16 2022] POST /identity/v3/projects => generated 361 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:53:16.235505 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b889201-c9d9-45a4-924e-30f5d2f77ad6 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:16.246274 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b889201-c9d9-45a4-924e-30f5d2f77ad6 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:16.258391 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:16.305538 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fbd3d0-4a42-41cb-a69f-1887ecd3420c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:16.306210 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbd3d0-4a42-41cb-a69f-1887ecd3420c admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:16.306520 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbd3d0-4a42-41cb-a69f-1887ecd3420c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:16.306800 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbd3d0-4a42-41cb-a69f-1887ecd3420c admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:16.307485 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fbd3d0-4a42-41cb-a69f-1887ecd3420c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:16.309380 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fbd3d0-4a42-41cb-a69f-1887ecd3420c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:16.329231 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1351/2664] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:53:16 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:53:16.333539 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd920c-442a-47f3-abc3-e77868a8ec88 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:16.344620 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd920c-442a-47f3-abc3-e77868a8ec88 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:16.349755 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c305b8-53ec-4892-a423-d21fed5ec7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:16.350423 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c305b8-53ec-4892-a423-d21fed5ec7a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:16.350746 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c305b8-53ec-4892-a423-d21fed5ec7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:16.351022 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c305b8-53ec-4892-a423-d21fed5ec7a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:16.351757 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c305b8-53ec-4892-a423-d21fed5ec7a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:16.353358 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c305b8-53ec-4892-a423-d21fed5ec7a5 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:16.364209 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1314/2665] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:53:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:53:16.368386 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fbd3d0-4a42-41cb-a69f-1887ecd3420c admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:16.378580 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fbd3d0-4a42-41cb-a69f-1887ecd3420c admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:16.383203 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118cb4bc-3bcb-4157-91a6-16681b8616ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:16.384086 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118cb4bc-3bcb-4157-91a6-16681b8616ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:16.384373 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118cb4bc-3bcb-4157-91a6-16681b8616ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:16.384651 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118cb4bc-3bcb-4157-91a6-16681b8616ea admin admin] PATH_INFO: `/v3/projects/5ca53d91ae3a442fab4846753be97a34/users/499bc8067c05432ea0bb1016f2efd73c/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:16.399926 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118cb4bc-3bcb-4157-91a6-16681b8616ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca53d91ae3a442fab4846753be97a34, user_id=499bc8067c05432ea0bb1016f2efd73c, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:16.402543 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118cb4bc-3bcb-4157-91a6-16681b8616ea admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:16.417243 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1352/2666] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:53:16 2022] PUT /identity/v3/projects/5ca53d91ae3a442fab4846753be97a34/users/499bc8067c05432ea0bb1016f2efd73c/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:53:16.421343 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c305b8-53ec-4892-a423-d21fed5ec7a5 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:16.433369 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c305b8-53ec-4892-a423-d21fed5ec7a5 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:16.444975 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:16.500513 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7e1853-b388-43d7-8afd-a822d6fa59d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:16.501196 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e1853-b388-43d7-8afd-a822d6fa59d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:16.501487 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e1853-b388-43d7-8afd-a822d6fa59d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:16.501771 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7e1853-b388-43d7-8afd-a822d6fa59d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:16.502576 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e1853-b388-43d7-8afd-a822d6fa59d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:16.504196 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7e1853-b388-43d7-8afd-a822d6fa59d6 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:16.514252 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1315/2667] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:53:16 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:53:16.518825 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118cb4bc-3bcb-4157-91a6-16681b8616ea admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:16.529357 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118cb4bc-3bcb-4157-91a6-16681b8616ea admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:16.534911 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073cceb7-d0d9-40bf-9aac-e4e7d1bd53c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:16.535783 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cceb7-d0d9-40bf-9aac-e4e7d1bd53c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:16.536083 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cceb7-d0d9-40bf-9aac-e4e7d1bd53c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:16.536363 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073cceb7-d0d9-40bf-9aac-e4e7d1bd53c2 admin admin] PATH_INFO: `/v3/projects/5ca53d91ae3a442fab4846753be97a34/users/499bc8067c05432ea0bb1016f2efd73c/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:16.538318 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073cceb7-d0d9-40bf-9aac-e4e7d1bd53c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca53d91ae3a442fab4846753be97a34, user_id=499bc8067c05432ea0bb1016f2efd73c, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:16.540947 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073cceb7-d0d9-40bf-9aac-e4e7d1bd53c2 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:16.552862 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1353/2668] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:53:16 2022] PUT /identity/v3/projects/5ca53d91ae3a442fab4846753be97a34/users/499bc8067c05432ea0bb1016f2efd73c/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:53:16.565090 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bff5b-3d47-4938-a8f4-3f1246966fe9 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:16.565295 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bff5b-3d47-4938-a8f4-3f1246966fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:16.565580 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bff5b-3d47-4938-a8f4-3f1246966fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:16.592831 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-db7bff5b-3d47-4938-a8f4-3f1246966fe9 None None] MFA Rules not processed for user `499bc8067c05432ea0bb1016f2efd73c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:16.594069 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-db7bff5b-3d47-4938-a8f4-3f1246966fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:16.666841 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1316/2669] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:16 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:53:16.679205 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073cceb7-d0d9-40bf-9aac-e4e7d1bd53c2 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:16.680983 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-073cceb7-d0d9-40bf-9aac-e4e7d1bd53c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:16.738877 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073cceb7-d0d9-40bf-9aac-e4e7d1bd53c2 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:16.742588 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b8daa-26d4-4f9f-9883-ce3d4eedcd54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:16.743237 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b8daa-26d4-4f9f-9883-ce3d4eedcd54 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:16.743518 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b8daa-26d4-4f9f-9883-ce3d4eedcd54 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:16.743789 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4b8daa-26d4-4f9f-9883-ce3d4eedcd54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:16.753532 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b8daa-26d4-4f9f-9883-ce3d4eedcd54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:16.754989 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4b8daa-26d4-4f9f-9883-ce3d4eedcd54 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:16.764353 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1354/2670] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:53:16 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:53:16.835422 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7bff5b-3d47-4938-a8f4-3f1246966fe9 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:16.845846 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7bff5b-3d47-4938-a8f4-3f1246966fe9 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:16.850248 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d0cf7-8385-4fda-a2a8-6f31ef1f6fec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:16.850935 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d0cf7-8385-4fda-a2a8-6f31ef1f6fec service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:16.851217 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d0cf7-8385-4fda-a2a8-6f31ef1f6fec service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:16.851494 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d0cf7-8385-4fda-a2a8-6f31ef1f6fec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:16.910506 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d0cf7-8385-4fda-a2a8-6f31ef1f6fec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:16.911951 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d0cf7-8385-4fda-a2a8-6f31ef1f6fec service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:16.920709 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1317/2671] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:53:16 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:53:23.845866 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b8daa-26d4-4f9f-9883-ce3d4eedcd54 service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:23.906667 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4b8daa-26d4-4f9f-9883-ce3d4eedcd54 service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:23.911435 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5155793-5fff-4041-9f5e-239e589652ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:23.912927 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5155793-5fff-4041-9f5e-239e589652ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:23.913211 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5155793-5fff-4041-9f5e-239e589652ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:23.913486 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5155793-5fff-4041-9f5e-239e589652ac admin admin] PATH_INFO: `/v3/users/bfa16c223adf44f8a8b95880fd2b5752` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:23.914711 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5155793-5fff-4041-9f5e-239e589652ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfa16c223adf44f8a8b95880fd2b5752)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:23.916623 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5155793-5fff-4041-9f5e-239e589652ac admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:23.928802 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:23.962571 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b5155793-5fff-4041-9f5e-239e589652ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfa16c223adf44f8a8b95880fd2b5752'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:23.963145 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b5155793-5fff-4041-9f5e-239e589652ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfa16c223adf44f8a8b95880fd2b5752'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:23.963736 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b5155793-5fff-4041-9f5e-239e589652ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfa16c223adf44f8a8b95880fd2b5752'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:23.970771 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b5155793-5fff-4041-9f5e-239e589652ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfa16c223adf44f8a8b95880fd2b5752'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:23.978974 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b5155793-5fff-4041-9f5e-239e589652ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfa16c223adf44f8a8b95880fd2b5752'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:23.996410 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1355/2672] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:53:23 2022] DELETE /identity/v3/users/bfa16c223adf44f8a8b95880fd2b5752 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:53:24.001450 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b883be6-c15a-4501-b24c-dfe0e0f6eccf None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:24.001970 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b883be6-c15a-4501-b24c-dfe0e0f6eccf None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:24.002389 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b883be6-c15a-4501-b24c-dfe0e0f6eccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:24.019765 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-8b883be6-c15a-4501-b24c-dfe0e0f6eccf None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:24.020952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8b883be6-c15a-4501-b24c-dfe0e0f6eccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:24.049998 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:24.079788 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1318/2673] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:53:24.090114 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5155793-5fff-4041-9f5e-239e589652ac admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:24.091567 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b5155793-5fff-4041-9f5e-239e589652ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:24.146178 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5155793-5fff-4041-9f5e-239e589652ac admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:24.150376 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e25bc-ab56-4b85-b808-e7aeb51b68fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:24.151047 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e25bc-ab56-4b85-b808-e7aeb51b68fd service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:24.151330 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e25bc-ab56-4b85-b808-e7aeb51b68fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:24.151607 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e25bc-ab56-4b85-b808-e7aeb51b68fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:24.160560 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e25bc-ab56-4b85-b808-e7aeb51b68fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:24.161972 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e25bc-ab56-4b85-b808-e7aeb51b68fd service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:24.171198 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1356/2674] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:53:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:53:24.438260 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b883be6-c15a-4501-b24c-dfe0e0f6eccf None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:24.439799 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8b883be6-c15a-4501-b24c-dfe0e0f6eccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:24.456226 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b883be6-c15a-4501-b24c-dfe0e0f6eccf None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:24.461643 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b48660-2ad2-49cc-8d60-7b8038100243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:24.462952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b48660-2ad2-49cc-8d60-7b8038100243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:24.463362 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b48660-2ad2-49cc-8d60-7b8038100243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:24.463509 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b48660-2ad2-49cc-8d60-7b8038100243 admin admin] PATH_INFO: `/v3/projects/dd6bccf208ee4d538613bb7adc03e740` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:24.464826 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b48660-2ad2-49cc-8d60-7b8038100243 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd6bccf208ee4d538613bb7adc03e740)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:24.466672 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b48660-2ad2-49cc-8d60-7b8038100243 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:24.514003 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c9b48660-2ad2-49cc-8d60-7b8038100243 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd6bccf208ee4d538613bb7adc03e740', 'request_id': 'req-c9b48660-2ad2-49cc-8d60-7b8038100243'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:24.520022 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c9b48660-2ad2-49cc-8d60-7b8038100243 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd6bccf208ee4d538613bb7adc03e740', 'request_id': 'req-c9b48660-2ad2-49cc-8d60-7b8038100243'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:24.527755 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c9b48660-2ad2-49cc-8d60-7b8038100243 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd6bccf208ee4d538613bb7adc03e740', 'request_id': 'req-c9b48660-2ad2-49cc-8d60-7b8038100243'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:24.538404 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c9b48660-2ad2-49cc-8d60-7b8038100243 admin admin] The token cache is being invalidate because project dd6bccf208ee4d538613bb7adc03e740 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:53:24.538754 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c9b48660-2ad2-49cc-8d60-7b8038100243 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:24.539393 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-c9b48660-2ad2-49cc-8d60-7b8038100243 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:24.541077 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1319/2675] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:53:24 2022] DELETE /identity/v3/projects/dd6bccf208ee4d538613bb7adc03e740 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:53:24.550412 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e25bc-ab56-4b85-b808-e7aeb51b68fd service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:24.560494 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e25bc-ab56-4b85-b808-e7aeb51b68fd service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:24.622090 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fdd981-60ac-48f2-877e-a61179d7d7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:24.623315 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fdd981-60ac-48f2-877e-a61179d7d7e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:24.623683 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fdd981-60ac-48f2-877e-a61179d7d7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:24.624027 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fdd981-60ac-48f2-877e-a61179d7d7e0 admin admin] PATH_INFO: `/v3/users/499bc8067c05432ea0bb1016f2efd73c` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:24.625325 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fdd981-60ac-48f2-877e-a61179d7d7e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=499bc8067c05432ea0bb1016f2efd73c)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:24.627369 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fdd981-60ac-48f2-877e-a61179d7d7e0 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:24.669079 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:24.681381 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-88fdd981-60ac-48f2-877e-a61179d7d7e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '499bc8067c05432ea0bb1016f2efd73c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:24.682042 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-88fdd981-60ac-48f2-877e-a61179d7d7e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '499bc8067c05432ea0bb1016f2efd73c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:24.682705 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-88fdd981-60ac-48f2-877e-a61179d7d7e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '499bc8067c05432ea0bb1016f2efd73c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:24.690101 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-88fdd981-60ac-48f2-877e-a61179d7d7e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '499bc8067c05432ea0bb1016f2efd73c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:24.702439 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-88fdd981-60ac-48f2-877e-a61179d7d7e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '499bc8067c05432ea0bb1016f2efd73c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:24.724272 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1357/2676] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:53:24 2022] DELETE /identity/v3/users/499bc8067c05432ea0bb1016f2efd73c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:53:25.004214 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b48660-2ad2-49cc-8d60-7b8038100243 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:25.005636 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-c9b48660-2ad2-49cc-8d60-7b8038100243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:25.020151 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b48660-2ad2-49cc-8d60-7b8038100243 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:25.080015 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbfbea6-40a0-46d0-b2a0-518736df3242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:25.080820 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbfbea6-40a0-46d0-b2a0-518736df3242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:25.081108 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbfbea6-40a0-46d0-b2a0-518736df3242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:25.081386 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbfbea6-40a0-46d0-b2a0-518736df3242 admin admin] PATH_INFO: `/v3/projects/5ca53d91ae3a442fab4846753be97a34` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:25.082632 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbfbea6-40a0-46d0-b2a0-518736df3242 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ca53d91ae3a442fab4846753be97a34)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:25.084582 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbfbea6-40a0-46d0-b2a0-518736df3242 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:25.131280 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9fbfbea6-40a0-46d0-b2a0-518736df3242 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ca53d91ae3a442fab4846753be97a34', 'request_id': 'req-9fbfbea6-40a0-46d0-b2a0-518736df3242'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:25.137546 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9fbfbea6-40a0-46d0-b2a0-518736df3242 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ca53d91ae3a442fab4846753be97a34', 'request_id': 'req-9fbfbea6-40a0-46d0-b2a0-518736df3242'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:25.141039 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:25.145023 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9fbfbea6-40a0-46d0-b2a0-518736df3242 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ca53d91ae3a442fab4846753be97a34', 'request_id': 'req-9fbfbea6-40a0-46d0-b2a0-518736df3242'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:25.156955 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9fbfbea6-40a0-46d0-b2a0-518736df3242 admin admin] The token cache is being invalidate because project 5ca53d91ae3a442fab4846753be97a34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:53:25.157249 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9fbfbea6-40a0-46d0-b2a0-518736df3242 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:25.157876 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9fbfbea6-40a0-46d0-b2a0-518736df3242 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:25.159768 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1320/2677] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:53:25 2022] DELETE /identity/v3/projects/5ca53d91ae3a442fab4846753be97a34 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:53:25.165232 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c3ec1-a3d5-4309-b90f-3be350aa3b6d None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:25.165695 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c3ec1-a3d5-4309-b90f-3be350aa3b6d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:25.165792 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c3ec1-a3d5-4309-b90f-3be350aa3b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:25.183487 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-300c3ec1-a3d5-4309-b90f-3be350aa3b6d None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:25.184678 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-300c3ec1-a3d5-4309-b90f-3be350aa3b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:25.242831 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1358/2678] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:53:25.250661 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055766b4-7384-481e-9e25-1a769c7d206d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:25.250954 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055766b4-7384-481e-9e25-1a769c7d206d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:25.251234 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055766b4-7384-481e-9e25-1a769c7d206d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:25.269255 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-055766b4-7384-481e-9e25-1a769c7d206d None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:25.270466 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-055766b4-7384-481e-9e25-1a769c7d206d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:25.279140 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1321/2679] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:53:25.283070 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c3ec1-a3d5-4309-b90f-3be350aa3b6d None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:25.293318 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c3ec1-a3d5-4309-b90f-3be350aa3b6d None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:25.297845 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d237f32f-97e3-4695-a526-5bc37cfcd8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:25.298515 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237f32f-97e3-4695-a526-5bc37cfcd8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:25.298803 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237f32f-97e3-4695-a526-5bc37cfcd8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:25.299080 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237f32f-97e3-4695-a526-5bc37cfcd8c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:25.299792 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d237f32f-97e3-4695-a526-5bc37cfcd8c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:53:25.300096 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d237f32f-97e3-4695-a526-5bc37cfcd8c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:25.301669 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d237f32f-97e3-4695-a526-5bc37cfcd8c8 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:25.312881 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1359/2680] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:53:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:53:25.317003 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055766b4-7384-481e-9e25-1a769c7d206d None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:25.326101 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055766b4-7384-481e-9e25-1a769c7d206d None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:25.330853 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92855b-d2b5-41d6-b264-6caab1754ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:25.331435 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92855b-d2b5-41d6-b264-6caab1754ebc admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:25.331719 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92855b-d2b5-41d6-b264-6caab1754ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:25.331992 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92855b-d2b5-41d6-b264-6caab1754ebc admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:25.332682 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e92855b-d2b5-41d6-b264-6caab1754ebc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:25.335113 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e92855b-d2b5-41d6-b264-6caab1754ebc admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:25.360627 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1322/2681] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:53:25 2022] POST /identity/v3/projects => generated 393 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:53:25.364444 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d237f32f-97e3-4695-a526-5bc37cfcd8c8 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:25.374279 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d237f32f-97e3-4695-a526-5bc37cfcd8c8 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:25.428257 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf5d10-3077-469e-a0ef-b9a8165d3f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:25.428908 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf5d10-3077-469e-a0ef-b9a8165d3f1a admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:25.429192 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf5d10-3077-469e-a0ef-b9a8165d3f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:25.429469 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bf5d10-3077-469e-a0ef-b9a8165d3f1a admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:25.430155 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf5d10-3077-469e-a0ef-b9a8165d3f1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:25.432085 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bf5d10-3077-469e-a0ef-b9a8165d3f1a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:25.450386 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1360/2682] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:53:25 2022] POST /identity/v3/users => generated 297 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:53:25.454634 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92855b-d2b5-41d6-b264-6caab1754ebc admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:25.465284 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92855b-d2b5-41d6-b264-6caab1754ebc admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:25.469905 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b101d-9bd5-4a90-a582-f915b2a6d368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:25.470585 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b101d-9bd5-4a90-a582-f915b2a6d368 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:25.470875 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b101d-9bd5-4a90-a582-f915b2a6d368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:25.471154 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b101d-9bd5-4a90-a582-f915b2a6d368 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:25.471879 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b101d-9bd5-4a90-a582-f915b2a6d368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:25.473491 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b101d-9bd5-4a90-a582-f915b2a6d368 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:25.484317 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1323/2683] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:53:25.488108 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf5d10-3077-469e-a0ef-b9a8165d3f1a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:25.497868 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bf5d10-3077-469e-a0ef-b9a8165d3f1a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:25.503156 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70358670-1a42-4448-b656-3963524fb73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:25.503812 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70358670-1a42-4448-b656-3963524fb73a admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:25.504098 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70358670-1a42-4448-b656-3963524fb73a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:25.504375 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70358670-1a42-4448-b656-3963524fb73a admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:25.505106 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70358670-1a42-4448-b656-3963524fb73a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:25.507282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70358670-1a42-4448-b656-3963524fb73a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:25.517401 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1361/2684] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 03:53:25.522181 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b101d-9bd5-4a90-a582-f915b2a6d368 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:25.533058 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b101d-9bd5-4a90-a582-f915b2a6d368 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:25.538565 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1df17-5dc2-4cfa-a4f8-d4592a38020d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:25.539691 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1df17-5dc2-4cfa-a4f8-d4592a38020d admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:25.539995 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1df17-5dc2-4cfa-a4f8-d4592a38020d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:25.540256 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1df17-5dc2-4cfa-a4f8-d4592a38020d admin admin] PATH_INFO: `/v3/projects/e08fb6c3aea946558692a7b7bf8a3f32/users/2d65b06856b3468cb9a9a201245da5cc/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:25.556341 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a1df17-5dc2-4cfa-a4f8-d4592a38020d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e08fb6c3aea946558692a7b7bf8a3f32, user_id=2d65b06856b3468cb9a9a201245da5cc, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:25.559548 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a1df17-5dc2-4cfa-a4f8-d4592a38020d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:25.573323 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1324/2685] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:53:25 2022] PUT /identity/v3/projects/e08fb6c3aea946558692a7b7bf8a3f32/users/2d65b06856b3468cb9a9a201245da5cc/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:53:25.584786 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03850908-d83f-499d-94f8-c3b54d02f6ca None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:25.585094 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03850908-d83f-499d-94f8-c3b54d02f6ca None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:25.585373 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03850908-d83f-499d-94f8-c3b54d02f6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:25.611338 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-03850908-d83f-499d-94f8-c3b54d02f6ca None None] MFA Rules not processed for user `2d65b06856b3468cb9a9a201245da5cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:25.612720 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-03850908-d83f-499d-94f8-c3b54d02f6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:25.618079 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:25.679407 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1362/2686] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:53:25.683688 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1df17-5dc2-4cfa-a4f8-d4592a38020d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:25.746078 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1df17-5dc2-4cfa-a4f8-d4592a38020d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:25.751049 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b801bc-b037-4545-8d06-b27ce47baee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:25.751714 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b801bc-b037-4545-8d06-b27ce47baee8 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:25.752006 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b801bc-b037-4545-8d06-b27ce47baee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:25.752293 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b801bc-b037-4545-8d06-b27ce47baee8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:25.753035 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b801bc-b037-4545-8d06-b27ce47baee8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:25.754967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b801bc-b037-4545-8d06-b27ce47baee8 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:25.780702 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1325/2687] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:53:25 2022] POST /identity/v3/projects => generated 393 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:53:25.784831 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03850908-d83f-499d-94f8-c3b54d02f6ca None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:25.796185 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03850908-d83f-499d-94f8-c3b54d02f6ca None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:25.855195 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b801bc-b037-4545-8d06-b27ce47baee8 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:25.856858 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a1b801bc-b037-4545-8d06-b27ce47baee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:25.859495 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb9422-effd-4d3b-a20b-ee668d6c2aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:25.860174 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb9422-effd-4d3b-a20b-ee668d6c2aad admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:25.860464 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb9422-effd-4d3b-a20b-ee668d6c2aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:25.860746 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fb9422-effd-4d3b-a20b-ee668d6c2aad admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:25.861468 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb9422-effd-4d3b-a20b-ee668d6c2aad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:25.863434 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fb9422-effd-4d3b-a20b-ee668d6c2aad admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:25.883800 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1363/2688] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:53:25 2022] POST /identity/v3/users => generated 303 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:53:25.887507 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb9422-effd-4d3b-a20b-ee668d6c2aad admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:25.897552 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fb9422-effd-4d3b-a20b-ee668d6c2aad admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:25.902437 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d730564-3098-4463-9f2e-5d97204d01ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:25.903248 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d730564-3098-4463-9f2e-5d97204d01ee admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:25.903633 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d730564-3098-4463-9f2e-5d97204d01ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:25.903924 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d730564-3098-4463-9f2e-5d97204d01ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:25.904776 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d730564-3098-4463-9f2e-5d97204d01ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:25.906244 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d730564-3098-4463-9f2e-5d97204d01ee admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:25.916668 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b801bc-b037-4545-8d06-b27ce47baee8 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:25.917137 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1364/2689] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 03:53:25.921111 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d730564-3098-4463-9f2e-5d97204d01ee admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:25.922883 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a9f01d-66c8-4dc5-9db4-8cd3b3a175d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:25.923537 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9f01d-66c8-4dc5-9db4-8cd3b3a175d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:25.923827 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9f01d-66c8-4dc5-9db4-8cd3b3a175d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:25.924116 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a9f01d-66c8-4dc5-9db4-8cd3b3a175d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:25.925924 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-15a9f01d-66c8-4dc5-9db4-8cd3b3a175d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:25.930648 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d730564-3098-4463-9f2e-5d97204d01ee admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:25.935279 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c1877-61e4-4620-b311-6e375e9366f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:25.936145 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c1877-61e4-4620-b311-6e375e9366f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:25.936432 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c1877-61e4-4620-b311-6e375e9366f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:25.936714 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68c1877-61e4-4620-b311-6e375e9366f2 admin admin] PATH_INFO: `/v3/projects/c4a7b4a34e23487eac6356863d9d6dfe/users/4fc5c6e5dd3e422d8d40388ff125c0a8/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:25.941131 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a9f01d-66c8-4dc5-9db4-8cd3b3a175d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:25.942612 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a9f01d-66c8-4dc5-9db4-8cd3b3a175d8 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:25.951479 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68c1877-61e4-4620-b311-6e375e9366f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4a7b4a34e23487eac6356863d9d6dfe, user_id=4fc5c6e5dd3e422d8d40388ff125c0a8, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:25.952585 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1326/2690] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:53:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 03:53:25.954102 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68c1877-61e4-4620-b311-6e375e9366f2 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:25.968069 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1365/2691] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:53:25 2022] PUT /identity/v3/projects/c4a7b4a34e23487eac6356863d9d6dfe/users/4fc5c6e5dd3e422d8d40388ff125c0a8/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:53:25.971983 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a9f01d-66c8-4dc5-9db4-8cd3b3a175d8 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:25.982087 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a9f01d-66c8-4dc5-9db4-8cd3b3a175d8 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:25.990069 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:26.044182 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7938d12f-9871-4369-8d9b-6d45395e7a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:26.044980 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938d12f-9871-4369-8d9b-6d45395e7a98 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:26.045284 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938d12f-9871-4369-8d9b-6d45395e7a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:26.045567 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7938d12f-9871-4369-8d9b-6d45395e7a98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:26.046305 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7938d12f-9871-4369-8d9b-6d45395e7a98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:26.047979 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7938d12f-9871-4369-8d9b-6d45395e7a98 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:26.058871 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1327/2692] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:53:26.063057 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c1877-61e4-4620-b311-6e375e9366f2 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:26.074725 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68c1877-61e4-4620-b311-6e375e9366f2 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:26.080976 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52236df-6b2c-4129-96a7-23c0ea9a265e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:26.081873 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52236df-6b2c-4129-96a7-23c0ea9a265e admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:26.082159 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52236df-6b2c-4129-96a7-23c0ea9a265e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:26.082611 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52236df-6b2c-4129-96a7-23c0ea9a265e admin admin] PATH_INFO: `/v3/projects/c4a7b4a34e23487eac6356863d9d6dfe/users/4fc5c6e5dd3e422d8d40388ff125c0a8/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:26.084643 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52236df-6b2c-4129-96a7-23c0ea9a265e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4a7b4a34e23487eac6356863d9d6dfe, user_id=4fc5c6e5dd3e422d8d40388ff125c0a8, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:26.087494 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52236df-6b2c-4129-96a7-23c0ea9a265e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:26.099362 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1366/2693] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:53:26 2022] PUT /identity/v3/projects/c4a7b4a34e23487eac6356863d9d6dfe/users/4fc5c6e5dd3e422d8d40388ff125c0a8/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:53:26.112378 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3892adb-5d6f-4f48-9eae-b8209b14aa12 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:26.112378 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3892adb-5d6f-4f48-9eae-b8209b14aa12 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:26.112635 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3892adb-5d6f-4f48-9eae-b8209b14aa12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:26.144287 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-a3892adb-5d6f-4f48-9eae-b8209b14aa12 None None] MFA Rules not processed for user `4fc5c6e5dd3e422d8d40388ff125c0a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:26.145945 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a3892adb-5d6f-4f48-9eae-b8209b14aa12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:26.229207 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1328/2694] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:26 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:53:26.241090 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52236df-6b2c-4129-96a7-23c0ea9a265e admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:26.246660 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b52236df-6b2c-4129-96a7-23c0ea9a265e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:26.318472 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:26.322691 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52236df-6b2c-4129-96a7-23c0ea9a265e admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:26.327776 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef028ec-79a2-47ba-aa15-cfc883e2687c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:26.328428 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef028ec-79a2-47ba-aa15-cfc883e2687c service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:26.328713 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef028ec-79a2-47ba-aa15-cfc883e2687c service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:26.328989 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef028ec-79a2-47ba-aa15-cfc883e2687c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:26.338176 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef028ec-79a2-47ba-aa15-cfc883e2687c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:26.339635 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef028ec-79a2-47ba-aa15-cfc883e2687c service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:26.349151 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1367/2695] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:53:26 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:53:26.394726 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3892adb-5d6f-4f48-9eae-b8209b14aa12 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:26.396119 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a3892adb-5d6f-4f48-9eae-b8209b14aa12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:26.408320 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3892adb-5d6f-4f48-9eae-b8209b14aa12 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:26.412649 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af2cde-d39b-4ec2-afd5-81fd8857281c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:26.413299 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af2cde-d39b-4ec2-afd5-81fd8857281c service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:26.413580 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af2cde-d39b-4ec2-afd5-81fd8857281c service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:26.413855 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af2cde-d39b-4ec2-afd5-81fd8857281c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:26.475183 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af2cde-d39b-4ec2-afd5-81fd8857281c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:26.476635 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af2cde-d39b-4ec2-afd5-81fd8857281c service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:26.486024 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1329/2696] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:53:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 03:53:29.330549 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef028ec-79a2-47ba-aa15-cfc883e2687c service cinder] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:29.332503 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6ef028ec-79a2-47ba-aa15-cfc883e2687c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:29.398114 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef028ec-79a2-47ba-aa15-cfc883e2687c service cinder] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:29.402606 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9596e93f-af97-4feb-9607-b57ed825959f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:29.403484 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596e93f-af97-4feb-9607-b57ed825959f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:29.403773 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596e93f-af97-4feb-9607-b57ed825959f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:29.404054 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9596e93f-af97-4feb-9607-b57ed825959f admin admin] PATH_INFO: `/v3/users/80ed200a0cd740e8a0b857690584404e` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:29.405244 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9596e93f-af97-4feb-9607-b57ed825959f admin admin] RBAC: Authorizing `identity:delete_user(user_id=80ed200a0cd740e8a0b857690584404e)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:29.407227 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9596e93f-af97-4feb-9607-b57ed825959f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:29.455258 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9596e93f-af97-4feb-9607-b57ed825959f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80ed200a0cd740e8a0b857690584404e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:29.455909 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9596e93f-af97-4feb-9607-b57ed825959f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80ed200a0cd740e8a0b857690584404e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:29.456522 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9596e93f-af97-4feb-9607-b57ed825959f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80ed200a0cd740e8a0b857690584404e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:29.463523 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9596e93f-af97-4feb-9607-b57ed825959f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80ed200a0cd740e8a0b857690584404e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:29.470568 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-9596e93f-af97-4feb-9607-b57ed825959f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80ed200a0cd740e8a0b857690584404e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:29.489835 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1368/2697] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:53:29 2022] DELETE /identity/v3/users/80ed200a0cd740e8a0b857690584404e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:53:29.664418 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af2cde-d39b-4ec2-afd5-81fd8857281c service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:29.676779 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af2cde-d39b-4ec2-afd5-81fd8857281c service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:29.711856 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:29.739808 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafd38d-a5a1-4773-b030-22518b9c656e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:29.740726 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafd38d-a5a1-4773-b030-22518b9c656e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:29.741012 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafd38d-a5a1-4773-b030-22518b9c656e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:29.741288 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bafd38d-a5a1-4773-b030-22518b9c656e admin admin] PATH_INFO: `/v3/projects/2225bec556df4bf8bdbc315dc9888cb2` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:29.742507 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bafd38d-a5a1-4773-b030-22518b9c656e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2225bec556df4bf8bdbc315dc9888cb2)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:29.744433 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bafd38d-a5a1-4773-b030-22518b9c656e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:29.791945 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5bafd38d-a5a1-4773-b030-22518b9c656e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2225bec556df4bf8bdbc315dc9888cb2', 'request_id': 'req-5bafd38d-a5a1-4773-b030-22518b9c656e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:29.799180 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5bafd38d-a5a1-4773-b030-22518b9c656e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2225bec556df4bf8bdbc315dc9888cb2', 'request_id': 'req-5bafd38d-a5a1-4773-b030-22518b9c656e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:29.807867 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5bafd38d-a5a1-4773-b030-22518b9c656e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2225bec556df4bf8bdbc315dc9888cb2', 'request_id': 'req-5bafd38d-a5a1-4773-b030-22518b9c656e'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:29.819005 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5bafd38d-a5a1-4773-b030-22518b9c656e admin admin] The token cache is being invalidate because project 2225bec556df4bf8bdbc315dc9888cb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:53:29.819295 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5bafd38d-a5a1-4773-b030-22518b9c656e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:29.819924 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5bafd38d-a5a1-4773-b030-22518b9c656e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:29.821475 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1330/2698] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:53:29 2022] DELETE /identity/v3/projects/2225bec556df4bf8bdbc315dc9888cb2 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:53:29.827416 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da00ff-2f81-4087-8aee-cb8b159c7dd7 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:29.827869 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da00ff-2f81-4087-8aee-cb8b159c7dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:29.828208 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da00ff-2f81-4087-8aee-cb8b159c7dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:29.849511 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d0da00ff-2f81-4087-8aee-cb8b159c7dd7 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:29.851258 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d0da00ff-2f81-4087-8aee-cb8b159c7dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:29.862006 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafd38d-a5a1-4773-b030-22518b9c656e admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:29.863524 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5bafd38d-a5a1-4773-b030-22518b9c656e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:29.911335 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1369/2699] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:53:29.919412 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b33067-4359-4da1-8fd4-e23526b68185 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:29.919706 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b33067-4359-4da1-8fd4-e23526b68185 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:29.919986 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b33067-4359-4da1-8fd4-e23526b68185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:29.928353 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bafd38d-a5a1-4773-b030-22518b9c656e admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:29.933017 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60e525-d191-44e9-9ccd-18a771740fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:29.933896 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60e525-d191-44e9-9ccd-18a771740fef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:29.934183 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60e525-d191-44e9-9ccd-18a771740fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:29.934482 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60e525-d191-44e9-9ccd-18a771740fef admin admin] PATH_INFO: `/v3/users/2d65b06856b3468cb9a9a201245da5cc` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:29.935722 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f60e525-d191-44e9-9ccd-18a771740fef admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d65b06856b3468cb9a9a201245da5cc)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:29.937154 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b2b33067-4359-4da1-8fd4-e23526b68185 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:29.937662 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f60e525-d191-44e9-9ccd-18a771740fef admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:29.938343 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b2b33067-4359-4da1-8fd4-e23526b68185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:29.946605 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1370/2700] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:53:29.950601 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b33067-4359-4da1-8fd4-e23526b68185 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:29.956220 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:29.960615 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b33067-4359-4da1-8fd4-e23526b68185 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:29.967321 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811f11d-c0f3-4d2b-a420-3e65631c0788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:29.968121 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811f11d-c0f3-4d2b-a420-3e65631c0788 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:29.968659 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811f11d-c0f3-4d2b-a420-3e65631c0788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:29.969143 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e811f11d-c0f3-4d2b-a420-3e65631c0788 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:29.969967 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e811f11d-c0f3-4d2b-a420-3e65631c0788 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:53:29.970402 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e811f11d-c0f3-4d2b-a420-3e65631c0788 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:29.972241 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e811f11d-c0f3-4d2b-a420-3e65631c0788 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:29.984845 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1371/2701] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:53:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:53:29.987242 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6f60e525-d191-44e9-9ccd-18a771740fef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d65b06856b3468cb9a9a201245da5cc'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:29.987905 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6f60e525-d191-44e9-9ccd-18a771740fef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d65b06856b3468cb9a9a201245da5cc'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:29.988607 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6f60e525-d191-44e9-9ccd-18a771740fef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d65b06856b3468cb9a9a201245da5cc'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:29.989209 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811f11d-c0f3-4d2b-a420-3e65631c0788 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:29.990975 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e811f11d-c0f3-4d2b-a420-3e65631c0788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:29.995824 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6f60e525-d191-44e9-9ccd-18a771740fef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d65b06856b3468cb9a9a201245da5cc'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:30.004262 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6f60e525-d191-44e9-9ccd-18a771740fef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d65b06856b3468cb9a9a201245da5cc'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:30.004436 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e811f11d-c0f3-4d2b-a420-3e65631c0788 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:30.005481 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:30.010589 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d67868-3c16-4cc5-8526-bfb335d50a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:30.011899 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d67868-3c16-4cc5-8526-bfb335d50a99 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:30.012293 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d67868-3c16-4cc5-8526-bfb335d50a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:30.012577 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d67868-3c16-4cc5-8526-bfb335d50a99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:30.013273 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d67868-3c16-4cc5-8526-bfb335d50a99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:30.015569 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d67868-3c16-4cc5-8526-bfb335d50a99 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:30.025156 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1331/2702] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:53:29 2022] DELETE /identity/v3/users/2d65b06856b3468cb9a9a201245da5cc => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:53:30.029633 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704effc-180f-4512-884d-b8d188c0f7c6 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:30.029926 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704effc-180f-4512-884d-b8d188c0f7c6 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:30.030208 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704effc-180f-4512-884d-b8d188c0f7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:30.047319 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1372/2703] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:53:29 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:53:30.048211 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d67868-3c16-4cc5-8526-bfb335d50a99 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:30.048418 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-6704effc-180f-4512-884d-b8d188c0f7c6 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:30.049703 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6704effc-180f-4512-884d-b8d188c0f7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:30.113253 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1332/2704] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:53:30.114280 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d67868-3c16-4cc5-8526-bfb335d50a99 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:30.121818 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142c55b-ed57-4f3d-a33f-b8d3027ffacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:30.122530 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142c55b-ed57-4f3d-a33f-b8d3027ffacf admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:30.122823 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142c55b-ed57-4f3d-a33f-b8d3027ffacf admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:30.122945 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6704effc-180f-4512-884d-b8d188c0f7c6 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:30.123102 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142c55b-ed57-4f3d-a33f-b8d3027ffacf admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:30.123838 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142c55b-ed57-4f3d-a33f-b8d3027ffacf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:30.124526 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6704effc-180f-4512-884d-b8d188c0f7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:30.125721 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142c55b-ed57-4f3d-a33f-b8d3027ffacf admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:30.148862 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1373/2705] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:53:30 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:53:30.152838 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142c55b-ed57-4f3d-a33f-b8d3027ffacf admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:30.162854 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142c55b-ed57-4f3d-a33f-b8d3027ffacf admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:30.168479 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94789c5f-ff94-425b-aea8-eb574ccc3f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:30.169148 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94789c5f-ff94-425b-aea8-eb574ccc3f02 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:30.169561 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94789c5f-ff94-425b-aea8-eb574ccc3f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:30.169854 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94789c5f-ff94-425b-aea8-eb574ccc3f02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:30.170629 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94789c5f-ff94-425b-aea8-eb574ccc3f02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:30.172355 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94789c5f-ff94-425b-aea8-eb574ccc3f02 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:30.182987 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1374/2706] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 03:53:30.186852 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94789c5f-ff94-425b-aea8-eb574ccc3f02 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:30.190064 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6704effc-180f-4512-884d-b8d188c0f7c6 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:30.196562 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35070949-4174-40d9-8593-66772795667b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:30.197221 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35070949-4174-40d9-8593-66772795667b service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:30.197519 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35070949-4174-40d9-8593-66772795667b service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:30.197803 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35070949-4174-40d9-8593-66772795667b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:30.198756 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94789c5f-ff94-425b-aea8-eb574ccc3f02 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:30.203617 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fcfc08-6733-4927-8587-6547a4920a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:30.204384 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcfc08-6733-4927-8587-6547a4920a99 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:30.204778 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcfc08-6733-4927-8587-6547a4920a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:30.205169 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fcfc08-6733-4927-8587-6547a4920a99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:30.206011 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fcfc08-6733-4927-8587-6547a4920a99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:30.207779 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fcfc08-6733-4927-8587-6547a4920a99 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:30.207940 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35070949-4174-40d9-8593-66772795667b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:30.210042 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35070949-4174-40d9-8593-66772795667b service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:30.223667 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1375/2707] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:53:30.224796 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fcfc08-6733-4927-8587-6547a4920a99 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:30.226926 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1333/2708] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:53:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 03:53:30.248900 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fcfc08-6733-4927-8587-6547a4920a99 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:30.255117 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fabbb6-c2fe-47c3-816e-6818c71462f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:30.257771 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fabbb6-c2fe-47c3-816e-6818c71462f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:30.258097 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fabbb6-c2fe-47c3-816e-6818c71462f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:30.258433 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fabbb6-c2fe-47c3-816e-6818c71462f0 admin admin] PATH_INFO: `/v3/projects/da9a275c8461457384606d7676d3c2e3/users/0cd1962046ad418692206b64c814b22c/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:30.277565 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fabbb6-c2fe-47c3-816e-6818c71462f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da9a275c8461457384606d7676d3c2e3, user_id=0cd1962046ad418692206b64c814b22c, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:30.280251 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fabbb6-c2fe-47c3-816e-6818c71462f0 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:30.304702 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1376/2709] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:53:30 2022] PUT /identity/v3/projects/da9a275c8461457384606d7676d3c2e3/users/0cd1962046ad418692206b64c814b22c/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:53:30.315475 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a03841-42c6-4154-a20e-4eddafcb8fe2 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:30.315774 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a03841-42c6-4154-a20e-4eddafcb8fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:30.316121 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a03841-42c6-4154-a20e-4eddafcb8fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:30.345819 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-f0a03841-42c6-4154-a20e-4eddafcb8fe2 None None] MFA Rules not processed for user `0cd1962046ad418692206b64c814b22c`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:30.347081 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f0a03841-42c6-4154-a20e-4eddafcb8fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:30.423414 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1334/2710] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:53:30.427660 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fabbb6-c2fe-47c3-816e-6818c71462f0 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:30.495993 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fabbb6-c2fe-47c3-816e-6818c71462f0 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:30.502040 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03336f-b917-47ac-ad29-d0d4e9472029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:30.502902 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03336f-b917-47ac-ad29-d0d4e9472029 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:30.503196 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03336f-b917-47ac-ad29-d0d4e9472029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:30.503482 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03336f-b917-47ac-ad29-d0d4e9472029 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:30.504197 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d03336f-b917-47ac-ad29-d0d4e9472029 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:30.506117 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d03336f-b917-47ac-ad29-d0d4e9472029 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:30.509780 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a03841-42c6-4154-a20e-4eddafcb8fe2 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:30.511514 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-f0a03841-42c6-4154-a20e-4eddafcb8fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:30.527707 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a03841-42c6-4154-a20e-4eddafcb8fe2 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:30.528956 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:30.537833 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ad0ff-7980-4f80-a0c8-b3cc653415ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:30.538780 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ad0ff-7980-4f80-a0c8-b3cc653415ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:30.539017 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ad0ff-7980-4f80-a0c8-b3cc653415ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:30.539288 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ad0ff-7980-4f80-a0c8-b3cc653415ce admin admin] PATH_INFO: `/v3/projects/e08fb6c3aea946558692a7b7bf8a3f32` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:30.540771 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ad0ff-7980-4f80-a0c8-b3cc653415ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=e08fb6c3aea946558692a7b7bf8a3f32)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:30.542764 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ad0ff-7980-4f80-a0c8-b3cc653415ce admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:30.545783 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1377/2711] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:53:30 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:53:30.546991 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03336f-b917-47ac-ad29-d0d4e9472029 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:30.556269 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:30.602653 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-486ad0ff-7980-4f80-a0c8-b3cc653415ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e08fb6c3aea946558692a7b7bf8a3f32', 'request_id': 'req-486ad0ff-7980-4f80-a0c8-b3cc653415ce'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:30.609655 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-486ad0ff-7980-4f80-a0c8-b3cc653415ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e08fb6c3aea946558692a7b7bf8a3f32', 'request_id': 'req-486ad0ff-7980-4f80-a0c8-b3cc653415ce'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:30.618918 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-486ad0ff-7980-4f80-a0c8-b3cc653415ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e08fb6c3aea946558692a7b7bf8a3f32', 'request_id': 'req-486ad0ff-7980-4f80-a0c8-b3cc653415ce'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:30.633205 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-486ad0ff-7980-4f80-a0c8-b3cc653415ce admin admin] The token cache is being invalidate because project e08fb6c3aea946558692a7b7bf8a3f32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:53:30.633592 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-486ad0ff-7980-4f80-a0c8-b3cc653415ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:30.634486 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-486ad0ff-7980-4f80-a0c8-b3cc653415ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:30.634626 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03336f-b917-47ac-ad29-d0d4e9472029 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:30.636083 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1335/2712] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:53:30 2022] DELETE /identity/v3/projects/e08fb6c3aea946558692a7b7bf8a3f32 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:53:30.640343 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ad0ff-7980-4f80-a0c8-b3cc653415ce admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:30.641762 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-486ad0ff-7980-4f80-a0c8-b3cc653415ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:30.699127 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a847f4b-c1cf-48c5-b129-fb9155c2fe7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:30.700090 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a847f4b-c1cf-48c5-b129-fb9155c2fe7a admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:30.700456 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a847f4b-c1cf-48c5-b129-fb9155c2fe7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:30.700742 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a847f4b-c1cf-48c5-b129-fb9155c2fe7a admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:30.701443 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a847f4b-c1cf-48c5-b129-fb9155c2fe7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:30.703709 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a847f4b-c1cf-48c5-b129-fb9155c2fe7a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:30.713100 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ad0ff-7980-4f80-a0c8-b3cc653415ce admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:30.719884 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de3ec6-9e0c-4da5-84cc-3b8b0bb0b7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:30.720778 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de3ec6-9e0c-4da5-84cc-3b8b0bb0b7a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:30.721066 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de3ec6-9e0c-4da5-84cc-3b8b0bb0b7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:30.721349 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de3ec6-9e0c-4da5-84cc-3b8b0bb0b7a2 admin admin] PATH_INFO: `/v3/users/4fc5c6e5dd3e422d8d40388ff125c0a8` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:30.722740 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2de3ec6-9e0c-4da5-84cc-3b8b0bb0b7a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fc5c6e5dd3e422d8d40388ff125c0a8)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:30.725434 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2de3ec6-9e0c-4da5-84cc-3b8b0bb0b7a2 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:30.725881 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1378/2713] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:53:30 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:53:30.729443 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a847f4b-c1cf-48c5-b129-fb9155c2fe7a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:30.731145 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-5a847f4b-c1cf-48c5-b129-fb9155c2fe7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:30.743179 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a847f4b-c1cf-48c5-b129-fb9155c2fe7a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:30.747869 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d96f1b-fb85-4efa-a99c-e56ffd32cbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:30.748531 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d96f1b-fb85-4efa-a99c-e56ffd32cbdc admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:30.748819 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d96f1b-fb85-4efa-a99c-e56ffd32cbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:30.749101 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d96f1b-fb85-4efa-a99c-e56ffd32cbdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:30.749955 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d96f1b-fb85-4efa-a99c-e56ffd32cbdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:30.752188 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d96f1b-fb85-4efa-a99c-e56ffd32cbdc admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:30.767453 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1379/2714] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 03:53:30.768457 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d96f1b-fb85-4efa-a99c-e56ffd32cbdc admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:30.777183 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f2de3ec6-9e0c-4da5-84cc-3b8b0bb0b7a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fc5c6e5dd3e422d8d40388ff125c0a8'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:30.777843 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f2de3ec6-9e0c-4da5-84cc-3b8b0bb0b7a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fc5c6e5dd3e422d8d40388ff125c0a8'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:30.778492 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f2de3ec6-9e0c-4da5-84cc-3b8b0bb0b7a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fc5c6e5dd3e422d8d40388ff125c0a8'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:30.779148 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d96f1b-fb85-4efa-a99c-e56ffd32cbdc admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:30.783906 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0f6ff-87a0-439d-b187-d0c87e02b236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:30.784804 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0f6ff-87a0-439d-b187-d0c87e02b236 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:30.785110 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0f6ff-87a0-439d-b187-d0c87e02b236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:30.785393 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0f6ff-87a0-439d-b187-d0c87e02b236 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:30.785991 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f2de3ec6-9e0c-4da5-84cc-3b8b0bb0b7a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fc5c6e5dd3e422d8d40388ff125c0a8'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:30.786098 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec0f6ff-87a0-439d-b187-d0c87e02b236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:30.787793 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec0f6ff-87a0-439d-b187-d0c87e02b236 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:30.793548 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-f2de3ec6-9e0c-4da5-84cc-3b8b0bb0b7a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fc5c6e5dd3e422d8d40388ff125c0a8'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:30.799151 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1380/2715] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:53:30.802927 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0f6ff-87a0-439d-b187-d0c87e02b236 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:30.804638 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-dec0f6ff-87a0-439d-b187-d0c87e02b236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:30.814727 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1336/2716] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:53:30 2022] DELETE /identity/v3/users/4fc5c6e5dd3e422d8d40388ff125c0a8 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:53:30.817473 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0f6ff-87a0-439d-b187-d0c87e02b236 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:30.875202 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f36cb5-e115-4370-b02b-d1063a71a2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:30.876096 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f36cb5-e115-4370-b02b-d1063a71a2de admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:30.876456 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f36cb5-e115-4370-b02b-d1063a71a2de admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:30.876661 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f36cb5-e115-4370-b02b-d1063a71a2de admin admin] PATH_INFO: `/v3/projects/2ed9c6b2d1a34617a5c8241be27e3fb1/users/c711183e6f414b01b105acd5012261cd/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:30.893903 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f36cb5-e115-4370-b02b-d1063a71a2de admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ed9c6b2d1a34617a5c8241be27e3fb1, user_id=c711183e6f414b01b105acd5012261cd, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:30.897310 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f36cb5-e115-4370-b02b-d1063a71a2de admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:30.900512 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:30.912353 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1381/2717] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:53:30 2022] PUT /identity/v3/projects/2ed9c6b2d1a34617a5c8241be27e3fb1/users/c711183e6f414b01b105acd5012261cd/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:53:30.922262 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e10310-6a3a-4e9c-a942-64b1ac434ed6 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:30.922747 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e10310-6a3a-4e9c-a942-64b1ac434ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:30.923100 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e10310-6a3a-4e9c-a942-64b1ac434ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:30.950699 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-a8e10310-6a3a-4e9c-a942-64b1ac434ed6 None None] MFA Rules not processed for user `c711183e6f414b01b105acd5012261cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:30.952027 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a8e10310-6a3a-4e9c-a942-64b1ac434ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:30.965409 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:31.029883 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1337/2718] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:53:31.034369 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f36cb5-e115-4370-b02b-d1063a71a2de admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:31.087813 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e10310-6a3a-4e9c-a942-64b1ac434ed6 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:31.089874 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a8e10310-6a3a-4e9c-a942-64b1ac434ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:31.104040 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f36cb5-e115-4370-b02b-d1063a71a2de admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:31.107107 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e10310-6a3a-4e9c-a942-64b1ac434ed6 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:31.110543 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef93acb-e408-4d67-89cd-e49220803590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:31.111684 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef93acb-e408-4d67-89cd-e49220803590 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:31.112147 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef93acb-e408-4d67-89cd-e49220803590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:31.112466 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef93acb-e408-4d67-89cd-e49220803590 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:31.112588 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd23079-0853-4c53-9075-06b16cacf5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:31.113245 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef93acb-e408-4d67-89cd-e49220803590 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:31.113659 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd23079-0853-4c53-9075-06b16cacf5c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:31.114055 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd23079-0853-4c53-9075-06b16cacf5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:31.114432 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd23079-0853-4c53-9075-06b16cacf5c2 admin admin] PATH_INFO: `/v3/projects/c4a7b4a34e23487eac6356863d9d6dfe` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:31.116422 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd23079-0853-4c53-9075-06b16cacf5c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4a7b4a34e23487eac6356863d9d6dfe)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:31.116939 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef93acb-e408-4d67-89cd-e49220803590 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:31.119303 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd23079-0853-4c53-9075-06b16cacf5c2 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:31.153815 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1382/2719] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:53:31 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:53:31.154993 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef93acb-e408-4d67-89cd-e49220803590 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:31.175367 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ddd23079-0853-4c53-9075-06b16cacf5c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4a7b4a34e23487eac6356863d9d6dfe', 'request_id': 'req-ddd23079-0853-4c53-9075-06b16cacf5c2'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:31.181535 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ddd23079-0853-4c53-9075-06b16cacf5c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4a7b4a34e23487eac6356863d9d6dfe', 'request_id': 'req-ddd23079-0853-4c53-9075-06b16cacf5c2'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:31.188494 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ddd23079-0853-4c53-9075-06b16cacf5c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4a7b4a34e23487eac6356863d9d6dfe', 'request_id': 'req-ddd23079-0853-4c53-9075-06b16cacf5c2'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:31.199607 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ddd23079-0853-4c53-9075-06b16cacf5c2 admin admin] The token cache is being invalidate because project c4a7b4a34e23487eac6356863d9d6dfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:53:31.199899 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ddd23079-0853-4c53-9075-06b16cacf5c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:31.200737 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-ddd23079-0853-4c53-9075-06b16cacf5c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:31.202315 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1338/2720] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:53:31 2022] DELETE /identity/v3/projects/c4a7b4a34e23487eac6356863d9d6dfe => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:53:31.206984 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ac205-a5c8-4391-a0be-d83c13ec7502 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:31.207326 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ac205-a5c8-4391-a0be-d83c13ec7502 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:31.207610 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358ac205-a5c8-4391-a0be-d83c13ec7502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:31.219540 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef93acb-e408-4d67-89cd-e49220803590 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:31.226392 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-358ac205-a5c8-4391-a0be-d83c13ec7502 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:31.227611 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-358ac205-a5c8-4391-a0be-d83c13ec7502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:31.275627 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36d6d42-5d3e-4f12-b260-f55ae0d9543f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:31.276302 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d6d42-5d3e-4f12-b260-f55ae0d9543f admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:31.276585 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d6d42-5d3e-4f12-b260-f55ae0d9543f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:31.276865 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36d6d42-5d3e-4f12-b260-f55ae0d9543f admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:31.277548 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36d6d42-5d3e-4f12-b260-f55ae0d9543f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:31.279529 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36d6d42-5d3e-4f12-b260-f55ae0d9543f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:31.290416 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1339/2721] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:53:31.299504 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49fa05-df80-461c-ad97-e8c6b00582d2 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:31.300352 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49fa05-df80-461c-ad97-e8c6b00582d2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:31.300352 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a49fa05-df80-461c-ad97-e8c6b00582d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:31.304318 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1383/2722] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:53:31 2022] POST /identity/v3/users => generated 299 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:53:31.305313 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36d6d42-5d3e-4f12-b260-f55ae0d9543f admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:31.307344 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e36d6d42-5d3e-4f12-b260-f55ae0d9543f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:31.319719 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-6a49fa05-df80-461c-ad97-e8c6b00582d2 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:31.321196 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6a49fa05-df80-461c-ad97-e8c6b00582d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:31.324264 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36d6d42-5d3e-4f12-b260-f55ae0d9543f admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:31.329960 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661aac9-d86c-40d7-a107-46d21709e670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:31.330150 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1340/2723] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:53:31.330400 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661aac9-d86c-40d7-a107-46d21709e670 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:31.330726 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661aac9-d86c-40d7-a107-46d21709e670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:31.331003 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a661aac9-d86c-40d7-a107-46d21709e670 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:31.331775 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a661aac9-d86c-40d7-a107-46d21709e670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:31.333446 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a661aac9-d86c-40d7-a107-46d21709e670 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:31.334533 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a49fa05-df80-461c-ad97-e8c6b00582d2 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:31.344953 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a49fa05-df80-461c-ad97-e8c6b00582d2 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:31.348151 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1384/2724] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 03:53:31.349208 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661aac9-d86c-40d7-a107-46d21709e670 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:31.350432 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233fddf4-394c-4640-a402-23a2f89bc765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:31.351392 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fddf4-394c-4640-a402-23a2f89bc765 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:31.351683 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fddf4-394c-4640-a402-23a2f89bc765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:31.351964 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fddf4-394c-4640-a402-23a2f89bc765 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:31.352708 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233fddf4-394c-4640-a402-23a2f89bc765 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:53:31.353022 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233fddf4-394c-4640-a402-23a2f89bc765 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:31.354820 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233fddf4-394c-4640-a402-23a2f89bc765 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:31.361218 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a661aac9-d86c-40d7-a107-46d21709e670 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:31.366221 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e2a36-24f0-411b-9eee-b52e791022dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:31.367330 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e2a36-24f0-411b-9eee-b52e791022dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:31.367622 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e2a36-24f0-411b-9eee-b52e791022dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:31.367905 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45e2a36-24f0-411b-9eee-b52e791022dc admin admin] PATH_INFO: `/v3/projects/31c6c93ddb304c2188c3a07a533671c0/users/bba3e9a3bba8497093600eb781dc3165/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:31.370908 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:31.373728 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1341/2725] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:53:31.374718 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233fddf4-394c-4640-a402-23a2f89bc765 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:31.384550 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233fddf4-394c-4640-a402-23a2f89bc765 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:31.386869 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e2a36-24f0-411b-9eee-b52e791022dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=31c6c93ddb304c2188c3a07a533671c0, user_id=bba3e9a3bba8497093600eb781dc3165, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:31.389647 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45e2a36-24f0-411b-9eee-b52e791022dc admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:31.392606 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7879a83-1e88-4a82-ab21-19e66609f891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:31.393515 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7879a83-1e88-4a82-ab21-19e66609f891 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:31.393896 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7879a83-1e88-4a82-ab21-19e66609f891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:31.394316 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7879a83-1e88-4a82-ab21-19e66609f891 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:31.395458 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7879a83-1e88-4a82-ab21-19e66609f891 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:31.400740 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7879a83-1e88-4a82-ab21-19e66609f891 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:31.406526 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:31.413941 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1385/2726] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:53:31 2022] PUT /identity/v3/projects/31c6c93ddb304c2188c3a07a533671c0/users/bba3e9a3bba8497093600eb781dc3165/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:53:31.416394 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e2a36-24f0-411b-9eee-b52e791022dc admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:31.441894 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1342/2727] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:53:31 2022] POST /identity/v3/projects => generated 359 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:53:31.443036 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7879a83-1e88-4a82-ab21-19e66609f891 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:31.494540 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45e2a36-24f0-411b-9eee-b52e791022dc admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:31.532530 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7879a83-1e88-4a82-ab21-19e66609f891 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:31.537484 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795bf87-cab9-4125-9ad6-8059153d17a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:31.538153 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795bf87-cab9-4125-9ad6-8059153d17a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:31.538442 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795bf87-cab9-4125-9ad6-8059153d17a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:31.538750 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795bf87-cab9-4125-9ad6-8059153d17a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:31.539527 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1795bf87-cab9-4125-9ad6-8059153d17a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:31.541364 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1795bf87-cab9-4125-9ad6-8059153d17a2 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:31.554199 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644972d-6636-4fb0-9477-5f641880ab6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:31.555239 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644972d-6636-4fb0-9477-5f641880ab6c admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:31.555634 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644972d-6636-4fb0-9477-5f641880ab6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:31.556029 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2644972d-6636-4fb0-9477-5f641880ab6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:31.556774 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2644972d-6636-4fb0-9477-5f641880ab6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:31.558655 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2644972d-6636-4fb0-9477-5f641880ab6c admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:31.563099 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1343/2728] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:53:31 2022] POST /identity/v3/users => generated 280 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:53:31.567134 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795bf87-cab9-4125-9ad6-8059153d17a2 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:31.572143 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1386/2729] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 03:53:31.576009 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644972d-6636-4fb0-9477-5f641880ab6c admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:31.580464 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795bf87-cab9-4125-9ad6-8059153d17a2 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:31.586010 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6eacf-057c-4ec7-aecf-97b349e35f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:31.586153 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2644972d-6636-4fb0-9477-5f641880ab6c admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:31.586714 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6eacf-057c-4ec7-aecf-97b349e35f22 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:31.587005 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6eacf-057c-4ec7-aecf-97b349e35f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:31.587286 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6eacf-057c-4ec7-aecf-97b349e35f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:31.588014 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6eacf-057c-4ec7-aecf-97b349e35f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:31.589773 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6eacf-057c-4ec7-aecf-97b349e35f22 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:31.590668 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d0e8b3-e52c-4c7b-9e65-a494c5858d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:31.591523 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0e8b3-e52c-4c7b-9e65-a494c5858d2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:31.591808 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0e8b3-e52c-4c7b-9e65-a494c5858d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:31.592078 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d0e8b3-e52c-4c7b-9e65-a494c5858d2f admin admin] PATH_INFO: `/v3/projects/31c6c93ddb304c2188c3a07a533671c0/users/bba3e9a3bba8497093600eb781dc3165/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:31.594251 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d0e8b3-e52c-4c7b-9e65-a494c5858d2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=31c6c93ddb304c2188c3a07a533671c0, user_id=bba3e9a3bba8497093600eb781dc3165, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:31.596967 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d0e8b3-e52c-4c7b-9e65-a494c5858d2f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:31.600469 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1344/2730] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 03:53:31.604300 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6eacf-057c-4ec7-aecf-97b349e35f22 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:31.607626 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1387/2731] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:53:31 2022] PUT /identity/v3/projects/31c6c93ddb304c2188c3a07a533671c0/users/bba3e9a3bba8497093600eb781dc3165/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:53:31.613904 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6eacf-057c-4ec7-aecf-97b349e35f22 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:31.617530 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be958b-bf89-4398-b9d7-32d36473e25a None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:31.617809 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be958b-bf89-4398-b9d7-32d36473e25a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:31.618095 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be958b-bf89-4398-b9d7-32d36473e25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:31.645309 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-30be958b-bf89-4398-b9d7-32d36473e25a None None] MFA Rules not processed for user `bba3e9a3bba8497093600eb781dc3165`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:31.647191 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-30be958b-bf89-4398-b9d7-32d36473e25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:31.671904 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1b145-8c78-4796-b928-78e64d449743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:31.672711 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1b145-8c78-4796-b928-78e64d449743 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:31.673111 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1b145-8c78-4796-b928-78e64d449743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:31.673491 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1b145-8c78-4796-b928-78e64d449743 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:31.674331 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1b145-8c78-4796-b928-78e64d449743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:31.676062 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1b145-8c78-4796-b928-78e64d449743 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:31.685809 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1345/2732] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:53:31.690192 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1b145-8c78-4796-b928-78e64d449743 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:31.702988 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1b145-8c78-4796-b928-78e64d449743 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:31.707604 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26639541-4189-4dc2-9405-2459ae4e2e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:31.708496 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26639541-4189-4dc2-9405-2459ae4e2e71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:31.708811 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26639541-4189-4dc2-9405-2459ae4e2e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:31.709643 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26639541-4189-4dc2-9405-2459ae4e2e71 admin admin] PATH_INFO: `/v3/projects/c475a7bb22314aaea191de94c5daf5a6/users/82871e0b694d4d74aa513e1d162f50f7/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:31.716412 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:31.723592 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1388/2733] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:53:31.728135 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26639541-4189-4dc2-9405-2459ae4e2e71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c475a7bb22314aaea191de94c5daf5a6, user_id=82871e0b694d4d74aa513e1d162f50f7, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:31.730822 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26639541-4189-4dc2-9405-2459ae4e2e71 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:31.734276 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be958b-bf89-4398-b9d7-32d36473e25a None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:31.735906 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-30be958b-bf89-4398-b9d7-32d36473e25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:31.748239 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1346/2734] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:53:31 2022] PUT /identity/v3/projects/c475a7bb22314aaea191de94c5daf5a6/users/82871e0b694d4d74aa513e1d162f50f7/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:53:31.758978 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd28e49-c5fc-4ec5-b06b-74893da7ec23 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:31.759269 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd28e49-c5fc-4ec5-b06b-74893da7ec23 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:31.759553 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd28e49-c5fc-4ec5-b06b-74893da7ec23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:31.788588 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-cdd28e49-c5fc-4ec5-b06b-74893da7ec23 None None] MFA Rules not processed for user `82871e0b694d4d74aa513e1d162f50f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:31.789813 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-cdd28e49-c5fc-4ec5-b06b-74893da7ec23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:31.813905 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be958b-bf89-4398-b9d7-32d36473e25a None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:31.815310 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:31.860502 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1347/2735] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:31 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:53:31.863329 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d560636-f2ed-472a-ad19-fe5cd1b4dca1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:31.864058 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d560636-f2ed-472a-ad19-fe5cd1b4dca1 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:31.864341 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d560636-f2ed-472a-ad19-fe5cd1b4dca1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:31.864714 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d560636-f2ed-472a-ad19-fe5cd1b4dca1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:31.891564 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd28e49-c5fc-4ec5-b06b-74893da7ec23 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:31.893761 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-cdd28e49-c5fc-4ec5-b06b-74893da7ec23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:31.905666 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd28e49-c5fc-4ec5-b06b-74893da7ec23 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:31.909340 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce8291-7bfd-464d-a66f-a6b62e2b8fad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:31.910377 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce8291-7bfd-464d-a66f-a6b62e2b8fad service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:31.910696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce8291-7bfd-464d-a66f-a6b62e2b8fad service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:31.910977 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce8291-7bfd-464d-a66f-a6b62e2b8fad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:31.919867 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce8291-7bfd-464d-a66f-a6b62e2b8fad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:31.921298 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ce8291-7bfd-464d-a66f-a6b62e2b8fad service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:31.926695 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d560636-f2ed-472a-ad19-fe5cd1b4dca1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:31.928650 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d560636-f2ed-472a-ad19-fe5cd1b4dca1 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:31.931641 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1348/2736] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:53:31 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 03:53:31.946488 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1389/2737] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:53:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 03:53:31.947463 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce8291-7bfd-464d-a66f-a6b62e2b8fad service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:32.011760 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce8291-7bfd-464d-a66f-a6b62e2b8fad service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:32.016556 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe31bf-6e34-472c-b6ce-0935eff459df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:32.017701 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe31bf-6e34-472c-b6ce-0935eff459df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:32.017832 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe31bf-6e34-472c-b6ce-0935eff459df admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:32.018046 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe31bf-6e34-472c-b6ce-0935eff459df admin admin] PATH_INFO: `/v3/users/82871e0b694d4d74aa513e1d162f50f7` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:32.019291 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe31bf-6e34-472c-b6ce-0935eff459df admin admin] RBAC: Authorizing `identity:delete_user(user_id=82871e0b694d4d74aa513e1d162f50f7)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:32.021262 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe31bf-6e34-472c-b6ce-0935eff459df admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:32.069555 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3cbe31bf-6e34-472c-b6ce-0935eff459df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82871e0b694d4d74aa513e1d162f50f7'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:32.070214 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3cbe31bf-6e34-472c-b6ce-0935eff459df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82871e0b694d4d74aa513e1d162f50f7'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:32.070880 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3cbe31bf-6e34-472c-b6ce-0935eff459df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82871e0b694d4d74aa513e1d162f50f7'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:32.077564 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3cbe31bf-6e34-472c-b6ce-0935eff459df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82871e0b694d4d74aa513e1d162f50f7'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:32.084466 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3cbe31bf-6e34-472c-b6ce-0935eff459df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82871e0b694d4d74aa513e1d162f50f7'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:32.112972 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1349/2738] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:53:31 2022] DELETE /identity/v3/users/82871e0b694d4d74aa513e1d162f50f7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:53:32.115532 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7766f1-1d95-4160-88a8-f6f0e20d9a6e None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:32.115978 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7766f1-1d95-4160-88a8-f6f0e20d9a6e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:32.116318 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7766f1-1d95-4160-88a8-f6f0e20d9a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:32.136385 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-dc7766f1-1d95-4160-88a8-f6f0e20d9a6e None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:32.137635 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-dc7766f1-1d95-4160-88a8-f6f0e20d9a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:32.202064 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1390/2739] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:53:32.212127 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe31bf-6e34-472c-b6ce-0935eff459df admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:32.213550 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3cbe31bf-6e34-472c-b6ce-0935eff459df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:32.251388 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:32.277015 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe31bf-6e34-472c-b6ce-0935eff459df admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:32.280777 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67eaf43-5fcf-43be-ae6d-af1397790d7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:32.281429 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67eaf43-5fcf-43be-ae6d-af1397790d7c service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:32.281756 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67eaf43-5fcf-43be-ae6d-af1397790d7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:32.282002 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67eaf43-5fcf-43be-ae6d-af1397790d7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:32.294122 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67eaf43-5fcf-43be-ae6d-af1397790d7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:32.295605 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67eaf43-5fcf-43be-ae6d-af1397790d7c service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:32.306765 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1350/2740] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:53:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:53:32.451923 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7766f1-1d95-4160-88a8-f6f0e20d9a6e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:32.453349 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-dc7766f1-1d95-4160-88a8-f6f0e20d9a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:32.462111 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:32.520350 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7766f1-1d95-4160-88a8-f6f0e20d9a6e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:32.526700 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac39ba4f-5526-4e84-a475-38ec53dc7023 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:32.527491 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39ba4f-5526-4e84-a475-38ec53dc7023 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:32.527916 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39ba4f-5526-4e84-a475-38ec53dc7023 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:32.528380 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac39ba4f-5526-4e84-a475-38ec53dc7023 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:32.530722 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ac39ba4f-5526-4e84-a475-38ec53dc7023 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:32.591287 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67eaf43-5fcf-43be-ae6d-af1397790d7c service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:32.592885 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b67eaf43-5fcf-43be-ae6d-af1397790d7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:32.613411 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67eaf43-5fcf-43be-ae6d-af1397790d7c service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:32.614718 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac39ba4f-5526-4e84-a475-38ec53dc7023 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:32.617038 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac39ba4f-5526-4e84-a475-38ec53dc7023 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:32.621057 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b411a811-58ca-463b-9a89-5b4033693ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:32.622002 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411a811-58ca-463b-9a89-5b4033693ae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:32.622380 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411a811-58ca-463b-9a89-5b4033693ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:32.622702 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b411a811-58ca-463b-9a89-5b4033693ae1 admin admin] PATH_INFO: `/v3/projects/c475a7bb22314aaea191de94c5daf5a6` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:32.624222 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411a811-58ca-463b-9a89-5b4033693ae1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c475a7bb22314aaea191de94c5daf5a6)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:32.628656 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b411a811-58ca-463b-9a89-5b4033693ae1 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:32.630514 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1391/2741] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:53:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:53:32.695293 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b411a811-58ca-463b-9a89-5b4033693ae1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c475a7bb22314aaea191de94c5daf5a6', 'request_id': 'req-b411a811-58ca-463b-9a89-5b4033693ae1'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:32.702306 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b411a811-58ca-463b-9a89-5b4033693ae1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c475a7bb22314aaea191de94c5daf5a6', 'request_id': 'req-b411a811-58ca-463b-9a89-5b4033693ae1'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:32.710138 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b411a811-58ca-463b-9a89-5b4033693ae1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c475a7bb22314aaea191de94c5daf5a6', 'request_id': 'req-b411a811-58ca-463b-9a89-5b4033693ae1'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:32.724782 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b411a811-58ca-463b-9a89-5b4033693ae1 admin admin] The token cache is being invalidate because project c475a7bb22314aaea191de94c5daf5a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:53:32.725071 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b411a811-58ca-463b-9a89-5b4033693ae1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:32.725735 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-b411a811-58ca-463b-9a89-5b4033693ae1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:32.727457 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1351/2742] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:53:32 2022] DELETE /identity/v3/projects/c475a7bb22314aaea191de94c5daf5a6 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:53:32.734235 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e02e36-b4b5-4c24-be01-e9d71d496ea8 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:32.734695 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e02e36-b4b5-4c24-be01-e9d71d496ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:32.735046 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e02e36-b4b5-4c24-be01-e9d71d496ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:32.754120 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-46e02e36-b4b5-4c24-be01-e9d71d496ea8 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:32.756259 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-46e02e36-b4b5-4c24-be01-e9d71d496ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:32.823953 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1392/2743] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:53:32.833245 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e9aad-02a9-4f95-8fba-6954c3e78a04 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:32.834257 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e9aad-02a9-4f95-8fba-6954c3e78a04 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:32.834549 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e9aad-02a9-4f95-8fba-6954c3e78a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:32.855470 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-5d6e9aad-02a9-4f95-8fba-6954c3e78a04 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:32.856835 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5d6e9aad-02a9-4f95-8fba-6954c3e78a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:32.866629 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1352/2744] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:53:32.871270 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e02e36-b4b5-4c24-be01-e9d71d496ea8 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:32.881430 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e02e36-b4b5-4c24-be01-e9d71d496ea8 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:32.886394 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d1a83-b640-49af-91d8-53a487f82bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:32.887406 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d1a83-b640-49af-91d8-53a487f82bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:32.887745 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d1a83-b640-49af-91d8-53a487f82bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:32.888126 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5d1a83-b640-49af-91d8-53a487f82bb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:32.888958 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d1a83-b640-49af-91d8-53a487f82bb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:53:32.889484 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d1a83-b640-49af-91d8-53a487f82bb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:32.891515 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5d1a83-b640-49af-91d8-53a487f82bb6 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:32.912911 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1393/2745] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:53:32.914451 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e9aad-02a9-4f95-8fba-6954c3e78a04 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:32.925782 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6e9aad-02a9-4f95-8fba-6954c3e78a04 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:32.930731 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4163df0-3671-4bd3-bf8e-ba4c506e8cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:32.931579 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4163df0-3671-4bd3-bf8e-ba4c506e8cc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:32.931926 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4163df0-3671-4bd3-bf8e-ba4c506e8cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:32.932267 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4163df0-3671-4bd3-bf8e-ba4c506e8cc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:32.933031 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4163df0-3671-4bd3-bf8e-ba4c506e8cc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:32.937473 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4163df0-3671-4bd3-bf8e-ba4c506e8cc7 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:32.969508 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1353/2746] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:53:32 2022] POST /identity/v3/projects => generated 397 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:53:32.970782 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d1a83-b640-49af-91d8-53a487f82bb6 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:32.981719 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5d1a83-b640-49af-91d8-53a487f82bb6 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:33.025884 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=100 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:33.039560 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606b693-81d3-4405-9a31-8920fdd5ef84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:33.040231 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606b693-81d3-4405-9a31-8920fdd5ef84 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:33.040514 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606b693-81d3-4405-9a31-8920fdd5ef84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:33.040787 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5606b693-81d3-4405-9a31-8920fdd5ef84 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:33.041484 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5606b693-81d3-4405-9a31-8920fdd5ef84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:33.043404 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5606b693-81d3-4405-9a31-8920fdd5ef84 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:33.063574 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1394/2747] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:53:32 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:53:33.067625 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4163df0-3671-4bd3-bf8e-ba4c506e8cc7 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:33.078281 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4163df0-3671-4bd3-bf8e-ba4c506e8cc7 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:33.082878 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e0fff-924c-4d95-a0ee-91f27171d9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:33.083537 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e0fff-924c-4d95-a0ee-91f27171d9ce admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:33.084433 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e0fff-924c-4d95-a0ee-91f27171d9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:33.084721 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e0fff-924c-4d95-a0ee-91f27171d9ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:33.085454 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e0fff-924c-4d95-a0ee-91f27171d9ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:33.087092 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e0fff-924c-4d95-a0ee-91f27171d9ce admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:33.100775 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1354/2748] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:53:33.101867 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606b693-81d3-4405-9a31-8920fdd5ef84 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:33.111722 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5606b693-81d3-4405-9a31-8920fdd5ef84 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:33.116367 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8af03c2-8613-478d-836b-e0929448c5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:33.117021 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af03c2-8613-478d-836b-e0929448c5dc admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:33.117312 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af03c2-8613-478d-836b-e0929448c5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:33.117610 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8af03c2-8613-478d-836b-e0929448c5dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:33.118335 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af03c2-8613-478d-836b-e0929448c5dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:33.119961 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8af03c2-8613-478d-836b-e0929448c5dc admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:33.129924 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1395/2749] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:53:33.134067 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e0fff-924c-4d95-a0ee-91f27171d9ce admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:33.143958 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e0fff-924c-4d95-a0ee-91f27171d9ce admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:33.149311 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f5033-6cea-40d4-a200-3b69fedebbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:33.150185 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f5033-6cea-40d4-a200-3b69fedebbd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:33.150496 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f5033-6cea-40d4-a200-3b69fedebbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:33.150782 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f5033-6cea-40d4-a200-3b69fedebbd6 admin admin] PATH_INFO: `/v3/projects/c3d6105d88f34432b9b7b4aedd0cab65/users/61dc3bfe38674bd099eeafdcaff4c6b8/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:33.166179 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f5033-6cea-40d4-a200-3b69fedebbd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3d6105d88f34432b9b7b4aedd0cab65, user_id=61dc3bfe38674bd099eeafdcaff4c6b8, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:33.168903 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f5033-6cea-40d4-a200-3b69fedebbd6 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:33.181432 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1355/2750] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:53:33 2022] PUT /identity/v3/projects/c3d6105d88f34432b9b7b4aedd0cab65/users/61dc3bfe38674bd099eeafdcaff4c6b8/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:53:33.191843 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0450a-8a82-4ba4-a0eb-2defe1cbe4bd None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:33.192139 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0450a-8a82-4ba4-a0eb-2defe1cbe4bd None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:33.192421 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0450a-8a82-4ba4-a0eb-2defe1cbe4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:33.219149 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-00c0450a-8a82-4ba4-a0eb-2defe1cbe4bd None None] MFA Rules not processed for user `61dc3bfe38674bd099eeafdcaff4c6b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:33.220465 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-00c0450a-8a82-4ba4-a0eb-2defe1cbe4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:33.285819 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1396/2751] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:53:33.297498 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f5033-6cea-40d4-a200-3b69fedebbd6 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:33.299247 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-db5f5033-6cea-40d4-a200-3b69fedebbd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:33.355290 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f5033-6cea-40d4-a200-3b69fedebbd6 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:33.358962 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a4d6b-31e0-4b5a-91b1-a033585d7a1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:33.359608 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a4d6b-31e0-4b5a-91b1-a033585d7a1b service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:33.359894 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a4d6b-31e0-4b5a-91b1-a033585d7a1b service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:33.360179 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a4d6b-31e0-4b5a-91b1-a033585d7a1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:33.368945 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a4d6b-31e0-4b5a-91b1-a033585d7a1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:33.370374 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a4d6b-31e0-4b5a-91b1-a033585d7a1b service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:33.373847 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:33.381708 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1356/2752] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:53:33 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:53:34.833677 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c0450a-8a82-4ba4-a0eb-2defe1cbe4bd None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:34.835755 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-00c0450a-8a82-4ba4-a0eb-2defe1cbe4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:34.908353 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c0450a-8a82-4ba4-a0eb-2defe1cbe4bd None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:34.913678 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae57ba8-9095-42bc-bcb1-b69e284f38b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:34.914640 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae57ba8-9095-42bc-bcb1-b69e284f38b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:34.914928 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae57ba8-9095-42bc-bcb1-b69e284f38b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:34.915203 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae57ba8-9095-42bc-bcb1-b69e284f38b6 admin admin] PATH_INFO: `/v3/users/0b692b01c9c74fdc95b2b52e9b6df859` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:34.916939 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae57ba8-9095-42bc-bcb1-b69e284f38b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b692b01c9c74fdc95b2b52e9b6df859)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:34.918289 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae57ba8-9095-42bc-bcb1-b69e284f38b6 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:34.974001 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7ae57ba8-9095-42bc-bcb1-b69e284f38b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b692b01c9c74fdc95b2b52e9b6df859'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:34.974716 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7ae57ba8-9095-42bc-bcb1-b69e284f38b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b692b01c9c74fdc95b2b52e9b6df859'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:34.975669 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7ae57ba8-9095-42bc-bcb1-b69e284f38b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b692b01c9c74fdc95b2b52e9b6df859'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:34.984369 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7ae57ba8-9095-42bc-bcb1-b69e284f38b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b692b01c9c74fdc95b2b52e9b6df859'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:34.986050 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:34.992702 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-7ae57ba8-9095-42bc-bcb1-b69e284f38b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b692b01c9c74fdc95b2b52e9b6df859'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:35.024283 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1397/2753] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:53:34 2022] DELETE /identity/v3/users/0b692b01c9c74fdc95b2b52e9b6df859 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:53:35.028752 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a06d8-ee25-4a6a-877f-c9c28c60774d None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:35.029212 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a06d8-ee25-4a6a-877f-c9c28c60774d None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:35.029296 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a06d8-ee25-4a6a-877f-c9c28c60774d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:35.046977 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-3a2a06d8-ee25-4a6a-877f-c9c28c60774d None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:35.048238 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3a2a06d8-ee25-4a6a-877f-c9c28c60774d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:35.105792 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1357/2754] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:53:35.115756 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae57ba8-9095-42bc-bcb1-b69e284f38b6 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:35.117158 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7ae57ba8-9095-42bc-bcb1-b69e284f38b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:35.174623 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae57ba8-9095-42bc-bcb1-b69e284f38b6 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:35.178771 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb7b40-7253-4059-817e-2319f2ec1d93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:35.179423 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb7b40-7253-4059-817e-2319f2ec1d93 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:35.179710 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb7b40-7253-4059-817e-2319f2ec1d93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:35.179990 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb7b40-7253-4059-817e-2319f2ec1d93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:35.189444 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb7b40-7253-4059-817e-2319f2ec1d93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:35.191127 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb7b40-7253-4059-817e-2319f2ec1d93 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:35.201511 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1398/2755] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:53:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 03:53:35.499568 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a06d8-ee25-4a6a-877f-c9c28c60774d None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:35.501245 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-3a2a06d8-ee25-4a6a-877f-c9c28c60774d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:35.514663 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a06d8-ee25-4a6a-877f-c9c28c60774d None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:35.521696 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02640850-66e3-4398-8401-0a9e8b5c7279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:35.522620 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02640850-66e3-4398-8401-0a9e8b5c7279 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:35.522908 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02640850-66e3-4398-8401-0a9e8b5c7279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:35.523192 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02640850-66e3-4398-8401-0a9e8b5c7279 admin admin] PATH_INFO: `/v3/projects/eccffa389a0541d4a7830e2433b46552` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:35.524867 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02640850-66e3-4398-8401-0a9e8b5c7279 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eccffa389a0541d4a7830e2433b46552)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:35.526844 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02640850-66e3-4398-8401-0a9e8b5c7279 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:35.590926 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-02640850-66e3-4398-8401-0a9e8b5c7279 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eccffa389a0541d4a7830e2433b46552', 'request_id': 'req-02640850-66e3-4398-8401-0a9e8b5c7279'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:35.597068 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-02640850-66e3-4398-8401-0a9e8b5c7279 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eccffa389a0541d4a7830e2433b46552', 'request_id': 'req-02640850-66e3-4398-8401-0a9e8b5c7279'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:35.605685 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-02640850-66e3-4398-8401-0a9e8b5c7279 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eccffa389a0541d4a7830e2433b46552', 'request_id': 'req-02640850-66e3-4398-8401-0a9e8b5c7279'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:35.617936 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-02640850-66e3-4398-8401-0a9e8b5c7279 admin admin] The token cache is being invalidate because project eccffa389a0541d4a7830e2433b46552 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:53:35.618271 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-02640850-66e3-4398-8401-0a9e8b5c7279 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:35.618944 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-02640850-66e3-4398-8401-0a9e8b5c7279 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:35.621016 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1358/2756] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:53:35 2022] DELETE /identity/v3/projects/eccffa389a0541d4a7830e2433b46552 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:53:35.625852 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ac2fd-dfee-4fb4-b979-f1ed67f0554e None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:35.626393 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ac2fd-dfee-4fb4-b979-f1ed67f0554e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:35.626920 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ac2fd-dfee-4fb4-b979-f1ed67f0554e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:35.645899 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-c15ac2fd-dfee-4fb4-b979-f1ed67f0554e None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:35.647689 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c15ac2fd-dfee-4fb4-b979-f1ed67f0554e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:35.710265 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1399/2757] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:53:35.719098 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a813a9-f01c-409c-a5c8-4892614ff791 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:35.719396 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a813a9-f01c-409c-a5c8-4892614ff791 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:35.719681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a813a9-f01c-409c-a5c8-4892614ff791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:35.739644 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-31a813a9-f01c-409c-a5c8-4892614ff791 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:35.740896 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-31a813a9-f01c-409c-a5c8-4892614ff791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:35.749142 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1359/2758] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:53:35.753297 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ac2fd-dfee-4fb4-b979-f1ed67f0554e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:35.762882 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ac2fd-dfee-4fb4-b979-f1ed67f0554e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:35.767435 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b8676-2f0e-45d2-8301-a0889aba23fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:35.768088 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b8676-2f0e-45d2-8301-a0889aba23fe admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:35.768375 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b8676-2f0e-45d2-8301-a0889aba23fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:35.768651 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76b8676-2f0e-45d2-8301-a0889aba23fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:35.769382 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b8676-2f0e-45d2-8301-a0889aba23fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:53:35.769693 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b8676-2f0e-45d2-8301-a0889aba23fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:35.771944 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76b8676-2f0e-45d2-8301-a0889aba23fe admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:35.783371 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1400/2759] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:53:35.788200 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a813a9-f01c-409c-a5c8-4892614ff791 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:35.797289 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a813a9-f01c-409c-a5c8-4892614ff791 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:35.801935 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24045f-da3d-4d44-b9c9-deef5994fcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:35.802645 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24045f-da3d-4d44-b9c9-deef5994fcf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:35.802938 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24045f-da3d-4d44-b9c9-deef5994fcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:35.803221 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c24045f-da3d-4d44-b9c9-deef5994fcf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:35.803918 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c24045f-da3d-4d44-b9c9-deef5994fcf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:35.805837 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c24045f-da3d-4d44-b9c9-deef5994fcf4 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:35.830895 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1360/2760] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:53:35 2022] POST /identity/v3/projects => generated 363 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:53:35.835441 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b8676-2f0e-45d2-8301-a0889aba23fe admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:35.845498 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76b8676-2f0e-45d2-8301-a0889aba23fe admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:35.902204 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bae422-1ee1-43e5-888e-9516d873459b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:35.902830 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bae422-1ee1-43e5-888e-9516d873459b admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:35.903115 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bae422-1ee1-43e5-888e-9516d873459b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:35.903394 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bae422-1ee1-43e5-888e-9516d873459b admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:35.904089 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bae422-1ee1-43e5-888e-9516d873459b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:35.905999 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bae422-1ee1-43e5-888e-9516d873459b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:35.915996 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:35.928342 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1401/2761] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:53:35 2022] POST /identity/v3/users => generated 282 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:53:35.932560 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24045f-da3d-4d44-b9c9-deef5994fcf4 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:35.943278 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c24045f-da3d-4d44-b9c9-deef5994fcf4 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:35.947990 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601188d-fa8c-4f8c-b170-6de2d0fcf367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:35.948633 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601188d-fa8c-4f8c-b170-6de2d0fcf367 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:35.948920 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601188d-fa8c-4f8c-b170-6de2d0fcf367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:35.949201 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a601188d-fa8c-4f8c-b170-6de2d0fcf367 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:35.949934 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601188d-fa8c-4f8c-b170-6de2d0fcf367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:35.951580 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a601188d-fa8c-4f8c-b170-6de2d0fcf367 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:35.962245 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1361/2762] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:53:35.965979 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bae422-1ee1-43e5-888e-9516d873459b admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:35.976329 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bae422-1ee1-43e5-888e-9516d873459b admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:35.980958 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e10ef23-c2a5-49fb-9b62-09e57f12ef30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:35.981601 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10ef23-c2a5-49fb-9b62-09e57f12ef30 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:35.981887 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10ef23-c2a5-49fb-9b62-09e57f12ef30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:35.982168 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e10ef23-c2a5-49fb-9b62-09e57f12ef30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:35.982939 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e10ef23-c2a5-49fb-9b62-09e57f12ef30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:35.984506 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e10ef23-c2a5-49fb-9b62-09e57f12ef30 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:35.994369 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1402/2763] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:53:35.998233 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601188d-fa8c-4f8c-b170-6de2d0fcf367 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:36.009663 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a601188d-fa8c-4f8c-b170-6de2d0fcf367 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:36.014311 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbff6b6-e5df-44aa-83ce-d07e669ec755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:36.015236 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbff6b6-e5df-44aa-83ce-d07e669ec755 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:36.015548 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbff6b6-e5df-44aa-83ce-d07e669ec755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:36.015829 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbff6b6-e5df-44aa-83ce-d07e669ec755 admin admin] PATH_INFO: `/v3/projects/d3d22ebe1bf14144a36951aa8d8021d8/users/b0974cbbf4374eebba914d3e001542a7/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:36.031869 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbff6b6-e5df-44aa-83ce-d07e669ec755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3d22ebe1bf14144a36951aa8d8021d8, user_id=b0974cbbf4374eebba914d3e001542a7, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:36.034983 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbff6b6-e5df-44aa-83ce-d07e669ec755 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:36.048582 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1362/2764] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:53:35 2022] PUT /identity/v3/projects/d3d22ebe1bf14144a36951aa8d8021d8/users/b0974cbbf4374eebba914d3e001542a7/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:53:36.059120 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887462e-de03-4ff8-9090-c7319b8c3d90 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:36.059485 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887462e-de03-4ff8-9090-c7319b8c3d90 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:36.059840 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887462e-de03-4ff8-9090-c7319b8c3d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:36.211693 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-b887462e-de03-4ff8-9090-c7319b8c3d90 None None] MFA Rules not processed for user `b0974cbbf4374eebba914d3e001542a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:36.212886 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b887462e-de03-4ff8-9090-c7319b8c3d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:36.275832 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1403/2765] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:36 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:53:36.287253 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbff6b6-e5df-44aa-83ce-d07e669ec755 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:36.288911 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0fbff6b6-e5df-44aa-83ce-d07e669ec755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:36.308534 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:36.349171 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbff6b6-e5df-44aa-83ce-d07e669ec755 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:36.352773 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ad035-d9b2-4aa5-a4df-4400faa689e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:36.353417 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ad035-d9b2-4aa5-a4df-4400faa689e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:36.353709 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ad035-d9b2-4aa5-a4df-4400faa689e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:36.353987 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ad035-d9b2-4aa5-a4df-4400faa689e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:36.362123 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ad035-d9b2-4aa5-a4df-4400faa689e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:36.363585 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ad035-d9b2-4aa5-a4df-4400faa689e1 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:36.373027 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1363/2766] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:53:36 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:53:36.718802 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887462e-de03-4ff8-9090-c7319b8c3d90 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:36.728725 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887462e-de03-4ff8-9090-c7319b8c3d90 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:36.732240 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0584270-9069-41e3-8851-eebfef8c640c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:36.732871 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0584270-9069-41e3-8851-eebfef8c640c service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:36.733152 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0584270-9069-41e3-8851-eebfef8c640c service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:36.733436 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0584270-9069-41e3-8851-eebfef8c640c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:36.735197 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c0584270-9069-41e3-8851-eebfef8c640c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:36.792240 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0584270-9069-41e3-8851-eebfef8c640c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:36.793688 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0584270-9069-41e3-8851-eebfef8c640c service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:36.802257 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1404/2767] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:53:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:53:38.353051 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ad035-d9b2-4aa5-a4df-4400faa689e1 service cinder] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:38.354439 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-478ad035-d9b2-4aa5-a4df-4400faa689e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:38.418364 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ad035-d9b2-4aa5-a4df-4400faa689e1 service cinder] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:38.422837 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8dfe7f-b71c-4b97-bb55-f6b20c731350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:38.423705 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8dfe7f-b71c-4b97-bb55-f6b20c731350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:38.423992 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8dfe7f-b71c-4b97-bb55-f6b20c731350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:38.424272 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8dfe7f-b71c-4b97-bb55-f6b20c731350 admin admin] PATH_INFO: `/v3/users/61dc3bfe38674bd099eeafdcaff4c6b8` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:38.425471 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8dfe7f-b71c-4b97-bb55-f6b20c731350 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61dc3bfe38674bd099eeafdcaff4c6b8)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:38.428060 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8dfe7f-b71c-4b97-bb55-f6b20c731350 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:38.473171 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-fd8dfe7f-b71c-4b97-bb55-f6b20c731350 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61dc3bfe38674bd099eeafdcaff4c6b8'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:38.475015 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-fd8dfe7f-b71c-4b97-bb55-f6b20c731350 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61dc3bfe38674bd099eeafdcaff4c6b8'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:38.475799 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-fd8dfe7f-b71c-4b97-bb55-f6b20c731350 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61dc3bfe38674bd099eeafdcaff4c6b8'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:38.483448 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-fd8dfe7f-b71c-4b97-bb55-f6b20c731350 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61dc3bfe38674bd099eeafdcaff4c6b8'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:38.492066 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-fd8dfe7f-b71c-4b97-bb55-f6b20c731350 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61dc3bfe38674bd099eeafdcaff4c6b8'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:38.509901 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1364/2768] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:53:38 2022] DELETE /identity/v3/users/61dc3bfe38674bd099eeafdcaff4c6b8 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:53:38.516863 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de7380-d8dc-4169-b0c2-c82b87aa7c15 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:38.517383 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de7380-d8dc-4169-b0c2-c82b87aa7c15 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:38.517623 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de7380-d8dc-4169-b0c2-c82b87aa7c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:38.535726 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-68de7380-d8dc-4169-b0c2-c82b87aa7c15 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:38.537414 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-68de7380-d8dc-4169-b0c2-c82b87aa7c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:38.598120 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1405/2769] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:53:38.608609 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8dfe7f-b71c-4b97-bb55-f6b20c731350 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:38.610251 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-fd8dfe7f-b71c-4b97-bb55-f6b20c731350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:38.656066 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:38.673011 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8dfe7f-b71c-4b97-bb55-f6b20c731350 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:38.677386 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45efd66-af52-48b2-b74c-155548a083c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:38.678336 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45efd66-af52-48b2-b74c-155548a083c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:38.678518 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45efd66-af52-48b2-b74c-155548a083c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:38.678717 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45efd66-af52-48b2-b74c-155548a083c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:38.688256 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45efd66-af52-48b2-b74c-155548a083c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:38.689700 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45efd66-af52-48b2-b74c-155548a083c7 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:38.699894 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1365/2770] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:53:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:53:38.879936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de7380-d8dc-4169-b0c2-c82b87aa7c15 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:38.881395 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-68de7380-d8dc-4169-b0c2-c82b87aa7c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:38.892862 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de7380-d8dc-4169-b0c2-c82b87aa7c15 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:38.897930 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3c5b78-874b-431e-9bb7-228b4ed59cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:38.898831 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c5b78-874b-431e-9bb7-228b4ed59cd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:38.899117 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c5b78-874b-431e-9bb7-228b4ed59cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:38.899395 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3c5b78-874b-431e-9bb7-228b4ed59cd1 admin admin] PATH_INFO: `/v3/users/0cd1962046ad418692206b64c814b22c` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:38.900582 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c5b78-874b-431e-9bb7-228b4ed59cd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cd1962046ad418692206b64c814b22c)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:38.902489 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3c5b78-874b-431e-9bb7-228b4ed59cd1 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:38.907148 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:38.949989 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3e3c5b78-874b-431e-9bb7-228b4ed59cd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cd1962046ad418692206b64c814b22c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:38.950685 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3e3c5b78-874b-431e-9bb7-228b4ed59cd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cd1962046ad418692206b64c814b22c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:38.951302 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3e3c5b78-874b-431e-9bb7-228b4ed59cd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cd1962046ad418692206b64c814b22c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:38.960446 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3e3c5b78-874b-431e-9bb7-228b4ed59cd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cd1962046ad418692206b64c814b22c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:38.968316 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-3e3c5b78-874b-431e-9bb7-228b4ed59cd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cd1962046ad418692206b64c814b22c'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:38.982698 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45efd66-af52-48b2-b74c-155548a083c7 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:38.984193 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d45efd66-af52-48b2-b74c-155548a083c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:38.988065 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1406/2771] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:53:38 2022] DELETE /identity/v3/users/0cd1962046ad418692206b64c814b22c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:53:38.992230 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae113d-4f97-4ed8-83e8-55a67edad56a None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:38.992526 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae113d-4f97-4ed8-83e8-55a67edad56a None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:38.992831 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ae113d-4f97-4ed8-83e8-55a67edad56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:38.999996 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45efd66-af52-48b2-b74c-155548a083c7 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:39.016134 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-75ae113d-4f97-4ed8-83e8-55a67edad56a None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:39.017357 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-75ae113d-4f97-4ed8-83e8-55a67edad56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:39.063905 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac0bd03-63a5-49fc-bd6f-0d10a078dab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:39.064816 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0bd03-63a5-49fc-bd6f-0d10a078dab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:39.065670 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0bd03-63a5-49fc-bd6f-0d10a078dab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:39.065952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0bd03-63a5-49fc-bd6f-0d10a078dab4 admin admin] PATH_INFO: `/v3/projects/c3d6105d88f34432b9b7b4aedd0cab65` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:39.067184 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac0bd03-63a5-49fc-bd6f-0d10a078dab4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3d6105d88f34432b9b7b4aedd0cab65)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:39.069632 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac0bd03-63a5-49fc-bd6f-0d10a078dab4 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:39.078711 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1407/2772] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:53:39.088890 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae113d-4f97-4ed8-83e8-55a67edad56a None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:39.090262 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-75ae113d-4f97-4ed8-83e8-55a67edad56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:39.117096 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9ac0bd03-63a5-49fc-bd6f-0d10a078dab4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3d6105d88f34432b9b7b4aedd0cab65', 'request_id': 'req-9ac0bd03-63a5-49fc-bd6f-0d10a078dab4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:39.123449 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9ac0bd03-63a5-49fc-bd6f-0d10a078dab4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3d6105d88f34432b9b7b4aedd0cab65', 'request_id': 'req-9ac0bd03-63a5-49fc-bd6f-0d10a078dab4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:39.131580 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9ac0bd03-63a5-49fc-bd6f-0d10a078dab4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3d6105d88f34432b9b7b4aedd0cab65', 'request_id': 'req-9ac0bd03-63a5-49fc-bd6f-0d10a078dab4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:39.142473 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9ac0bd03-63a5-49fc-bd6f-0d10a078dab4 admin admin] The token cache is being invalidate because project c3d6105d88f34432b9b7b4aedd0cab65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:53:39.142783 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9ac0bd03-63a5-49fc-bd6f-0d10a078dab4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:39.143402 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-9ac0bd03-63a5-49fc-bd6f-0d10a078dab4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:39.145530 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1366/2773] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:53:38 2022] DELETE /identity/v3/projects/c3d6105d88f34432b9b7b4aedd0cab65 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:53:39.149828 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ae113d-4f97-4ed8-83e8-55a67edad56a None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:39.194382 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:39.210414 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c7958-f393-4abe-94ee-a943821adf61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:39.211490 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c7958-f393-4abe-94ee-a943821adf61 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:39.213569 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c7958-f393-4abe-94ee-a943821adf61 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:39.213858 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c7958-f393-4abe-94ee-a943821adf61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:39.216140 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ff1c7958-f393-4abe-94ee-a943821adf61 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:39.310731 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c7958-f393-4abe-94ee-a943821adf61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:39.312183 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c7958-f393-4abe-94ee-a943821adf61 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:39.324695 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1408/2774] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:53:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 03:53:39.620332 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac0bd03-63a5-49fc-bd6f-0d10a078dab4 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:39.621768 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9ac0bd03-63a5-49fc-bd6f-0d10a078dab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:39.636144 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac0bd03-63a5-49fc-bd6f-0d10a078dab4 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:39.640865 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73b450-37bc-46f6-89d7-5c1f0fb1aed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:39.641823 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73b450-37bc-46f6-89d7-5c1f0fb1aed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:39.642177 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73b450-37bc-46f6-89d7-5c1f0fb1aed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:39.642547 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73b450-37bc-46f6-89d7-5c1f0fb1aed0 admin admin] PATH_INFO: `/v3/projects/da9a275c8461457384606d7676d3c2e3` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:39.643833 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b73b450-37bc-46f6-89d7-5c1f0fb1aed0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da9a275c8461457384606d7676d3c2e3)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:39.645990 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b73b450-37bc-46f6-89d7-5c1f0fb1aed0 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:39.693778 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6b73b450-37bc-46f6-89d7-5c1f0fb1aed0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da9a275c8461457384606d7676d3c2e3', 'request_id': 'req-6b73b450-37bc-46f6-89d7-5c1f0fb1aed0'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:39.699977 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6b73b450-37bc-46f6-89d7-5c1f0fb1aed0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da9a275c8461457384606d7676d3c2e3', 'request_id': 'req-6b73b450-37bc-46f6-89d7-5c1f0fb1aed0'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:39.707714 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6b73b450-37bc-46f6-89d7-5c1f0fb1aed0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da9a275c8461457384606d7676d3c2e3', 'request_id': 'req-6b73b450-37bc-46f6-89d7-5c1f0fb1aed0'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:39.714994 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:39.722775 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6b73b450-37bc-46f6-89d7-5c1f0fb1aed0 admin admin] The token cache is being invalidate because project da9a275c8461457384606d7676d3c2e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:53:39.723260 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6b73b450-37bc-46f6-89d7-5c1f0fb1aed0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:39.724709 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-6b73b450-37bc-46f6-89d7-5c1f0fb1aed0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:39.726254 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1367/2775] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:53:39 2022] DELETE /identity/v3/projects/da9a275c8461457384606d7676d3c2e3 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:53:39.730174 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c7958-f393-4abe-94ee-a943821adf61 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:39.739749 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c7958-f393-4abe-94ee-a943821adf61 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:39.794976 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ddd153-6d3d-49e3-857b-931128e65198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:39.795903 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ddd153-6d3d-49e3-857b-931128e65198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:39.796186 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ddd153-6d3d-49e3-857b-931128e65198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:39.796456 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ddd153-6d3d-49e3-857b-931128e65198 admin admin] PATH_INFO: `/v3/users/c711183e6f414b01b105acd5012261cd` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:39.797631 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ddd153-6d3d-49e3-857b-931128e65198 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c711183e6f414b01b105acd5012261cd)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:39.799553 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ddd153-6d3d-49e3-857b-931128e65198 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:39.844886 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-38ddd153-6d3d-49e3-857b-931128e65198 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c711183e6f414b01b105acd5012261cd'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:39.845531 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-38ddd153-6d3d-49e3-857b-931128e65198 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c711183e6f414b01b105acd5012261cd'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:39.846130 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-38ddd153-6d3d-49e3-857b-931128e65198 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c711183e6f414b01b105acd5012261cd'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:39.853263 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-38ddd153-6d3d-49e3-857b-931128e65198 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c711183e6f414b01b105acd5012261cd'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:39.860506 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-38ddd153-6d3d-49e3-857b-931128e65198 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c711183e6f414b01b105acd5012261cd'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:39.877424 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1409/2776] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:53:39 2022] DELETE /identity/v3/users/c711183e6f414b01b105acd5012261cd => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:53:40.147360 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73b450-37bc-46f6-89d7-5c1f0fb1aed0 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:40.148834 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-6b73b450-37bc-46f6-89d7-5c1f0fb1aed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:40.162743 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73b450-37bc-46f6-89d7-5c1f0fb1aed0 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:40.218261 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f3c99-a334-4c5a-b339-2eeeb7c040f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:40.219149 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f3c99-a334-4c5a-b339-2eeeb7c040f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:40.219432 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f3c99-a334-4c5a-b339-2eeeb7c040f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:40.219705 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f3c99-a334-4c5a-b339-2eeeb7c040f4 admin admin] PATH_INFO: `/v3/projects/2ed9c6b2d1a34617a5c8241be27e3fb1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:40.220886 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f3c99-a334-4c5a-b339-2eeeb7c040f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ed9c6b2d1a34617a5c8241be27e3fb1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:40.222967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f3c99-a334-4c5a-b339-2eeeb7c040f4 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:40.268254 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-996f3c99-a334-4c5a-b339-2eeeb7c040f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ed9c6b2d1a34617a5c8241be27e3fb1', 'request_id': 'req-996f3c99-a334-4c5a-b339-2eeeb7c040f4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:40.274767 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-996f3c99-a334-4c5a-b339-2eeeb7c040f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ed9c6b2d1a34617a5c8241be27e3fb1', 'request_id': 'req-996f3c99-a334-4c5a-b339-2eeeb7c040f4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:40.281983 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-996f3c99-a334-4c5a-b339-2eeeb7c040f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ed9c6b2d1a34617a5c8241be27e3fb1', 'request_id': 'req-996f3c99-a334-4c5a-b339-2eeeb7c040f4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:40.293048 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-996f3c99-a334-4c5a-b339-2eeeb7c040f4 admin admin] The token cache is being invalidate because project 2ed9c6b2d1a34617a5c8241be27e3fb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:53:40.293335 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-996f3c99-a334-4c5a-b339-2eeeb7c040f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:40.293952 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-996f3c99-a334-4c5a-b339-2eeeb7c040f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:40.295495 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1368/2777] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:53:40 2022] DELETE /identity/v3/projects/2ed9c6b2d1a34617a5c8241be27e3fb1 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:53:40.299449 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ddd153-6d3d-49e3-857b-931128e65198 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:40.300848 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-38ddd153-6d3d-49e3-857b-931128e65198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:40.313941 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ddd153-6d3d-49e3-857b-931128e65198 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:40.318993 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:40.372592 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba60dd5d-38ca-452c-90c7-1d59ea61ffb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:40.373450 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60dd5d-38ca-452c-90c7-1d59ea61ffb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:40.373727 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60dd5d-38ca-452c-90c7-1d59ea61ffb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:40.374003 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba60dd5d-38ca-452c-90c7-1d59ea61ffb4 admin admin] PATH_INFO: `/v3/users/bba3e9a3bba8497093600eb781dc3165` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:40.375214 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba60dd5d-38ca-452c-90c7-1d59ea61ffb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bba3e9a3bba8497093600eb781dc3165)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:40.377103 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba60dd5d-38ca-452c-90c7-1d59ea61ffb4 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:40.423600 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ba60dd5d-38ca-452c-90c7-1d59ea61ffb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bba3e9a3bba8497093600eb781dc3165'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:40.424256 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ba60dd5d-38ca-452c-90c7-1d59ea61ffb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bba3e9a3bba8497093600eb781dc3165'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:40.424899 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ba60dd5d-38ca-452c-90c7-1d59ea61ffb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bba3e9a3bba8497093600eb781dc3165'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:40.432498 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ba60dd5d-38ca-452c-90c7-1d59ea61ffb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bba3e9a3bba8497093600eb781dc3165'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:40.440164 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ba60dd5d-38ca-452c-90c7-1d59ea61ffb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bba3e9a3bba8497093600eb781dc3165'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:40.460417 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1410/2778] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:53:40 2022] DELETE /identity/v3/users/bba3e9a3bba8497093600eb781dc3165 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:53:40.754352 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f3c99-a334-4c5a-b339-2eeeb7c040f4 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:40.755910 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-996f3c99-a334-4c5a-b339-2eeeb7c040f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:40.770787 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f3c99-a334-4c5a-b339-2eeeb7c040f4 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:40.828087 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb520a-f8a0-41fc-8adb-0a19c0aa0b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:40.828934 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb520a-f8a0-41fc-8adb-0a19c0aa0b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:40.829216 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb520a-f8a0-41fc-8adb-0a19c0aa0b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:40.829488 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb520a-f8a0-41fc-8adb-0a19c0aa0b42 admin admin] PATH_INFO: `/v3/projects/31c6c93ddb304c2188c3a07a533671c0` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:40.830681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb520a-f8a0-41fc-8adb-0a19c0aa0b42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31c6c93ddb304c2188c3a07a533671c0)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:40.832575 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb520a-f8a0-41fc-8adb-0a19c0aa0b42 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:40.862352 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:40.879316 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3bcb520a-f8a0-41fc-8adb-0a19c0aa0b42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31c6c93ddb304c2188c3a07a533671c0', 'request_id': 'req-3bcb520a-f8a0-41fc-8adb-0a19c0aa0b42'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:40.885414 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3bcb520a-f8a0-41fc-8adb-0a19c0aa0b42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31c6c93ddb304c2188c3a07a533671c0', 'request_id': 'req-3bcb520a-f8a0-41fc-8adb-0a19c0aa0b42'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:40.892642 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3bcb520a-f8a0-41fc-8adb-0a19c0aa0b42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31c6c93ddb304c2188c3a07a533671c0', 'request_id': 'req-3bcb520a-f8a0-41fc-8adb-0a19c0aa0b42'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:40.903427 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3bcb520a-f8a0-41fc-8adb-0a19c0aa0b42 admin admin] The token cache is being invalidate because project 31c6c93ddb304c2188c3a07a533671c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:53:40.903715 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3bcb520a-f8a0-41fc-8adb-0a19c0aa0b42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:40.904337 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-3bcb520a-f8a0-41fc-8adb-0a19c0aa0b42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:40.905865 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1369/2779] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:53:40 2022] DELETE /identity/v3/projects/31c6c93ddb304c2188c3a07a533671c0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:53:40.912608 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35001f-c8e9-4652-b1f0-0ecc158fa56e None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:40.913106 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35001f-c8e9-4652-b1f0-0ecc158fa56e None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:40.913205 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc35001f-c8e9-4652-b1f0-0ecc158fa56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:40.930794 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-cc35001f-c8e9-4652-b1f0-0ecc158fa56e None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:40.931978 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-cc35001f-c8e9-4652-b1f0-0ecc158fa56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:40.989412 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1411/2780] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:53:40.999139 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766f17d-0d5a-4360-a9e4-1e247d5e7ee4 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:40.999371 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766f17d-0d5a-4360-a9e4-1e247d5e7ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:40.999652 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5766f17d-0d5a-4360-a9e4-1e247d5e7ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:41.017642 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-5766f17d-0d5a-4360-a9e4-1e247d5e7ee4 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:41.018881 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5766f17d-0d5a-4360-a9e4-1e247d5e7ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:41.027516 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1370/2781] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:53:41.031419 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35001f-c8e9-4652-b1f0-0ecc158fa56e None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:41.041803 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc35001f-c8e9-4652-b1f0-0ecc158fa56e None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:41.046569 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9a07c-dbb6-4fe1-8bca-db91d46e711e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:41.047214 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9a07c-dbb6-4fe1-8bca-db91d46e711e admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:41.047496 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9a07c-dbb6-4fe1-8bca-db91d46e711e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:41.047773 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9a07c-dbb6-4fe1-8bca-db91d46e711e admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:41.048519 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f9a07c-dbb6-4fe1-8bca-db91d46e711e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:53:41.048824 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f9a07c-dbb6-4fe1-8bca-db91d46e711e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:41.050429 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f9a07c-dbb6-4fe1-8bca-db91d46e711e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:41.061750 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1412/2782] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:53:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:53:41.065839 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766f17d-0d5a-4360-a9e4-1e247d5e7ee4 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:41.074945 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5766f17d-0d5a-4360-a9e4-1e247d5e7ee4 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:41.079549 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cbc452-ab07-41f1-b695-eea25d661fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:41.080187 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cbc452-ab07-41f1-b695-eea25d661fe7 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:41.080473 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cbc452-ab07-41f1-b695-eea25d661fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:41.080751 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cbc452-ab07-41f1-b695-eea25d661fe7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:41.081431 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cbc452-ab07-41f1-b695-eea25d661fe7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:41.083362 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cbc452-ab07-41f1-b695-eea25d661fe7 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:41.120290 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1371/2783] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:53:41 2022] POST /identity/v3/projects => generated 387 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:53:41.124320 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9a07c-dbb6-4fe1-8bca-db91d46e711e admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:41.134130 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9a07c-dbb6-4fe1-8bca-db91d46e711e admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:41.145149 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:41.190976 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b63c66b-d93f-4a88-bfdc-ca1a78749bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:41.191635 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63c66b-d93f-4a88-bfdc-ca1a78749bd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:41.191919 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63c66b-d93f-4a88-bfdc-ca1a78749bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:41.192189 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63c66b-d93f-4a88-bfdc-ca1a78749bd6 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:41.192896 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b63c66b-d93f-4a88-bfdc-ca1a78749bd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:41.194818 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b63c66b-d93f-4a88-bfdc-ca1a78749bd6 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:41.214244 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1413/2784] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:53:41 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:53:41.218271 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cbc452-ab07-41f1-b695-eea25d661fe7 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:41.228921 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cbc452-ab07-41f1-b695-eea25d661fe7 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:41.233436 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd22f2-d953-4793-a4bf-279f7db8b8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:41.234088 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd22f2-d953-4793-a4bf-279f7db8b8ef admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:41.234371 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd22f2-d953-4793-a4bf-279f7db8b8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:41.234703 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd22f2-d953-4793-a4bf-279f7db8b8ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:41.235429 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd22f2-d953-4793-a4bf-279f7db8b8ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:41.237058 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd22f2-d953-4793-a4bf-279f7db8b8ef admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:41.246720 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1372/2785] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:53:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:53:41.250495 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b63c66b-d93f-4a88-bfdc-ca1a78749bd6 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:41.261077 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b63c66b-d93f-4a88-bfdc-ca1a78749bd6 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:41.265605 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38faf55c-7bc3-4b6b-81ef-f295cfd6155f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:41.266255 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38faf55c-7bc3-4b6b-81ef-f295cfd6155f admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:41.266575 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38faf55c-7bc3-4b6b-81ef-f295cfd6155f admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:41.266855 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38faf55c-7bc3-4b6b-81ef-f295cfd6155f admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:41.267576 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38faf55c-7bc3-4b6b-81ef-f295cfd6155f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:41.269149 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38faf55c-7bc3-4b6b-81ef-f295cfd6155f admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:41.279446 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1414/2786] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:53:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:53:41.283551 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd22f2-d953-4793-a4bf-279f7db8b8ef admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:41.293613 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd22f2-d953-4793-a4bf-279f7db8b8ef admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:41.298063 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc9bc4-084b-4e86-bd7d-50beff9ef0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:41.298967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc9bc4-084b-4e86-bd7d-50beff9ef0cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:41.299249 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc9bc4-084b-4e86-bd7d-50beff9ef0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:41.299521 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc9bc4-084b-4e86-bd7d-50beff9ef0cc admin admin] PATH_INFO: `/v3/projects/61dd7dbd37cd4ad7a384e2cd9c66197a/users/777585931727483db7b530abf3380013/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:41.313753 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc9bc4-084b-4e86-bd7d-50beff9ef0cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=61dd7dbd37cd4ad7a384e2cd9c66197a, user_id=777585931727483db7b530abf3380013, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:41.316417 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc9bc4-084b-4e86-bd7d-50beff9ef0cc admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:41.330229 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1373/2787] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:53:41 2022] PUT /identity/v3/projects/61dd7dbd37cd4ad7a384e2cd9c66197a/users/777585931727483db7b530abf3380013/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:53:41.342029 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02df440-9409-4843-8e8b-8a252f5bc3ef None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:41.342317 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02df440-9409-4843-8e8b-8a252f5bc3ef None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:41.342644 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02df440-9409-4843-8e8b-8a252f5bc3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:41.370791 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-a02df440-9409-4843-8e8b-8a252f5bc3ef None None] MFA Rules not processed for user `777585931727483db7b530abf3380013`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:41.371992 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-a02df440-9409-4843-8e8b-8a252f5bc3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:41.434575 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1415/2788] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:53:41.439035 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc9bc4-084b-4e86-bd7d-50beff9ef0cc admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:41.498951 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc9bc4-084b-4e86-bd7d-50beff9ef0cc admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:41.503555 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0ef32-7284-4b91-9a19-25519dda88da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:41.504145 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0ef32-7284-4b91-9a19-25519dda88da admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:41.504430 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0ef32-7284-4b91-9a19-25519dda88da admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:41.504711 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b0ef32-7284-4b91-9a19-25519dda88da admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:41.505888 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b0ef32-7284-4b91-9a19-25519dda88da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:41.507807 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b0ef32-7284-4b91-9a19-25519dda88da admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:41.532233 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1374/2789] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:53:41 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:53:41.536667 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02df440-9409-4843-8e8b-8a252f5bc3ef None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:41.547147 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02df440-9409-4843-8e8b-8a252f5bc3ef None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:41.608772 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedad73a-9218-4c8c-ac42-43723593b9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:41.609439 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedad73a-9218-4c8c-ac42-43723593b9e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:41.609722 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedad73a-9218-4c8c-ac42-43723593b9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:41.610004 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedad73a-9218-4c8c-ac42-43723593b9e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:41.610780 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedad73a-9218-4c8c-ac42-43723593b9e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:41.612605 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedad73a-9218-4c8c-ac42-43723593b9e3 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:41.634050 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1416/2790] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:53:41 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:53:41.637909 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0ef32-7284-4b91-9a19-25519dda88da admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:41.649390 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b0ef32-7284-4b91-9a19-25519dda88da admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:41.654486 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f1fda-d0ac-4f40-836b-df66d818b55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:41.655164 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f1fda-d0ac-4f40-836b-df66d818b55e admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:41.655451 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f1fda-d0ac-4f40-836b-df66d818b55e admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:41.655728 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f1fda-d0ac-4f40-836b-df66d818b55e admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:41.656496 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f1fda-d0ac-4f40-836b-df66d818b55e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:41.658153 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f1fda-d0ac-4f40-836b-df66d818b55e admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:41.670211 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1375/2791] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:53:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:53:41.674525 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedad73a-9218-4c8c-ac42-43723593b9e3 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:41.684572 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedad73a-9218-4c8c-ac42-43723593b9e3 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:41.689186 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46f428-63da-4be8-8512-da95592646d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:41.690139 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46f428-63da-4be8-8512-da95592646d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:41.690555 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46f428-63da-4be8-8512-da95592646d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:41.691030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46f428-63da-4be8-8512-da95592646d2 admin admin] PATH_INFO: `/v3/projects/07f5ea9d083e4c5cbacf048a096a7a6f/users/6692385c909e446c81979f7f6335f488/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:41.705729 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:41.710639 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a46f428-63da-4be8-8512-da95592646d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07f5ea9d083e4c5cbacf048a096a7a6f, user_id=6692385c909e446c81979f7f6335f488, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:41.713487 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a46f428-63da-4be8-8512-da95592646d2 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:41.729340 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1417/2792] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:53:41 2022] PUT /identity/v3/projects/07f5ea9d083e4c5cbacf048a096a7a6f/users/6692385c909e446c81979f7f6335f488/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:53:41.733278 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f1fda-d0ac-4f40-836b-df66d818b55e admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:41.743332 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f1fda-d0ac-4f40-836b-df66d818b55e admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:41.758594 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:41.809831 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672020bb-1aee-431e-919e-87201976cf13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:41.810557 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672020bb-1aee-431e-919e-87201976cf13 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:41.810847 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672020bb-1aee-431e-919e-87201976cf13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:41.811132 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672020bb-1aee-431e-919e-87201976cf13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:41.811855 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672020bb-1aee-431e-919e-87201976cf13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:41.813514 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672020bb-1aee-431e-919e-87201976cf13 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:41.826610 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1376/2793] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:53:41 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:53:41.827655 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46f428-63da-4be8-8512-da95592646d2 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:41.840397 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46f428-63da-4be8-8512-da95592646d2 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:41.845644 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde5745-9aeb-464b-ac93-a45493865a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:41.846355 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde5745-9aeb-464b-ac93-a45493865a87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:41.846676 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde5745-9aeb-464b-ac93-a45493865a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:41.847004 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde5745-9aeb-464b-ac93-a45493865a87 admin admin] PATH_INFO: `/v3/projects/07f5ea9d083e4c5cbacf048a096a7a6f/users/6692385c909e446c81979f7f6335f488/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:41.849033 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde5745-9aeb-464b-ac93-a45493865a87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07f5ea9d083e4c5cbacf048a096a7a6f, user_id=6692385c909e446c81979f7f6335f488, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:41.852427 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde5745-9aeb-464b-ac93-a45493865a87 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:41.866123 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1418/2794] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:53:41 2022] PUT /identity/v3/projects/07f5ea9d083e4c5cbacf048a096a7a6f/users/6692385c909e446c81979f7f6335f488/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:53:41.877129 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48660d42-0423-49f4-8049-74682239b915 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:41.877413 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48660d42-0423-49f4-8049-74682239b915 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:41.877934 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48660d42-0423-49f4-8049-74682239b915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:41.906007 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-48660d42-0423-49f4-8049-74682239b915 None None] MFA Rules not processed for user `6692385c909e446c81979f7f6335f488`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:41.907415 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-48660d42-0423-49f4-8049-74682239b915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:41.976156 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1377/2795] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:41 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:53:41.987305 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde5745-9aeb-464b-ac93-a45493865a87 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:41.988997 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9fde5745-9aeb-464b-ac93-a45493865a87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:42.046098 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde5745-9aeb-464b-ac93-a45493865a87 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:42.049648 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f23ac-3ca6-4a69-ad4b-ad3bf245e1e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:42.050282 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f23ac-3ca6-4a69-ad4b-ad3bf245e1e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:42.050700 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f23ac-3ca6-4a69-ad4b-ad3bf245e1e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:42.050980 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f23ac-3ca6-4a69-ad4b-ad3bf245e1e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:42.060536 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f23ac-3ca6-4a69-ad4b-ad3bf245e1e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:42.061972 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175f23ac-3ca6-4a69-ad4b-ad3bf245e1e1 service cinder] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:42.071324 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1419/2796] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:53:41 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:53:42.606643 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48660d42-0423-49f4-8049-74682239b915 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:42.669601 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48660d42-0423-49f4-8049-74682239b915 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:42.674045 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f56bd6-1ad6-4a63-9dac-f77094373c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:42.674941 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f56bd6-1ad6-4a63-9dac-f77094373c09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:42.675226 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f56bd6-1ad6-4a63-9dac-f77094373c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:42.675495 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f56bd6-1ad6-4a63-9dac-f77094373c09 admin admin] PATH_INFO: `/v3/users/777585931727483db7b530abf3380013` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:42.676664 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f56bd6-1ad6-4a63-9dac-f77094373c09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=777585931727483db7b530abf3380013)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:42.678662 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f56bd6-1ad6-4a63-9dac-f77094373c09 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:42.719410 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:42.726002 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-84f56bd6-1ad6-4a63-9dac-f77094373c09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '777585931727483db7b530abf3380013'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:42.727008 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-84f56bd6-1ad6-4a63-9dac-f77094373c09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '777585931727483db7b530abf3380013'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:42.727792 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-84f56bd6-1ad6-4a63-9dac-f77094373c09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '777585931727483db7b530abf3380013'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:42.734792 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-84f56bd6-1ad6-4a63-9dac-f77094373c09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '777585931727483db7b530abf3380013'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:42.741847 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-84f56bd6-1ad6-4a63-9dac-f77094373c09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '777585931727483db7b530abf3380013'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:42.759256 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1378/2797] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:53:42 2022] DELETE /identity/v3/users/777585931727483db7b530abf3380013 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:53:42.763769 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcf309-a86f-4e61-a9f9-7c2c6fdb2ff1 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:42.764058 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcf309-a86f-4e61-a9f9-7c2c6fdb2ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:42.764338 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbcf309-a86f-4e61-a9f9-7c2c6fdb2ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:42.781333 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-8bbcf309-a86f-4e61-a9f9-7c2c6fdb2ff1 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:42.782566 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8bbcf309-a86f-4e61-a9f9-7c2c6fdb2ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:42.840107 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1420/2798] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:53:42.849767 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f56bd6-1ad6-4a63-9dac-f77094373c09 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:42.851321 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-84f56bd6-1ad6-4a63-9dac-f77094373c09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:42.911789 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f56bd6-1ad6-4a63-9dac-f77094373c09 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:42.915530 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0ad47-b72e-4878-ada2-2e9f181cef22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:42.916184 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0ad47-b72e-4878-ada2-2e9f181cef22 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:42.916475 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0ad47-b72e-4878-ada2-2e9f181cef22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:42.916757 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0ad47-b72e-4878-ada2-2e9f181cef22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:42.925956 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b0ad47-b72e-4878-ada2-2e9f181cef22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:42.927418 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b0ad47-b72e-4878-ada2-2e9f181cef22 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:42.937194 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1379/2799] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:53:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:53:43.235677 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcf309-a86f-4e61-a9f9-7c2c6fdb2ff1 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:43.237641 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-8bbcf309-a86f-4e61-a9f9-7c2c6fdb2ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:43.251926 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbcf309-a86f-4e61-a9f9-7c2c6fdb2ff1 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:43.257440 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35df4ee-53c0-4ce3-99fd-2b1fadd9556e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:43.258386 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35df4ee-53c0-4ce3-99fd-2b1fadd9556e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:43.258776 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35df4ee-53c0-4ce3-99fd-2b1fadd9556e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:43.259123 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35df4ee-53c0-4ce3-99fd-2b1fadd9556e admin admin] PATH_INFO: `/v3/projects/61dd7dbd37cd4ad7a384e2cd9c66197a` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:43.260507 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35df4ee-53c0-4ce3-99fd-2b1fadd9556e admin admin] RBAC: Authorizing `identity:delete_project(project_id=61dd7dbd37cd4ad7a384e2cd9c66197a)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:43.262505 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35df4ee-53c0-4ce3-99fd-2b1fadd9556e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:43.309699 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d35df4ee-53c0-4ce3-99fd-2b1fadd9556e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61dd7dbd37cd4ad7a384e2cd9c66197a', 'request_id': 'req-d35df4ee-53c0-4ce3-99fd-2b1fadd9556e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:43.320472 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d35df4ee-53c0-4ce3-99fd-2b1fadd9556e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61dd7dbd37cd4ad7a384e2cd9c66197a', 'request_id': 'req-d35df4ee-53c0-4ce3-99fd-2b1fadd9556e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:43.327845 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d35df4ee-53c0-4ce3-99fd-2b1fadd9556e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61dd7dbd37cd4ad7a384e2cd9c66197a', 'request_id': 'req-d35df4ee-53c0-4ce3-99fd-2b1fadd9556e'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:43.338089 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d35df4ee-53c0-4ce3-99fd-2b1fadd9556e admin admin] The token cache is being invalidate because project 61dd7dbd37cd4ad7a384e2cd9c66197a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:53:43.338373 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d35df4ee-53c0-4ce3-99fd-2b1fadd9556e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:43.339030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-d35df4ee-53c0-4ce3-99fd-2b1fadd9556e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:43.340741 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1421/2800] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:53:43 2022] DELETE /identity/v3/projects/61dd7dbd37cd4ad7a384e2cd9c66197a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:53:43.344577 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0ad47-b72e-4878-ada2-2e9f181cef22 service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:43.354428 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0ad47-b72e-4878-ada2-2e9f181cef22 service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:43.410195 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6c9a7-2482-4887-8a53-d3ccd85e990f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:43.411106 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6c9a7-2482-4887-8a53-d3ccd85e990f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:43.411396 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6c9a7-2482-4887-8a53-d3ccd85e990f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:43.411734 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6c9a7-2482-4887-8a53-d3ccd85e990f admin admin] PATH_INFO: `/v3/users/6692385c909e446c81979f7f6335f488` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:43.412923 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f6c9a7-2482-4887-8a53-d3ccd85e990f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6692385c909e446c81979f7f6335f488)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:43.414908 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f6c9a7-2482-4887-8a53-d3ccd85e990f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:43.460282 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-42f6c9a7-2482-4887-8a53-d3ccd85e990f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6692385c909e446c81979f7f6335f488'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:43.460928 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-42f6c9a7-2482-4887-8a53-d3ccd85e990f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6692385c909e446c81979f7f6335f488'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:43.461527 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-42f6c9a7-2482-4887-8a53-d3ccd85e990f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6692385c909e446c81979f7f6335f488'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:43.468347 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-42f6c9a7-2482-4887-8a53-d3ccd85e990f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6692385c909e446c81979f7f6335f488'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:43.475734 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-42f6c9a7-2482-4887-8a53-d3ccd85e990f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6692385c909e446c81979f7f6335f488'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:43.477056 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:43.496907 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1380/2801] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:53:43 2022] DELETE /identity/v3/users/6692385c909e446c81979f7f6335f488 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:53:43.766533 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35df4ee-53c0-4ce3-99fd-2b1fadd9556e admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:43.767938 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d35df4ee-53c0-4ce3-99fd-2b1fadd9556e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:43.775782 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:43.790789 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35df4ee-53c0-4ce3-99fd-2b1fadd9556e admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:43.844971 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ec769-eb7b-4ddd-ae67-7683053fa5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:43.845819 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ec769-eb7b-4ddd-ae67-7683053fa5f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:43.846101 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ec769-eb7b-4ddd-ae67-7683053fa5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:43.846375 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ec769-eb7b-4ddd-ae67-7683053fa5f9 admin admin] PATH_INFO: `/v3/projects/07f5ea9d083e4c5cbacf048a096a7a6f` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:43.847564 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ec769-eb7b-4ddd-ae67-7683053fa5f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07f5ea9d083e4c5cbacf048a096a7a6f)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:43.849953 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ec769-eb7b-4ddd-ae67-7683053fa5f9 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:43.893666 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ad0ec769-eb7b-4ddd-ae67-7683053fa5f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07f5ea9d083e4c5cbacf048a096a7a6f', 'request_id': 'req-ad0ec769-eb7b-4ddd-ae67-7683053fa5f9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:43.900161 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ad0ec769-eb7b-4ddd-ae67-7683053fa5f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07f5ea9d083e4c5cbacf048a096a7a6f', 'request_id': 'req-ad0ec769-eb7b-4ddd-ae67-7683053fa5f9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:43.907410 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ad0ec769-eb7b-4ddd-ae67-7683053fa5f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07f5ea9d083e4c5cbacf048a096a7a6f', 'request_id': 'req-ad0ec769-eb7b-4ddd-ae67-7683053fa5f9'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:43.918381 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ad0ec769-eb7b-4ddd-ae67-7683053fa5f9 admin admin] The token cache is being invalidate because project 07f5ea9d083e4c5cbacf048a096a7a6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:53:43.918701 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ad0ec769-eb7b-4ddd-ae67-7683053fa5f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:43.919327 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ad0ec769-eb7b-4ddd-ae67-7683053fa5f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:53:43.920879 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1422/2802] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:53:43 2022] DELETE /identity/v3/projects/07f5ea9d083e4c5cbacf048a096a7a6f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:53:43.926683 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e7a0d-f8db-4250-8bd8-95a3c8a259d3 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:43.927166 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e7a0d-f8db-4250-8bd8-95a3c8a259d3 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:43.927280 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e7a0d-f8db-4250-8bd8-95a3c8a259d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:43.945014 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-109e7a0d-f8db-4250-8bd8-95a3c8a259d3 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:43.946208 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-109e7a0d-f8db-4250-8bd8-95a3c8a259d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:44.003610 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1381/2803] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:53:44.011427 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8a052-83ca-49a7-93c2-77b771db6309 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:44.011716 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8a052-83ca-49a7-93c2-77b771db6309 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:44.011994 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd8a052-83ca-49a7-93c2-77b771db6309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:44.030629 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-6dd8a052-83ca-49a7-93c2-77b771db6309 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:44.031824 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-6dd8a052-83ca-49a7-93c2-77b771db6309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:44.040511 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1423/2804] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:53:44.044554 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e7a0d-f8db-4250-8bd8-95a3c8a259d3 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:44.054239 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e7a0d-f8db-4250-8bd8-95a3c8a259d3 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:44.058858 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21afb2f4-b87d-4784-9050-3a52ff89daab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:44.059516 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afb2f4-b87d-4784-9050-3a52ff89daab admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:44.059817 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afb2f4-b87d-4784-9050-3a52ff89daab admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:44.060085 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afb2f4-b87d-4784-9050-3a52ff89daab admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:44.060815 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21afb2f4-b87d-4784-9050-3a52ff89daab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:53:44.061128 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21afb2f4-b87d-4784-9050-3a52ff89daab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:44.062781 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21afb2f4-b87d-4784-9050-3a52ff89daab admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:44.077639 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1382/2805] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:53:44.081837 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8a052-83ca-49a7-93c2-77b771db6309 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:44.091411 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd8a052-83ca-49a7-93c2-77b771db6309 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:44.096188 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b768a12-acfe-4dd1-b2fe-55341b458e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:44.096845 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b768a12-acfe-4dd1-b2fe-55341b458e94 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:44.097126 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b768a12-acfe-4dd1-b2fe-55341b458e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:44.097405 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b768a12-acfe-4dd1-b2fe-55341b458e94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:44.098097 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b768a12-acfe-4dd1-b2fe-55341b458e94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:44.100763 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b768a12-acfe-4dd1-b2fe-55341b458e94 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:44.126876 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1424/2806] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:53:44 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:53:44.131284 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21afb2f4-b87d-4784-9050-3a52ff89daab admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:44.141285 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21afb2f4-b87d-4784-9050-3a52ff89daab admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:44.196887 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508426a-22df-4efc-8e3a-62714d670c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:44.197487 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508426a-22df-4efc-8e3a-62714d670c8d admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:44.197779 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508426a-22df-4efc-8e3a-62714d670c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:44.198063 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508426a-22df-4efc-8e3a-62714d670c8d admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:44.198805 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508426a-22df-4efc-8e3a-62714d670c8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:44.200743 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508426a-22df-4efc-8e3a-62714d670c8d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:44.222605 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1383/2807] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:53:44 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:53:44.227086 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b768a12-acfe-4dd1-b2fe-55341b458e94 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:44.237494 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b768a12-acfe-4dd1-b2fe-55341b458e94 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:44.242194 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903dafe-5010-41fe-a6f9-2662058bbe4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:44.242907 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903dafe-5010-41fe-a6f9-2662058bbe4e admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:44.243196 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903dafe-5010-41fe-a6f9-2662058bbe4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:44.243475 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903dafe-5010-41fe-a6f9-2662058bbe4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:44.244206 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3903dafe-5010-41fe-a6f9-2662058bbe4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:44.245809 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3903dafe-5010-41fe-a6f9-2662058bbe4e admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:44.257182 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1425/2808] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 03:53:44.269320 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508426a-22df-4efc-8e3a-62714d670c8d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:44.272265 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508426a-22df-4efc-8e3a-62714d670c8d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:44.277132 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ec4c4e-638d-46b0-9e23-2c8b4ff74069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:44.277799 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec4c4e-638d-46b0-9e23-2c8b4ff74069 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:44.278084 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec4c4e-638d-46b0-9e23-2c8b4ff74069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:44.278362 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ec4c4e-638d-46b0-9e23-2c8b4ff74069 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:44.279160 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec4c4e-638d-46b0-9e23-2c8b4ff74069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:44.280771 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ec4c4e-638d-46b0-9e23-2c8b4ff74069 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:44.291190 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1384/2809] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:53:44.295570 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903dafe-5010-41fe-a6f9-2662058bbe4e admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:44.305690 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903dafe-5010-41fe-a6f9-2662058bbe4e admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:44.310350 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1750142-945c-400f-bfbe-459d717b1c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:44.311337 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1750142-945c-400f-bfbe-459d717b1c45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:44.311681 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1750142-945c-400f-bfbe-459d717b1c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:44.311967 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1750142-945c-400f-bfbe-459d717b1c45 admin admin] PATH_INFO: `/v3/projects/a18f4e5518d9420cb333086cda862103/users/f0760b57d45b4ab491463da5263cbbe1/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:44.327256 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1750142-945c-400f-bfbe-459d717b1c45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a18f4e5518d9420cb333086cda862103, user_id=f0760b57d45b4ab491463da5263cbbe1, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:44.329928 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1750142-945c-400f-bfbe-459d717b1c45 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:44.352431 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1426/2810] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:53:44 2022] PUT /identity/v3/projects/a18f4e5518d9420cb333086cda862103/users/f0760b57d45b4ab491463da5263cbbe1/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:53:44.355198 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d23ae2-478c-4467-abfe-abf2b3761aa9 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:44.355518 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d23ae2-478c-4467-abfe-abf2b3761aa9 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:44.355846 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d23ae2-478c-4467-abfe-abf2b3761aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:44.383766 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-02d23ae2-478c-4467-abfe-abf2b3761aa9 None None] MFA Rules not processed for user `f0760b57d45b4ab491463da5263cbbe1`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:53:44.385059 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-02d23ae2-478c-4467-abfe-abf2b3761aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:44.425924 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:44.460949 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1385/2811] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:53:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:53:44.473058 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1750142-945c-400f-bfbe-459d717b1c45 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:53:44.474667 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b1750142-945c-400f-bfbe-459d717b1c45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:53:44.506941 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:44.538539 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1750142-945c-400f-bfbe-459d717b1c45 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:53:44.542362 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036eef0a-8e29-4f4f-9a51-151789900f57 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a567cddc98164bd39317a245626d0f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:53:44.543067 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036eef0a-8e29-4f4f-9a51-151789900f57 service glance] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:53:44.543354 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036eef0a-8e29-4f4f-9a51-151789900f57 service glance] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:53:44.543641 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036eef0a-8e29-4f4f-9a51-151789900f57 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:53:44.552592 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036eef0a-8e29-4f4f-9a51-151789900f57 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:53:44.554029 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036eef0a-8e29-4f4f-9a51-151789900f57 service glance] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:53:44.564561 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1427/2812] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:53:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:53:54.456438 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=11 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:53:54.559042 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=13 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:54:07.326143 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d23ae2-478c-4467-abfe-abf2b3761aa9 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:07.390052 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d23ae2-478c-4467-abfe-abf2b3761aa9 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:07.394650 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5362b8-ee92-4593-82a1-adf1c4714ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:07.395565 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5362b8-ee92-4593-82a1-adf1c4714ab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:07.395851 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5362b8-ee92-4593-82a1-adf1c4714ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:07.396126 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5362b8-ee92-4593-82a1-adf1c4714ab1 admin admin] PATH_INFO: `/v3/users/f0760b57d45b4ab491463da5263cbbe1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:07.397303 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5362b8-ee92-4593-82a1-adf1c4714ab1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0760b57d45b4ab491463da5263cbbe1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:07.399257 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5362b8-ee92-4593-82a1-adf1c4714ab1 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:07.443949 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8b5362b8-ee92-4593-82a1-adf1c4714ab1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0760b57d45b4ab491463da5263cbbe1'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:07.444596 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8b5362b8-ee92-4593-82a1-adf1c4714ab1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0760b57d45b4ab491463da5263cbbe1'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:07.445196 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8b5362b8-ee92-4593-82a1-adf1c4714ab1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0760b57d45b4ab491463da5263cbbe1'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:07.452517 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8b5362b8-ee92-4593-82a1-adf1c4714ab1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0760b57d45b4ab491463da5263cbbe1'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:07.459489 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8b5362b8-ee92-4593-82a1-adf1c4714ab1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0760b57d45b4ab491463da5263cbbe1'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:07.476845 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1386/2813] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:54:07 2022] DELETE /identity/v3/users/f0760b57d45b4ab491463da5263cbbe1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:54:07.481734 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca090e4-d7c1-45a1-b5fa-f4b6b325d16f None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:07.482248 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca090e4-d7c1-45a1-b5fa-f4b6b325d16f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:07.482351 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca090e4-d7c1-45a1-b5fa-f4b6b325d16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:07.499075 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-1ca090e4-d7c1-45a1-b5fa-f4b6b325d16f None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:54:07.500302 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1ca090e4-d7c1-45a1-b5fa-f4b6b325d16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:07.557582 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1428/2814] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:54:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:54:07.567130 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5362b8-ee92-4593-82a1-adf1c4714ab1 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:07.568559 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8b5362b8-ee92-4593-82a1-adf1c4714ab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:07.625147 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5362b8-ee92-4593-82a1-adf1c4714ab1 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:07.628757 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dab76d-fc45-4e54-a495-4cc25b10b4f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:07.629396 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dab76d-fc45-4e54-a495-4cc25b10b4f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:07.629681 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dab76d-fc45-4e54-a495-4cc25b10b4f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:07.629960 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dab76d-fc45-4e54-a495-4cc25b10b4f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:07.638862 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dab76d-fc45-4e54-a495-4cc25b10b4f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:07.640294 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dab76d-fc45-4e54-a495-4cc25b10b4f9 service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:07.649543 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1387/2815] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:54:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:54:07.916340 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca090e4-d7c1-45a1-b5fa-f4b6b325d16f None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:07.918393 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1ca090e4-d7c1-45a1-b5fa-f4b6b325d16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:07.929915 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca090e4-d7c1-45a1-b5fa-f4b6b325d16f None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:07.934858 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa24f99-4a84-4de7-907b-2d09d608a958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:07.935817 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa24f99-4a84-4de7-907b-2d09d608a958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:07.936101 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa24f99-4a84-4de7-907b-2d09d608a958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:07.936378 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa24f99-4a84-4de7-907b-2d09d608a958 admin admin] PATH_INFO: `/v3/projects/a18f4e5518d9420cb333086cda862103` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:07.937614 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa24f99-4a84-4de7-907b-2d09d608a958 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a18f4e5518d9420cb333086cda862103)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:07.939728 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa24f99-4a84-4de7-907b-2d09d608a958 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:07.987786 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2fa24f99-4a84-4de7-907b-2d09d608a958 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a18f4e5518d9420cb333086cda862103', 'request_id': 'req-2fa24f99-4a84-4de7-907b-2d09d608a958'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:07.993776 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2fa24f99-4a84-4de7-907b-2d09d608a958 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a18f4e5518d9420cb333086cda862103', 'request_id': 'req-2fa24f99-4a84-4de7-907b-2d09d608a958'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:08.001086 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2fa24f99-4a84-4de7-907b-2d09d608a958 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a18f4e5518d9420cb333086cda862103', 'request_id': 'req-2fa24f99-4a84-4de7-907b-2d09d608a958'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:08.011250 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2fa24f99-4a84-4de7-907b-2d09d608a958 admin admin] The token cache is being invalidate because project a18f4e5518d9420cb333086cda862103 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80332) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:54:08.011538 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2fa24f99-4a84-4de7-907b-2d09d608a958 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:08.012166 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2fa24f99-4a84-4de7-907b-2d09d608a958 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:08.013695 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1429/2816] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:54:07 2022] DELETE /identity/v3/projects/a18f4e5518d9420cb333086cda862103 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:54:08.018553 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f672f-1120-4c37-aa50-09022b5fc365 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:08.018843 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f672f-1120-4c37-aa50-09022b5fc365 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:08.019122 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f672f-1120-4c37-aa50-09022b5fc365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:08.037084 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-7a4f672f-1120-4c37-aa50-09022b5fc365 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:54:08.038275 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-7a4f672f-1120-4c37-aa50-09022b5fc365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:08.055253 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:54:08.098892 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1388/2817] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:54:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:54:08.108100 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c012e31-854d-49b6-b939-fce1685cc8fb None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:08.108397 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c012e31-854d-49b6-b939-fce1685cc8fb None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:08.108683 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c012e31-854d-49b6-b939-fce1685cc8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:08.127297 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-1c012e31-854d-49b6-b939-fce1685cc8fb None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:54:08.128499 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-1c012e31-854d-49b6-b939-fce1685cc8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:08.136860 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1430/2818] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:54:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:54:08.140886 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f672f-1120-4c37-aa50-09022b5fc365 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:08.150301 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f672f-1120-4c37-aa50-09022b5fc365 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:08.155437 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eaf629-6a42-4e0b-a2f7-ac12dba021d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:08.156087 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eaf629-6a42-4e0b-a2f7-ac12dba021d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:08.156371 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eaf629-6a42-4e0b-a2f7-ac12dba021d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:08.156647 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eaf629-6a42-4e0b-a2f7-ac12dba021d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:08.157377 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eaf629-6a42-4e0b-a2f7-ac12dba021d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80331) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:54:08.157683 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eaf629-6a42-4e0b-a2f7-ac12dba021d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:08.159327 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eaf629-6a42-4e0b-a2f7-ac12dba021d7 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:08.170911 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1389/2819] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:54:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:54:08.174885 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c012e31-854d-49b6-b939-fce1685cc8fb None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:08.183805 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c012e31-854d-49b6-b939-fce1685cc8fb None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:08.188422 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f73f952-95e9-43e8-962f-42e2db061cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:08.189061 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73f952-95e9-43e8-962f-42e2db061cb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:08.189349 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73f952-95e9-43e8-962f-42e2db061cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:08.189628 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f73f952-95e9-43e8-962f-42e2db061cb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:08.190311 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f73f952-95e9-43e8-962f-42e2db061cb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:08.192228 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f73f952-95e9-43e8-962f-42e2db061cb3 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:08.217693 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1431/2820] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:54:08 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:54:08.221873 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eaf629-6a42-4e0b-a2f7-ac12dba021d7 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:08.231788 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eaf629-6a42-4e0b-a2f7-ac12dba021d7 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:08.288660 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28d109-1ba1-4858-8904-5f579b922e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:08.289335 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28d109-1ba1-4858-8904-5f579b922e4d admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:08.289627 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28d109-1ba1-4858-8904-5f579b922e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:08.289905 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28d109-1ba1-4858-8904-5f579b922e4d admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:08.290637 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e28d109-1ba1-4858-8904-5f579b922e4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:08.292580 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e28d109-1ba1-4858-8904-5f579b922e4d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:08.316223 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1390/2821] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:54:08 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:54:08.320287 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f73f952-95e9-43e8-962f-42e2db061cb3 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:08.330941 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f73f952-95e9-43e8-962f-42e2db061cb3 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:08.335430 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66ebda-bcce-485f-bbcf-b341e0683510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:08.336079 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66ebda-bcce-485f-bbcf-b341e0683510 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:08.336359 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66ebda-bcce-485f-bbcf-b341e0683510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:08.336633 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66ebda-bcce-485f-bbcf-b341e0683510 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:08.337361 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66ebda-bcce-485f-bbcf-b341e0683510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:08.339568 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66ebda-bcce-485f-bbcf-b341e0683510 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:08.349719 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1432/2822] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:54:08.353421 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28d109-1ba1-4858-8904-5f579b922e4d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:08.363527 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28d109-1ba1-4858-8904-5f579b922e4d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:08.368130 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb70687-596b-4eea-9ded-47524bade7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:08.368778 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb70687-596b-4eea-9ded-47524bade7ea admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:08.369065 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb70687-596b-4eea-9ded-47524bade7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:08.369346 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb70687-596b-4eea-9ded-47524bade7ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:08.370072 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb70687-596b-4eea-9ded-47524bade7ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:08.371735 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb70687-596b-4eea-9ded-47524bade7ea admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:08.381299 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1391/2823] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:54:08.385257 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66ebda-bcce-485f-bbcf-b341e0683510 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:08.395665 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66ebda-bcce-485f-bbcf-b341e0683510 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:08.400346 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af15e608-07d0-485e-b93f-910bb6ecdc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:08.401838 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15e608-07d0-485e-b93f-910bb6ecdc57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:08.402130 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15e608-07d0-485e-b93f-910bb6ecdc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:08.402408 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15e608-07d0-485e-b93f-910bb6ecdc57 admin admin] PATH_INFO: `/v3/projects/23f6cea05397488cad95fbb0a9953367/users/cfbcae43722e45e6bc879688363221e7/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:08.418287 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af15e608-07d0-485e-b93f-910bb6ecdc57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23f6cea05397488cad95fbb0a9953367, user_id=cfbcae43722e45e6bc879688363221e7, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:08.421091 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af15e608-07d0-485e-b93f-910bb6ecdc57 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:08.435104 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1433/2824] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:54:08 2022] PUT /identity/v3/projects/23f6cea05397488cad95fbb0a9953367/users/cfbcae43722e45e6bc879688363221e7/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:54:08.445257 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91caca-240b-4a1f-b7f6-354a3b985b62 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:08.445551 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91caca-240b-4a1f-b7f6-354a3b985b62 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:08.445887 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91caca-240b-4a1f-b7f6-354a3b985b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:08.472451 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-4b91caca-240b-4a1f-b7f6-354a3b985b62 None None] MFA Rules not processed for user `cfbcae43722e45e6bc879688363221e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:54:08.473682 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-4b91caca-240b-4a1f-b7f6-354a3b985b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:08.535457 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1392/2825] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:54:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:54:08.539895 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af15e608-07d0-485e-b93f-910bb6ecdc57 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:08.561792 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:54:08.605224 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af15e608-07d0-485e-b93f-910bb6ecdc57 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:08.609661 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be74c406-9e94-4b66-9a8e-95ddc6fc4567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:08.610308 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74c406-9e94-4b66-9a8e-95ddc6fc4567 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:08.610704 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74c406-9e94-4b66-9a8e-95ddc6fc4567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:08.610983 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74c406-9e94-4b66-9a8e-95ddc6fc4567 admin admin] PATH_INFO: `/v3/projects` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:08.611705 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be74c406-9e94-4b66-9a8e-95ddc6fc4567 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:08.613584 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be74c406-9e94-4b66-9a8e-95ddc6fc4567 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:08.637606 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1434/2826] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:54:08 2022] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:54:08.642005 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91caca-240b-4a1f-b7f6-354a3b985b62 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:08.654779 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91caca-240b-4a1f-b7f6-354a3b985b62 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:08.667476 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:54:08.715376 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b0534-1dcc-49c2-a0a0-2c0df969c82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:08.715822 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b0534-1dcc-49c2-a0a0-2c0df969c82d admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:08.716111 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b0534-1dcc-49c2-a0a0-2c0df969c82d admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:08.716418 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b0534-1dcc-49c2-a0a0-2c0df969c82d admin admin] PATH_INFO: `/v3/users` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:08.717098 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1b0534-1dcc-49c2-a0a0-2c0df969c82d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:08.719067 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1b0534-1dcc-49c2-a0a0-2c0df969c82d admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:08.739061 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1393/2827] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:54:08 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:54:08.743249 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be74c406-9e94-4b66-9a8e-95ddc6fc4567 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:08.753312 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be74c406-9e94-4b66-9a8e-95ddc6fc4567 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:08.757954 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a744e42-a8cf-413e-826a-4040ae3bf853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:08.758643 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a744e42-a8cf-413e-826a-4040ae3bf853 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:08.758930 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a744e42-a8cf-413e-826a-4040ae3bf853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:08.759210 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a744e42-a8cf-413e-826a-4040ae3bf853 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:08.759934 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a744e42-a8cf-413e-826a-4040ae3bf853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:08.761507 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a744e42-a8cf-413e-826a-4040ae3bf853 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:08.771765 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1435/2828] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:54:08.775694 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b0534-1dcc-49c2-a0a0-2c0df969c82d admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:08.786831 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b0534-1dcc-49c2-a0a0-2c0df969c82d admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:08.791607 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d99bef-bb02-40a5-9114-7ac9d9fe3b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:08.793036 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d99bef-bb02-40a5-9114-7ac9d9fe3b24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:08.793324 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d99bef-bb02-40a5-9114-7ac9d9fe3b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:08.793633 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d99bef-bb02-40a5-9114-7ac9d9fe3b24 admin admin] PATH_INFO: `/v3/projects/51ea041616ee4ca19195609caf245a06/users/e84a6e7daadb49a48d75dbdcb75d03ee/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:08.808126 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d99bef-bb02-40a5-9114-7ac9d9fe3b24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51ea041616ee4ca19195609caf245a06, user_id=e84a6e7daadb49a48d75dbdcb75d03ee, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:08.810843 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d99bef-bb02-40a5-9114-7ac9d9fe3b24 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:08.823163 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1394/2829] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:54:08 2022] PUT /identity/v3/projects/51ea041616ee4ca19195609caf245a06/users/e84a6e7daadb49a48d75dbdcb75d03ee/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:54:08.826978 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a744e42-a8cf-413e-826a-4040ae3bf853 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:08.836617 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a744e42-a8cf-413e-826a-4040ae3bf853 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:08.891680 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59d003-be93-40b7-8bbb-af50db61aca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:08.892276 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59d003-be93-40b7-8bbb-af50db61aca1 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:08.892565 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59d003-be93-40b7-8bbb-af50db61aca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:08.892847 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59d003-be93-40b7-8bbb-af50db61aca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:08.893648 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc59d003-be93-40b7-8bbb-af50db61aca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:08.895349 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc59d003-be93-40b7-8bbb-af50db61aca1 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:08.905474 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1436/2830] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:54:08.909911 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d99bef-bb02-40a5-9114-7ac9d9fe3b24 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:08.919967 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d99bef-bb02-40a5-9114-7ac9d9fe3b24 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:08.924487 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d9a8f-2c8f-46b3-b247-210385af6c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:08.925356 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d9a8f-2c8f-46b3-b247-210385af6c08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:08.925642 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d9a8f-2c8f-46b3-b247-210385af6c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:08.925916 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d9a8f-2c8f-46b3-b247-210385af6c08 admin admin] PATH_INFO: `/v3/projects/51ea041616ee4ca19195609caf245a06/users/e84a6e7daadb49a48d75dbdcb75d03ee/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:08.927893 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68d9a8f-2c8f-46b3-b247-210385af6c08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51ea041616ee4ca19195609caf245a06, user_id=e84a6e7daadb49a48d75dbdcb75d03ee, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:08.930521 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68d9a8f-2c8f-46b3-b247-210385af6c08 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:08.940435 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1395/2831] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:54:08 2022] PUT /identity/v3/projects/51ea041616ee4ca19195609caf245a06/users/e84a6e7daadb49a48d75dbdcb75d03ee/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:54:08.952073 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a62e0f-126b-4d35-90c5-b05270c9b08c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:08.952365 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a62e0f-126b-4d35-90c5-b05270c9b08c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:08.952647 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a62e0f-126b-4d35-90c5-b05270c9b08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:08.978567 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-d1a62e0f-126b-4d35-90c5-b05270c9b08c None None] MFA Rules not processed for user `e84a6e7daadb49a48d75dbdcb75d03ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:54:08.979805 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d1a62e0f-126b-4d35-90c5-b05270c9b08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:09.047473 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1437/2832] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:54:08 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:54:09.058673 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d9a8f-2c8f-46b3-b247-210385af6c08 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:09.060781 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-b68d9a8f-2c8f-46b3-b247-210385af6c08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:09.118858 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d9a8f-2c8f-46b3-b247-210385af6c08 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:09.122434 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22ac11-a1cd-41ab-8fbb-622809540c81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:09.123102 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22ac11-a1cd-41ab-8fbb-622809540c81 service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:09.123383 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22ac11-a1cd-41ab-8fbb-622809540c81 service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:09.123682 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22ac11-a1cd-41ab-8fbb-622809540c81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:09.180090 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22ac11-a1cd-41ab-8fbb-622809540c81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:09.181550 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22ac11-a1cd-41ab-8fbb-622809540c81 service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:09.190922 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1396/2833] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:54:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:54:11.701162 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a62e0f-126b-4d35-90c5-b05270c9b08c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:11.718259 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:54:11.762809 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a62e0f-126b-4d35-90c5-b05270c9b08c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:11.767223 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276bf4e-31a8-4c1a-b463-e9bf87c0b8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:11.768084 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276bf4e-31a8-4c1a-b463-e9bf87c0b8ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:11.768367 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276bf4e-31a8-4c1a-b463-e9bf87c0b8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:11.768639 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276bf4e-31a8-4c1a-b463-e9bf87c0b8ec admin admin] PATH_INFO: `/v3/users/cfbcae43722e45e6bc879688363221e7` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:11.769804 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e276bf4e-31a8-4c1a-b463-e9bf87c0b8ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfbcae43722e45e6bc879688363221e7)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:11.771727 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e276bf4e-31a8-4c1a-b463-e9bf87c0b8ec admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:11.815051 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e276bf4e-31a8-4c1a-b463-e9bf87c0b8ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfbcae43722e45e6bc879688363221e7'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:11.815692 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e276bf4e-31a8-4c1a-b463-e9bf87c0b8ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfbcae43722e45e6bc879688363221e7'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:11.816293 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e276bf4e-31a8-4c1a-b463-e9bf87c0b8ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfbcae43722e45e6bc879688363221e7'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:11.823578 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e276bf4e-31a8-4c1a-b463-e9bf87c0b8ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfbcae43722e45e6bc879688363221e7'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:11.830628 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e276bf4e-31a8-4c1a-b463-e9bf87c0b8ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfbcae43722e45e6bc879688363221e7'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:11.847215 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1438/2834] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:54:11 2022] DELETE /identity/v3/users/cfbcae43722e45e6bc879688363221e7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:54:11.851768 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087bfcb0-08a3-4948-a754-ae34c817aa55 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:11.852251 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087bfcb0-08a3-4948-a754-ae34c817aa55 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:11.852363 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087bfcb0-08a3-4948-a754-ae34c817aa55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:11.869396 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-087bfcb0-08a3-4948-a754-ae34c817aa55 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:54:11.871236 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-087bfcb0-08a3-4948-a754-ae34c817aa55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:11.890781 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:54:11.931523 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1397/2835] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:54:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:54:11.942608 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276bf4e-31a8-4c1a-b463-e9bf87c0b8ec admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:11.944222 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e276bf4e-31a8-4c1a-b463-e9bf87c0b8ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:12.002975 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276bf4e-31a8-4c1a-b463-e9bf87c0b8ec admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:12.006631 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d3fd3-4702-42b2-9739-b97fc2eebe06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:12.007275 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d3fd3-4702-42b2-9739-b97fc2eebe06 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:12.007560 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d3fd3-4702-42b2-9739-b97fc2eebe06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:12.007838 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d3fd3-4702-42b2-9739-b97fc2eebe06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:12.017178 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1d3fd3-4702-42b2-9739-b97fc2eebe06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:12.018619 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1d3fd3-4702-42b2-9739-b97fc2eebe06 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:12.031373 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1439/2836] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:54:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:54:12.303522 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087bfcb0-08a3-4948-a754-ae34c817aa55 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:12.304980 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-087bfcb0-08a3-4948-a754-ae34c817aa55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:12.317452 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087bfcb0-08a3-4948-a754-ae34c817aa55 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:12.322249 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564030be-77e6-47b7-9255-b39606e7ea87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:12.323716 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564030be-77e6-47b7-9255-b39606e7ea87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:12.323995 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564030be-77e6-47b7-9255-b39606e7ea87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:12.324293 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564030be-77e6-47b7-9255-b39606e7ea87 admin admin] PATH_INFO: `/v3/projects/23f6cea05397488cad95fbb0a9953367` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:12.325809 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564030be-77e6-47b7-9255-b39606e7ea87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23f6cea05397488cad95fbb0a9953367)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:12.327785 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564030be-77e6-47b7-9255-b39606e7ea87 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:12.375698 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-564030be-77e6-47b7-9255-b39606e7ea87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23f6cea05397488cad95fbb0a9953367', 'request_id': 'req-564030be-77e6-47b7-9255-b39606e7ea87'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:12.382426 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-564030be-77e6-47b7-9255-b39606e7ea87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23f6cea05397488cad95fbb0a9953367', 'request_id': 'req-564030be-77e6-47b7-9255-b39606e7ea87'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:12.390771 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-564030be-77e6-47b7-9255-b39606e7ea87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23f6cea05397488cad95fbb0a9953367', 'request_id': 'req-564030be-77e6-47b7-9255-b39606e7ea87'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:12.401352 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-564030be-77e6-47b7-9255-b39606e7ea87 admin admin] The token cache is being invalidate because project 23f6cea05397488cad95fbb0a9953367 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:54:12.401649 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-564030be-77e6-47b7-9255-b39606e7ea87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:12.402277 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-564030be-77e6-47b7-9255-b39606e7ea87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:12.404119 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1398/2837] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:54:12 2022] DELETE /identity/v3/projects/23f6cea05397488cad95fbb0a9953367 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:54:12.408367 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d3fd3-4702-42b2-9739-b97fc2eebe06 service neutron] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:12.419262 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d3fd3-4702-42b2-9739-b97fc2eebe06 service neutron] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:12.452194 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:54:12.477495 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf3c46-1090-413f-881a-4b48d29cd507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:12.478359 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf3c46-1090-413f-881a-4b48d29cd507 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:12.478671 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf3c46-1090-413f-881a-4b48d29cd507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:12.478949 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf3c46-1090-413f-881a-4b48d29cd507 admin admin] PATH_INFO: `/v3/users/e84a6e7daadb49a48d75dbdcb75d03ee` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:12.480159 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf3c46-1090-413f-881a-4b48d29cd507 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e84a6e7daadb49a48d75dbdcb75d03ee)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:12.482043 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bf3c46-1090-413f-881a-4b48d29cd507 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:12.529383 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-58bf3c46-1090-413f-881a-4b48d29cd507 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e84a6e7daadb49a48d75dbdcb75d03ee'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:12.530021 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-58bf3c46-1090-413f-881a-4b48d29cd507 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e84a6e7daadb49a48d75dbdcb75d03ee'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:12.530641 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-58bf3c46-1090-413f-881a-4b48d29cd507 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e84a6e7daadb49a48d75dbdcb75d03ee'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:12.537605 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-58bf3c46-1090-413f-881a-4b48d29cd507 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e84a6e7daadb49a48d75dbdcb75d03ee'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:12.544518 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-58bf3c46-1090-413f-881a-4b48d29cd507 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e84a6e7daadb49a48d75dbdcb75d03ee'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:12.562387 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1440/2838] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:54:12 2022] DELETE /identity/v3/users/e84a6e7daadb49a48d75dbdcb75d03ee => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:54:12.836582 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564030be-77e6-47b7-9255-b39606e7ea87 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:12.838027 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-564030be-77e6-47b7-9255-b39606e7ea87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:12.851034 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564030be-77e6-47b7-9255-b39606e7ea87 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:12.907594 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c9888-1da4-430c-a580-6003124ba784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:12.908459 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c9888-1da4-430c-a580-6003124ba784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:12.908741 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c9888-1da4-430c-a580-6003124ba784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:12.909022 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c9888-1da4-430c-a580-6003124ba784 admin admin] PATH_INFO: `/v3/projects/51ea041616ee4ca19195609caf245a06` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:12.910485 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842c9888-1da4-430c-a580-6003124ba784 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51ea041616ee4ca19195609caf245a06)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:12.912385 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842c9888-1da4-430c-a580-6003124ba784 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:12.957711 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-842c9888-1da4-430c-a580-6003124ba784 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51ea041616ee4ca19195609caf245a06', 'request_id': 'req-842c9888-1da4-430c-a580-6003124ba784'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:12.958721 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:54:12.965778 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-842c9888-1da4-430c-a580-6003124ba784 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51ea041616ee4ca19195609caf245a06', 'request_id': 'req-842c9888-1da4-430c-a580-6003124ba784'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:12.973505 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-842c9888-1da4-430c-a580-6003124ba784 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51ea041616ee4ca19195609caf245a06', 'request_id': 'req-842c9888-1da4-430c-a580-6003124ba784'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:12.984933 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-842c9888-1da4-430c-a580-6003124ba784 admin admin] The token cache is being invalidate because project 51ea041616ee4ca19195609caf245a06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:54:12.985227 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-842c9888-1da4-430c-a580-6003124ba784 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:12.985854 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-842c9888-1da4-430c-a580-6003124ba784 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:12.987431 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1399/2839] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:54:12 2022] DELETE /identity/v3/projects/51ea041616ee4ca19195609caf245a06 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:54:12.992484 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551558a5-1b2a-4d68-b62e-85c70fcb5064 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:12.992945 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551558a5-1b2a-4d68-b62e-85c70fcb5064 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:12.993088 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551558a5-1b2a-4d68-b62e-85c70fcb5064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:13.010480 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-551558a5-1b2a-4d68-b62e-85c70fcb5064 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:54:13.011705 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-551558a5-1b2a-4d68-b62e-85c70fcb5064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:13.068424 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1441/2840] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:54:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:54:13.128774 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93960672-da27-4cbd-816a-00c176d189a2 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:13.129071 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93960672-da27-4cbd-816a-00c176d189a2 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:13.129353 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93960672-da27-4cbd-816a-00c176d189a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:13.147356 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-93960672-da27-4cbd-816a-00c176d189a2 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:54:13.148571 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-93960672-da27-4cbd-816a-00c176d189a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:13.156968 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1400/2841] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:54:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:54:13.161569 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551558a5-1b2a-4d68-b62e-85c70fcb5064 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:13.171726 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551558a5-1b2a-4d68-b62e-85c70fcb5064 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:13.176259 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad37344-5a22-47ab-8837-4ec1440fa72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:13.176907 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad37344-5a22-47ab-8837-4ec1440fa72b admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:13.177190 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad37344-5a22-47ab-8837-4ec1440fa72b admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:13.177465 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad37344-5a22-47ab-8837-4ec1440fa72b admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:13.178185 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad37344-5a22-47ab-8837-4ec1440fa72b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:54:13.178526 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad37344-5a22-47ab-8837-4ec1440fa72b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:13.180111 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad37344-5a22-47ab-8837-4ec1440fa72b admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:13.191319 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1442/2842] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:54:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 03:54:13.195483 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93960672-da27-4cbd-816a-00c176d189a2 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:13.204596 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93960672-da27-4cbd-816a-00c176d189a2 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:13.209270 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837e51e-7ac7-4aeb-b6a7-57f619d5241b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:13.209893 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837e51e-7ac7-4aeb-b6a7-57f619d5241b admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:13.210182 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837e51e-7ac7-4aeb-b6a7-57f619d5241b admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:13.210480 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837e51e-7ac7-4aeb-b6a7-57f619d5241b admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:13.211190 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837e51e-7ac7-4aeb-b6a7-57f619d5241b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:13.213106 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837e51e-7ac7-4aeb-b6a7-57f619d5241b admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:13.240596 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1401/2843] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:54:13 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:54:13.244807 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad37344-5a22-47ab-8837-4ec1440fa72b admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:13.255127 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad37344-5a22-47ab-8837-4ec1440fa72b admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:13.304917 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:54:13.333948 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f725c5-86fe-4183-a492-8243ff3063e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:13.334776 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f725c5-86fe-4183-a492-8243ff3063e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:13.335134 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f725c5-86fe-4183-a492-8243ff3063e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:13.335477 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f725c5-86fe-4183-a492-8243ff3063e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:13.336311 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f725c5-86fe-4183-a492-8243ff3063e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:13.338269 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f725c5-86fe-4183-a492-8243ff3063e3 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:13.365424 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1443/2844] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:54:13 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:54:13.368457 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837e51e-7ac7-4aeb-b6a7-57f619d5241b admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:13.380284 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837e51e-7ac7-4aeb-b6a7-57f619d5241b admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:13.385946 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5b127-b707-42c6-b60d-3e45866ba567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:13.386651 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5b127-b707-42c6-b60d-3e45866ba567 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:13.386936 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5b127-b707-42c6-b60d-3e45866ba567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:13.387225 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5b127-b707-42c6-b60d-3e45866ba567 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:13.387942 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb5b127-b707-42c6-b60d-3e45866ba567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:13.389548 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb5b127-b707-42c6-b60d-3e45866ba567 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:13.403251 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1402/2845] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:54:13.407349 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f725c5-86fe-4183-a492-8243ff3063e3 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:13.418922 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f725c5-86fe-4183-a492-8243ff3063e3 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:13.423849 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4060667-c9ec-4ff5-96fb-55f292b5f900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:13.424590 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4060667-c9ec-4ff5-96fb-55f292b5f900 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:13.425006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4060667-c9ec-4ff5-96fb-55f292b5f900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:13.425376 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4060667-c9ec-4ff5-96fb-55f292b5f900 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:13.432206 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4060667-c9ec-4ff5-96fb-55f292b5f900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:13.432206 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4060667-c9ec-4ff5-96fb-55f292b5f900 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:13.438244 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1444/2846] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:54:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 03:54:13.442423 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5b127-b707-42c6-b60d-3e45866ba567 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:13.452915 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5b127-b707-42c6-b60d-3e45866ba567 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:13.457710 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2676dac-5078-4ea3-bc03-ce22374b6b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:13.458618 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2676dac-5078-4ea3-bc03-ce22374b6b32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:13.458910 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2676dac-5078-4ea3-bc03-ce22374b6b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:13.459176 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2676dac-5078-4ea3-bc03-ce22374b6b32 admin admin] PATH_INFO: `/v3/projects/c33e5478747646279eb98a1859a3bf2f/users/acd0ea1dd9ca4cc2bca22749070366a3/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:13.474170 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2676dac-5078-4ea3-bc03-ce22374b6b32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c33e5478747646279eb98a1859a3bf2f, user_id=acd0ea1dd9ca4cc2bca22749070366a3, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:13.476836 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2676dac-5078-4ea3-bc03-ce22374b6b32 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:13.490069 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1403/2847] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:54:13 2022] PUT /identity/v3/projects/c33e5478747646279eb98a1859a3bf2f/users/acd0ea1dd9ca4cc2bca22749070366a3/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:54:13.500294 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd5510-e884-4524-99c7-94afcae96ab4 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:13.500604 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd5510-e884-4524-99c7-94afcae96ab4 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:13.500888 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd5510-e884-4524-99c7-94afcae96ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:13.528230 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-3dcd5510-e884-4524-99c7-94afcae96ab4 None None] MFA Rules not processed for user `acd0ea1dd9ca4cc2bca22749070366a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:54:13.529546 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3dcd5510-e884-4524-99c7-94afcae96ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:13.593607 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1445/2848] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:54:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:54:13.605602 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2676dac-5078-4ea3-bc03-ce22374b6b32 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:13.607451 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a2676dac-5078-4ea3-bc03-ce22374b6b32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:13.665704 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2676dac-5078-4ea3-bc03-ce22374b6b32 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:13.669999 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51090f-3e93-425c-b06a-7440676e52da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:13.670683 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51090f-3e93-425c-b06a-7440676e52da service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:13.670971 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51090f-3e93-425c-b06a-7440676e52da service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:13.671249 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51090f-3e93-425c-b06a-7440676e52da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:13.680028 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c51090f-3e93-425c-b06a-7440676e52da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:13.681455 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c51090f-3e93-425c-b06a-7440676e52da service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:13.691026 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1404/2849] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:54:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:54:14.459538 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd5510-e884-4524-99c7-94afcae96ab4 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:14.460923 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3dcd5510-e884-4524-99c7-94afcae96ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:14.524956 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd5510-e884-4524-99c7-94afcae96ab4 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:14.529470 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14555c7-1775-4eda-81dc-146855d055dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:14.530332 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14555c7-1775-4eda-81dc-146855d055dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:14.530645 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14555c7-1775-4eda-81dc-146855d055dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:14.530925 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14555c7-1775-4eda-81dc-146855d055dc admin admin] PATH_INFO: `/v3/users/b0974cbbf4374eebba914d3e001542a7` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:14.532107 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14555c7-1775-4eda-81dc-146855d055dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0974cbbf4374eebba914d3e001542a7)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:14.534011 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14555c7-1775-4eda-81dc-146855d055dc admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:14.581004 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b14555c7-1775-4eda-81dc-146855d055dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0974cbbf4374eebba914d3e001542a7'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:14.581644 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b14555c7-1775-4eda-81dc-146855d055dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0974cbbf4374eebba914d3e001542a7'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:14.582248 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b14555c7-1775-4eda-81dc-146855d055dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0974cbbf4374eebba914d3e001542a7'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:14.588140 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:54:14.590683 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b14555c7-1775-4eda-81dc-146855d055dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0974cbbf4374eebba914d3e001542a7'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:14.599681 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-b14555c7-1775-4eda-81dc-146855d055dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0974cbbf4374eebba914d3e001542a7'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:14.616764 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1446/2850] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:54:14 2022] DELETE /identity/v3/users/b0974cbbf4374eebba914d3e001542a7 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:54:14.621815 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f3eff-a403-4ac2-b249-22d884f6be91 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:14.622273 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f3eff-a403-4ac2-b249-22d884f6be91 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:14.622381 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f3eff-a403-4ac2-b249-22d884f6be91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:14.641003 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-ca1f3eff-a403-4ac2-b249-22d884f6be91 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:54:14.642232 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ca1f3eff-a403-4ac2-b249-22d884f6be91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:14.706477 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1405/2851] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:54:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:54:14.716359 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14555c7-1775-4eda-81dc-146855d055dc admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:14.717782 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-b14555c7-1775-4eda-81dc-146855d055dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:14.774129 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14555c7-1775-4eda-81dc-146855d055dc admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:14.777807 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07089573-d61e-4fa9-a620-3d356c48a670 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:14.778449 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07089573-d61e-4fa9-a620-3d356c48a670 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:14.778771 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07089573-d61e-4fa9-a620-3d356c48a670 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:14.779047 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07089573-d61e-4fa9-a620-3d356c48a670 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:14.788102 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07089573-d61e-4fa9-a620-3d356c48a670 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:14.789523 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07089573-d61e-4fa9-a620-3d356c48a670 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:14.798873 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1447/2852] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:54:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:54:15.065433 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f3eff-a403-4ac2-b249-22d884f6be91 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:15.066959 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ca1f3eff-a403-4ac2-b249-22d884f6be91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:15.084446 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f3eff-a403-4ac2-b249-22d884f6be91 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:15.090089 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2d44f-6b46-4009-bc02-d1033fd5803c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:15.091168 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2d44f-6b46-4009-bc02-d1033fd5803c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:15.091633 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2d44f-6b46-4009-bc02-d1033fd5803c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:15.092019 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2d44f-6b46-4009-bc02-d1033fd5803c admin admin] PATH_INFO: `/v3/projects/d3d22ebe1bf14144a36951aa8d8021d8` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:15.093481 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e2d44f-6b46-4009-bc02-d1033fd5803c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3d22ebe1bf14144a36951aa8d8021d8)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:15.095550 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e2d44f-6b46-4009-bc02-d1033fd5803c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:15.109261 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:54:15.148927 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-59e2d44f-6b46-4009-bc02-d1033fd5803c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3d22ebe1bf14144a36951aa8d8021d8', 'request_id': 'req-59e2d44f-6b46-4009-bc02-d1033fd5803c'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:15.155774 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-59e2d44f-6b46-4009-bc02-d1033fd5803c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3d22ebe1bf14144a36951aa8d8021d8', 'request_id': 'req-59e2d44f-6b46-4009-bc02-d1033fd5803c'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:15.164147 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-59e2d44f-6b46-4009-bc02-d1033fd5803c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3d22ebe1bf14144a36951aa8d8021d8', 'request_id': 'req-59e2d44f-6b46-4009-bc02-d1033fd5803c'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:15.176753 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-59e2d44f-6b46-4009-bc02-d1033fd5803c admin admin] The token cache is being invalidate because project d3d22ebe1bf14144a36951aa8d8021d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:54:15.177038 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-59e2d44f-6b46-4009-bc02-d1033fd5803c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:15.177672 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-59e2d44f-6b46-4009-bc02-d1033fd5803c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:15.179247 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1406/2853] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:54:15 2022] DELETE /identity/v3/projects/d3d22ebe1bf14144a36951aa8d8021d8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:54:15.185463 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c162b1-01c5-4a44-8e18-b0736d3e9d10 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:15.185794 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c162b1-01c5-4a44-8e18-b0736d3e9d10 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:15.186069 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c162b1-01c5-4a44-8e18-b0736d3e9d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:15.204566 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-29c162b1-01c5-4a44-8e18-b0736d3e9d10 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:54:15.205883 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-29c162b1-01c5-4a44-8e18-b0736d3e9d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:15.264497 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1448/2854] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:54:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:54:15.273628 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0abdf-325c-4b19-9064-529ba14b777b None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:15.273925 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0abdf-325c-4b19-9064-529ba14b777b None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:15.274236 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0abdf-325c-4b19-9064-529ba14b777b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:15.295831 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-1ae0abdf-325c-4b19-9064-529ba14b777b None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:54:15.298031 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-1ae0abdf-325c-4b19-9064-529ba14b777b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:15.312984 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1407/2855] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:54:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:54:15.319368 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c162b1-01c5-4a44-8e18-b0736d3e9d10 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:15.331244 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c162b1-01c5-4a44-8e18-b0736d3e9d10 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:15.336178 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9474d4-7874-491a-b6ff-516ad0e8f0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:15.336936 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9474d4-7874-491a-b6ff-516ad0e8f0b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:15.337233 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9474d4-7874-491a-b6ff-516ad0e8f0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:15.337558 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9474d4-7874-491a-b6ff-516ad0e8f0b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:15.338618 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9474d4-7874-491a-b6ff-516ad0e8f0b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:54:15.338929 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9474d4-7874-491a-b6ff-516ad0e8f0b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:15.341319 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9474d4-7874-491a-b6ff-516ad0e8f0b9 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:15.358551 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1449/2856] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:54:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:54:15.359613 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0abdf-325c-4b19-9064-529ba14b777b None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:15.368979 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0abdf-325c-4b19-9064-529ba14b777b None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:15.373716 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a6108-ce3b-4081-a406-13eef0565a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:15.374363 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a6108-ce3b-4081-a406-13eef0565a84 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:15.374682 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a6108-ce3b-4081-a406-13eef0565a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:15.374962 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a6108-ce3b-4081-a406-13eef0565a84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:15.375657 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a6108-ce3b-4081-a406-13eef0565a84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:15.377549 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a6108-ce3b-4081-a406-13eef0565a84 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:15.404030 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1408/2857] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:54:15 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:54:15.408061 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9474d4-7874-491a-b6ff-516ad0e8f0b9 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:15.418818 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9474d4-7874-491a-b6ff-516ad0e8f0b9 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:15.476882 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e85802-5082-4f79-8ada-b7008243faab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:15.477547 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e85802-5082-4f79-8ada-b7008243faab admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:15.477836 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e85802-5082-4f79-8ada-b7008243faab admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:15.478117 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e85802-5082-4f79-8ada-b7008243faab admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:15.478846 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e85802-5082-4f79-8ada-b7008243faab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:15.481329 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e85802-5082-4f79-8ada-b7008243faab admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:15.488677 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:54:15.502601 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1450/2858] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:54:15 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:54:15.506724 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a6108-ce3b-4081-a406-13eef0565a84 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:15.516778 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a6108-ce3b-4081-a406-13eef0565a84 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:15.521276 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8aa0f-1c63-4c54-b956-d3a5f5ec8027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:15.521928 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8aa0f-1c63-4c54-b956-d3a5f5ec8027 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:15.522211 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8aa0f-1c63-4c54-b956-d3a5f5ec8027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:15.522576 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8aa0f-1c63-4c54-b956-d3a5f5ec8027 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:15.523300 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8aa0f-1c63-4c54-b956-d3a5f5ec8027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:15.524892 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8aa0f-1c63-4c54-b956-d3a5f5ec8027 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:15.535689 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1409/2859] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:54:15.539357 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e85802-5082-4f79-8ada-b7008243faab admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:15.549597 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e85802-5082-4f79-8ada-b7008243faab admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:15.555012 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28d69b-ce52-47c5-ba35-11e9b982ec36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:15.555705 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28d69b-ce52-47c5-ba35-11e9b982ec36 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:15.555996 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28d69b-ce52-47c5-ba35-11e9b982ec36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:15.556276 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28d69b-ce52-47c5-ba35-11e9b982ec36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:15.557012 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28d69b-ce52-47c5-ba35-11e9b982ec36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:15.558639 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e28d69b-ce52-47c5-ba35-11e9b982ec36 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:15.569547 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1451/2860] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:54:15.573263 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8aa0f-1c63-4c54-b956-d3a5f5ec8027 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:15.583613 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8aa0f-1c63-4c54-b956-d3a5f5ec8027 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:15.588239 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4b792-fb35-43cc-a44e-916e87fff3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:15.589115 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4b792-fb35-43cc-a44e-916e87fff3e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:15.590011 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4b792-fb35-43cc-a44e-916e87fff3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:15.590292 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f4b792-fb35-43cc-a44e-916e87fff3e2 admin admin] PATH_INFO: `/v3/projects/cd82f2a1bc6c42fc8f7f627dd9917c45/users/cb5f2620c55c43ba89da6aea0dc67878/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:15.604454 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4b792-fb35-43cc-a44e-916e87fff3e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd82f2a1bc6c42fc8f7f627dd9917c45, user_id=cb5f2620c55c43ba89da6aea0dc67878, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:15.607154 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f4b792-fb35-43cc-a44e-916e87fff3e2 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:15.620013 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1410/2861] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:54:15 2022] PUT /identity/v3/projects/cd82f2a1bc6c42fc8f7f627dd9917c45/users/cb5f2620c55c43ba89da6aea0dc67878/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:54:15.630066 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a311727-979a-4981-9b2d-d5d674ffe86b None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:15.630385 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a311727-979a-4981-9b2d-d5d674ffe86b None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:15.630705 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a311727-979a-4981-9b2d-d5d674ffe86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:15.657090 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-3a311727-979a-4981-9b2d-d5d674ffe86b None None] MFA Rules not processed for user `cb5f2620c55c43ba89da6aea0dc67878`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:54:15.658218 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3a311727-979a-4981-9b2d-d5d674ffe86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:15.721431 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1452/2862] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:54:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:54:15.732004 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4b792-fb35-43cc-a44e-916e87fff3e2 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:15.733734 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-11f4b792-fb35-43cc-a44e-916e87fff3e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:15.789072 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f4b792-fb35-43cc-a44e-916e87fff3e2 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:15.792693 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd063074-79e4-4d39-a87b-d6d75f0a17dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03f2ad420185421c97d5bc06be965bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:15.793325 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd063074-79e4-4d39-a87b-d6d75f0a17dd service cinder] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:15.793606 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd063074-79e4-4d39-a87b-d6d75f0a17dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:15.793883 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd063074-79e4-4d39-a87b-d6d75f0a17dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:15.801984 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd063074-79e4-4d39-a87b-d6d75f0a17dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:15.803431 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd063074-79e4-4d39-a87b-d6d75f0a17dd service cinder] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:15.812023 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1411/2863] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:54:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:54:16.230065 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a311727-979a-4981-9b2d-d5d674ffe86b None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:16.231562 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-3a311727-979a-4981-9b2d-d5d674ffe86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:16.293864 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a311727-979a-4981-9b2d-d5d674ffe86b None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:16.298243 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03187cc-6600-4818-b300-4997e9b50d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:16.299131 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03187cc-6600-4818-b300-4997e9b50d45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:16.299412 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03187cc-6600-4818-b300-4997e9b50d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:16.299684 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03187cc-6600-4818-b300-4997e9b50d45 admin admin] PATH_INFO: `/v3/users/acd0ea1dd9ca4cc2bca22749070366a3` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:16.300901 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03187cc-6600-4818-b300-4997e9b50d45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acd0ea1dd9ca4cc2bca22749070366a3)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:16.302887 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03187cc-6600-4818-b300-4997e9b50d45 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:16.347484 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c03187cc-6600-4818-b300-4997e9b50d45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acd0ea1dd9ca4cc2bca22749070366a3'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:16.348139 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c03187cc-6600-4818-b300-4997e9b50d45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acd0ea1dd9ca4cc2bca22749070366a3'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:16.348776 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c03187cc-6600-4818-b300-4997e9b50d45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acd0ea1dd9ca4cc2bca22749070366a3'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:16.356256 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c03187cc-6600-4818-b300-4997e9b50d45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acd0ea1dd9ca4cc2bca22749070366a3'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:16.363279 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-c03187cc-6600-4818-b300-4997e9b50d45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acd0ea1dd9ca4cc2bca22749070366a3'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:16.370382 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:INSERT=3,keystone:SELECT=88,keystone:DELETE=9 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:54:16.383344 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1453/2864] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:54:16 2022] DELETE /identity/v3/users/acd0ea1dd9ca4cc2bca22749070366a3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:54:16.388113 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c992a1-2580-45c3-92b8-3560f9b46c19 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:16.388402 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c992a1-2580-45c3-92b8-3560f9b46c19 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:16.388680 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c992a1-2580-45c3-92b8-3560f9b46c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:16.405213 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-a8c992a1-2580-45c3-92b8-3560f9b46c19 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:54:16.406482 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a8c992a1-2580-45c3-92b8-3560f9b46c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:16.439427 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:54:16.467897 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1412/2865] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:54:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:54:16.478088 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03187cc-6600-4818-b300-4997e9b50d45 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:16.479556 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c03187cc-6600-4818-b300-4997e9b50d45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:16.536242 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03187cc-6600-4818-b300-4997e9b50d45 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:16.539909 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75fed9-9f50-461f-8d19-c589f83773de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:16.540554 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75fed9-9f50-461f-8d19-c589f83773de service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:16.540842 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75fed9-9f50-461f-8d19-c589f83773de service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:16.541121 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75fed9-9f50-461f-8d19-c589f83773de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:16.550009 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75fed9-9f50-461f-8d19-c589f83773de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:16.551647 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75fed9-9f50-461f-8d19-c589f83773de service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:16.561371 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1454/2866] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:54:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:54:16.843489 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c992a1-2580-45c3-92b8-3560f9b46c19 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:16.844943 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-a8c992a1-2580-45c3-92b8-3560f9b46c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:16.857149 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c992a1-2580-45c3-92b8-3560f9b46c19 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:16.861773 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4190a5-7b27-4423-bdf0-471c2e85e051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:16.862670 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4190a5-7b27-4423-bdf0-471c2e85e051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:16.862954 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4190a5-7b27-4423-bdf0-471c2e85e051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:16.863233 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4190a5-7b27-4423-bdf0-471c2e85e051 admin admin] PATH_INFO: `/v3/projects/c33e5478747646279eb98a1859a3bf2f` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:16.864427 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4190a5-7b27-4423-bdf0-471c2e85e051 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c33e5478747646279eb98a1859a3bf2f)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:16.866343 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4190a5-7b27-4423-bdf0-471c2e85e051 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:16.912489 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8f4190a5-7b27-4423-bdf0-471c2e85e051 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c33e5478747646279eb98a1859a3bf2f', 'request_id': 'req-8f4190a5-7b27-4423-bdf0-471c2e85e051'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:16.918482 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8f4190a5-7b27-4423-bdf0-471c2e85e051 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c33e5478747646279eb98a1859a3bf2f', 'request_id': 'req-8f4190a5-7b27-4423-bdf0-471c2e85e051'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:16.925796 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8f4190a5-7b27-4423-bdf0-471c2e85e051 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c33e5478747646279eb98a1859a3bf2f', 'request_id': 'req-8f4190a5-7b27-4423-bdf0-471c2e85e051'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:16.936430 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8f4190a5-7b27-4423-bdf0-471c2e85e051 admin admin] The token cache is being invalidate because project c33e5478747646279eb98a1859a3bf2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:54:16.936722 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8f4190a5-7b27-4423-bdf0-471c2e85e051 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:16.937339 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-8f4190a5-7b27-4423-bdf0-471c2e85e051 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:16.938917 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1413/2867] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:54:16 2022] DELETE /identity/v3/projects/c33e5478747646279eb98a1859a3bf2f => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:54:17.148285 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a210d61-88aa-47ae-87d9-f0dcc443f11d None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:17.148592 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a210d61-88aa-47ae-87d9-f0dcc443f11d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:17.148877 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a210d61-88aa-47ae-87d9-f0dcc443f11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:17.167202 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-7a210d61-88aa-47ae-87d9-f0dcc443f11d None None] MFA Rules not processed for user `cb5f2620c55c43ba89da6aea0dc67878`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:54:17.168931 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7a210d61-88aa-47ae-87d9-f0dcc443f11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:17.222894 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1455/2868] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:54:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:54:17.259235 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4190a5-7b27-4423-bdf0-471c2e85e051 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:17.260619 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8f4190a5-7b27-4423-bdf0-471c2e85e051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:17.318695 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4190a5-7b27-4423-bdf0-471c2e85e051 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:17.322256 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03115a18-62cc-49ba-b4a0-20d6b9d69f55 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a567cddc98164bd39317a245626d0f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:17.322951 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03115a18-62cc-49ba-b4a0-20d6b9d69f55 service glance] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:17.323235 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03115a18-62cc-49ba-b4a0-20d6b9d69f55 service glance] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:17.323558 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03115a18-62cc-49ba-b4a0-20d6b9d69f55 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:17.325605 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-03115a18-62cc-49ba-b4a0-20d6b9d69f55 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:17.404002 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03115a18-62cc-49ba-b4a0-20d6b9d69f55 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:17.405382 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03115a18-62cc-49ba-b4a0-20d6b9d69f55 service glance] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:17.417257 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1414/2869] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:54:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:54:17.860741 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a210d61-88aa-47ae-87d9-f0dcc443f11d None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:17.862169 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-7a210d61-88aa-47ae-87d9-f0dcc443f11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:17.877931 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03115a18-62cc-49ba-b4a0-20d6b9d69f55 service glance] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:17.880013 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-03115a18-62cc-49ba-b4a0-20d6b9d69f55 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:17.886862 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:54:17.935217 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a210d61-88aa-47ae-87d9-f0dcc443f11d None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:17.940196 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9649b2-5ec7-448f-a09c-87d94ddc3a1e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb39129b3ed04db28ed01860b37bd714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:17.940846 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9649b2-5ec7-448f-a09c-87d94ddc3a1e service placement] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:17.941144 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9649b2-5ec7-448f-a09c-87d94ddc3a1e service placement] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:17.941413 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9649b2-5ec7-448f-a09c-87d94ddc3a1e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:17.943226 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-bd9649b2-5ec7-448f-a09c-87d94ddc3a1e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:17.944873 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03115a18-62cc-49ba-b4a0-20d6b9d69f55 service glance] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:17.948390 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a6cbe-4e0c-479d-b7ea-51137867bccf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:17.949565 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a6cbe-4e0c-479d-b7ea-51137867bccf service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:17.949844 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a6cbe-4e0c-479d-b7ea-51137867bccf service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:17.950115 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a6cbe-4e0c-479d-b7ea-51137867bccf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:17.951935 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-325a6cbe-4e0c-479d-b7ea-51137867bccf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:17.955241 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9649b2-5ec7-448f-a09c-87d94ddc3a1e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:17.956808 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9649b2-5ec7-448f-a09c-87d94ddc3a1e service placement] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:17.965215 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325a6cbe-4e0c-479d-b7ea-51137867bccf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:17.966668 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325a6cbe-4e0c-479d-b7ea-51137867bccf service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:17.966933 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1456/2870] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:54:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:54:17.977791 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1415/2871] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:54:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 03:54:19.975654 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9649b2-5ec7-448f-a09c-87d94ddc3a1e service placement] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:19.977220 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-bd9649b2-5ec7-448f-a09c-87d94ddc3a1e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:19.989494 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9649b2-5ec7-448f-a09c-87d94ddc3a1e service placement] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:19.993077 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4cc4e-39ab-43b4-ae02-441d632be852 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:19.993738 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4cc4e-39ab-43b4-ae02-441d632be852 service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:19.994032 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4cc4e-39ab-43b4-ae02-441d632be852 service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:19.994313 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4cc4e-39ab-43b4-ae02-441d632be852 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:19.996970 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-39a4cc4e-39ab-43b4-ae02-441d632be852 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:20.007762 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a4cc4e-39ab-43b4-ae02-441d632be852 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:20.009439 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a4cc4e-39ab-43b4-ae02-441d632be852 service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:20.018954 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1457/2872] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:54:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:54:27.972822 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=24 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:54:30.014874 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=93,keystone:DELETE=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:54:30.731279 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a6cbe-4e0c-479d-b7ea-51137867bccf service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:30.733176 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-325a6cbe-4e0c-479d-b7ea-51137867bccf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:30.750242 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a6cbe-4e0c-479d-b7ea-51137867bccf service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:30.759333 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6877e05-9951-42c5-9a0a-bbf427e073e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:30.760016 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6877e05-9951-42c5-9a0a-bbf427e073e4 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:30.760429 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6877e05-9951-42c5-9a0a-bbf427e073e4 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:30.760722 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6877e05-9951-42c5-9a0a-bbf427e073e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:30.763311 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d6877e05-9951-42c5-9a0a-bbf427e073e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:30.777436 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6877e05-9951-42c5-9a0a-bbf427e073e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:30.779212 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6877e05-9951-42c5-9a0a-bbf427e073e4 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:30.791104 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1416/2873] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:54:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 03:54:32.303186 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ec7ea-94d7-468e-9f56-0f08aa3ca970 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:32.303651 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ec7ea-94d7-468e-9f56-0f08aa3ca970 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:32.303747 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ec7ea-94d7-468e-9f56-0f08aa3ca970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:32.350787 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-795ec7ea-94d7-468e-9f56-0f08aa3ca970 None None] MFA Rules not processed for user `73fad109df9f449e8ac5f38749c01ace`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:54:32.351993 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-795ec7ea-94d7-468e-9f56-0f08aa3ca970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:32.414343 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1458/2874] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jul 21 03:54:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:54:32.460248 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6877e05-9951-42c5-9a0a-bbf427e073e4 service nova] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:32.461699 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d6877e05-9951-42c5-9a0a-bbf427e073e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:32.550041 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6877e05-9951-42c5-9a0a-bbf427e073e4 service nova] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:32.555862 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4d747-bd02-430e-a4b2-d73f5a6ac39b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8bc228892e45c0a7d1b529c2f9a8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:32.556567 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4d747-bd02-430e-a4b2-d73f5a6ac39b service swift] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:32.556887 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4d747-bd02-430e-a4b2-d73f5a6ac39b service swift] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:32.557198 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4d747-bd02-430e-a4b2-d73f5a6ac39b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:32.565381 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f4d747-bd02-430e-a4b2-d73f5a6ac39b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:32.566975 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f4d747-bd02-430e-a4b2-d73f5a6ac39b service swift] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:32.574809 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1417/2875] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jul 21 03:54:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 03:54:33.062186 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eefd01-1c82-4229-964d-8d692df68d9f None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:33.062495 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eefd01-1c82-4229-964d-8d692df68d9f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:33.062902 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eefd01-1c82-4229-964d-8d692df68d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:33.079908 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-e2eefd01-1c82-4229-964d-8d692df68d9f None None] MFA Rules not processed for user `73fad109df9f449e8ac5f38749c01ace`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:54:33.081091 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e2eefd01-1c82-4229-964d-8d692df68d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:33.088300 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1459/2876] 10.222.0.20 () {58 vars in 967 bytes} [Thu Jul 21 03:54:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:54:33.100367 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4d747-bd02-430e-a4b2-d73f5a6ac39b service swift] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:33.111694 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4d747-bd02-430e-a4b2-d73f5a6ac39b service swift] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:33.116622 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1c9f3-1c29-468b-a2b0-094a8bebad11 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8bc228892e45c0a7d1b529c2f9a8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:33.117251 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1c9f3-1c29-468b-a2b0-094a8bebad11 service swift] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:33.117536 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1c9f3-1c29-468b-a2b0-094a8bebad11 service swift] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:33.117810 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1c9f3-1c29-468b-a2b0-094a8bebad11 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:33.126379 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc1c9f3-1c29-468b-a2b0-094a8bebad11 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:33.127964 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc1c9f3-1c29-468b-a2b0-094a8bebad11 service swift] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:33.135836 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1418/2877] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jul 21 03:54:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 03:54:33.320158 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1992dd7-6b82-47fb-883f-ad6de5c1c889 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:33.320614 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1992dd7-6b82-47fb-883f-ad6de5c1c889 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:33.320738 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1992dd7-6b82-47fb-883f-ad6de5c1c889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:33.338190 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-f1992dd7-6b82-47fb-883f-ad6de5c1c889 None None] MFA Rules not processed for user `73fad109df9f449e8ac5f38749c01ace`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:54:33.339913 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-f1992dd7-6b82-47fb-883f-ad6de5c1c889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:33.346850 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1460/2878] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jul 21 03:54:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:54:33.359245 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1c9f3-1c29-468b-a2b0-094a8bebad11 service swift] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:33.370176 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1c9f3-1c29-468b-a2b0-094a8bebad11 service swift] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:33.375161 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7dac4-d496-4a80-b027-9ab1e2b7d3e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8bc228892e45c0a7d1b529c2f9a8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:33.375805 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7dac4-d496-4a80-b027-9ab1e2b7d3e8 service swift] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:33.376086 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7dac4-d496-4a80-b027-9ab1e2b7d3e8 service swift] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:33.376360 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7dac4-d496-4a80-b027-9ab1e2b7d3e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:33.384284 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7dac4-d496-4a80-b027-9ab1e2b7d3e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:33.385870 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7dac4-d496-4a80-b027-9ab1e2b7d3e8 service swift] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:33.393756 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1419/2879] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jul 21 03:54:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 03:54:33.705007 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3fc8e-f43f-4877-896a-1b1818db9a6f None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:33.705311 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3fc8e-f43f-4877-896a-1b1818db9a6f None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:33.705598 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3fc8e-f43f-4877-896a-1b1818db9a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:33.724590 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-90c3fc8e-f43f-4877-896a-1b1818db9a6f None None] MFA Rules not processed for user `73fad109df9f449e8ac5f38749c01ace`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:54:33.725820 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-90c3fc8e-f43f-4877-896a-1b1818db9a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:33.732963 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1461/2880] 10.222.0.20 () {58 vars in 967 bytes} [Thu Jul 21 03:54:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:54:33.744858 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7dac4-d496-4a80-b027-9ab1e2b7d3e8 service swift] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:33.755338 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7dac4-d496-4a80-b027-9ab1e2b7d3e8 service swift] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:33.760389 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9874448a-a80f-4b1f-a21f-a87fbc49d4df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8bc228892e45c0a7d1b529c2f9a8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:33.761517 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9874448a-a80f-4b1f-a21f-a87fbc49d4df service swift] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:33.761801 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9874448a-a80f-4b1f-a21f-a87fbc49d4df service swift] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:33.762080 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9874448a-a80f-4b1f-a21f-a87fbc49d4df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:33.769992 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9874448a-a80f-4b1f-a21f-a87fbc49d4df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:33.771606 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9874448a-a80f-4b1f-a21f-a87fbc49d4df service swift] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:33.780196 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1420/2881] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jul 21 03:54:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 03:54:35.861426 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3fc8e-f43f-4877-896a-1b1818db9a6f None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:35.864075 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-90c3fc8e-f43f-4877-896a-1b1818db9a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:35.929589 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3fc8e-f43f-4877-896a-1b1818db9a6f None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:35.934639 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef600c-2eac-42e0-a252-1cf63523c458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:35.935510 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef600c-2eac-42e0-a252-1cf63523c458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:35.935793 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef600c-2eac-42e0-a252-1cf63523c458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:35.936069 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef600c-2eac-42e0-a252-1cf63523c458 admin admin] PATH_INFO: `/v3/users/cb5f2620c55c43ba89da6aea0dc67878` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:35.937266 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef600c-2eac-42e0-a252-1cf63523c458 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb5f2620c55c43ba89da6aea0dc67878)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:35.939208 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef600c-2eac-42e0-a252-1cf63523c458 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:35.983296 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e0ef600c-2eac-42e0-a252-1cf63523c458 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb5f2620c55c43ba89da6aea0dc67878'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:35.983921 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e0ef600c-2eac-42e0-a252-1cf63523c458 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb5f2620c55c43ba89da6aea0dc67878'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:35.984538 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e0ef600c-2eac-42e0-a252-1cf63523c458 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb5f2620c55c43ba89da6aea0dc67878'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:35.989649 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:54:35.991939 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e0ef600c-2eac-42e0-a252-1cf63523c458 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb5f2620c55c43ba89da6aea0dc67878'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:36.000451 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-e0ef600c-2eac-42e0-a252-1cf63523c458 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb5f2620c55c43ba89da6aea0dc67878'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:36.017419 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1462/2882] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:54:35 2022] DELETE /identity/v3/users/cb5f2620c55c43ba89da6aea0dc67878 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:54:36.021929 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a236de-7532-43de-8abf-1261368fde26 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:36.022392 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a236de-7532-43de-8abf-1261368fde26 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:36.022539 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a236de-7532-43de-8abf-1261368fde26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:36.040053 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-e7a236de-7532-43de-8abf-1261368fde26 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:54:36.041233 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e7a236de-7532-43de-8abf-1261368fde26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:36.097226 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1421/2883] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:54:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:54:36.107386 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef600c-2eac-42e0-a252-1cf63523c458 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:36.108780 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-e0ef600c-2eac-42e0-a252-1cf63523c458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:36.165373 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef600c-2eac-42e0-a252-1cf63523c458 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:36.169504 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5870f8-8829-47c2-8d86-ea6f19ac8a4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:36.170157 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5870f8-8829-47c2-8d86-ea6f19ac8a4c service neutron] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:36.170446 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5870f8-8829-47c2-8d86-ea6f19ac8a4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:36.170764 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5870f8-8829-47c2-8d86-ea6f19ac8a4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:36.179618 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5870f8-8829-47c2-8d86-ea6f19ac8a4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:36.181044 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5870f8-8829-47c2-8d86-ea6f19ac8a4c service neutron] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:36.190952 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1463/2884] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:54:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:54:36.360260 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a236de-7532-43de-8abf-1261368fde26 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:36.361807 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-e7a236de-7532-43de-8abf-1261368fde26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:36.375331 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a236de-7532-43de-8abf-1261368fde26 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:36.379910 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe5b3a-7da3-4bf0-913e-a03946a5c4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:36.380771 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe5b3a-7da3-4bf0-913e-a03946a5c4c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:36.381057 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe5b3a-7da3-4bf0-913e-a03946a5c4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:36.381332 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe5b3a-7da3-4bf0-913e-a03946a5c4c4 admin admin] PATH_INFO: `/v3/projects/cd82f2a1bc6c42fc8f7f627dd9917c45` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:36.382562 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe5b3a-7da3-4bf0-913e-a03946a5c4c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd82f2a1bc6c42fc8f7f627dd9917c45)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:36.384480 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe5b3a-7da3-4bf0-913e-a03946a5c4c4 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:36.396391 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=100 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:54:36.431515 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-04fe5b3a-7da3-4bf0-913e-a03946a5c4c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd82f2a1bc6c42fc8f7f627dd9917c45', 'request_id': 'req-04fe5b3a-7da3-4bf0-913e-a03946a5c4c4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:36.437534 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-04fe5b3a-7da3-4bf0-913e-a03946a5c4c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd82f2a1bc6c42fc8f7f627dd9917c45', 'request_id': 'req-04fe5b3a-7da3-4bf0-913e-a03946a5c4c4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:36.443903 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-04fe5b3a-7da3-4bf0-913e-a03946a5c4c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd82f2a1bc6c42fc8f7f627dd9917c45', 'request_id': 'req-04fe5b3a-7da3-4bf0-913e-a03946a5c4c4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:36.454274 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-04fe5b3a-7da3-4bf0-913e-a03946a5c4c4 admin admin] The token cache is being invalidate because project cd82f2a1bc6c42fc8f7f627dd9917c45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:54:36.454601 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-04fe5b3a-7da3-4bf0-913e-a03946a5c4c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:36.455233 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-04fe5b3a-7da3-4bf0-913e-a03946a5c4c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:54:36.456779 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1422/2885] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:54:36 2022] DELETE /identity/v3/projects/cd82f2a1bc6c42fc8f7f627dd9917c45 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:54:36.461958 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5277d55-ebd5-48c7-a3d4-a3a5b9314517 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:36.462250 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5277d55-ebd5-48c7-a3d4-a3a5b9314517 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:36.462565 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5277d55-ebd5-48c7-a3d4-a3a5b9314517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:36.480788 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-c5277d55-ebd5-48c7-a3d4-a3a5b9314517 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:54:36.481988 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-c5277d55-ebd5-48c7-a3d4-a3a5b9314517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:36.538686 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1464/2886] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:54:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:54:36.546599 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9caa2-63da-4c1b-9cb3-b1ee4ee20f32 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:36.546892 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9caa2-63da-4c1b-9cb3-b1ee4ee20f32 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:36.547173 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b9caa2-63da-4c1b-9cb3-b1ee4ee20f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:36.565214 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-81b9caa2-63da-4c1b-9cb3-b1ee4ee20f32 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:54:36.566412 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-81b9caa2-63da-4c1b-9cb3-b1ee4ee20f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:36.574858 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1423/2887] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:54:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:54:36.578683 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5277d55-ebd5-48c7-a3d4-a3a5b9314517 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:36.588136 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5277d55-ebd5-48c7-a3d4-a3a5b9314517 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:36.593291 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4fc803-e52f-4ade-88d6-3cb890e451a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:36.593941 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4fc803-e52f-4ade-88d6-3cb890e451a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:36.594231 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4fc803-e52f-4ade-88d6-3cb890e451a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:36.594546 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4fc803-e52f-4ade-88d6-3cb890e451a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:36.595280 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4fc803-e52f-4ade-88d6-3cb890e451a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80332) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 03:54:36.595596 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4fc803-e52f-4ade-88d6-3cb890e451a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:36.597193 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4fc803-e52f-4ade-88d6-3cb890e451a3 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:36.608545 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1465/2888] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jul 21 03:54:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 03:54:36.612582 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9caa2-63da-4c1b-9cb3-b1ee4ee20f32 None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:36.621721 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b9caa2-63da-4c1b-9cb3-b1ee4ee20f32 None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:36.629179 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0bcee9-3f39-4048-a2fc-f57fbb46778c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:36.629831 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0bcee9-3f39-4048-a2fc-f57fbb46778c admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:36.630120 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0bcee9-3f39-4048-a2fc-f57fbb46778c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:36.630395 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0bcee9-3f39-4048-a2fc-f57fbb46778c admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:36.631127 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0bcee9-3f39-4048-a2fc-f57fbb46778c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:36.633047 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0bcee9-3f39-4048-a2fc-f57fbb46778c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:36.658822 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1424/2889] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:54:36 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:54:36.663207 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4fc803-e52f-4ade-88d6-3cb890e451a3 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:36.672915 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4fc803-e52f-4ade-88d6-3cb890e451a3 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:36.729075 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c125745-38e8-4d47-9dd3-b13eb68bec42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:36.729747 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c125745-38e8-4d47-9dd3-b13eb68bec42 admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:36.730034 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c125745-38e8-4d47-9dd3-b13eb68bec42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:36.730342 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c125745-38e8-4d47-9dd3-b13eb68bec42 admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:36.731164 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c125745-38e8-4d47-9dd3-b13eb68bec42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:36.733086 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c125745-38e8-4d47-9dd3-b13eb68bec42 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:36.740489 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:54:36.753222 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1466/2890] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:54:36 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:54:36.757258 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0bcee9-3f39-4048-a2fc-f57fbb46778c admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:36.768155 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0bcee9-3f39-4048-a2fc-f57fbb46778c admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:36.773925 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ff71e-b50f-4140-bff4-3f70d7f983e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:36.774637 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ff71e-b50f-4140-bff4-3f70d7f983e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:36.774926 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ff71e-b50f-4140-bff4-3f70d7f983e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:36.775202 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ff71e-b50f-4140-bff4-3f70d7f983e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:36.775925 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ff71e-b50f-4140-bff4-3f70d7f983e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:36.778202 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ff71e-b50f-4140-bff4-3f70d7f983e7 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:36.788839 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1425/2891] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:54:36.792851 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c125745-38e8-4d47-9dd3-b13eb68bec42 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:36.802692 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c125745-38e8-4d47-9dd3-b13eb68bec42 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:36.807324 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae186e27-06c8-4a3e-ba60-0213533d76ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:36.809041 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae186e27-06c8-4a3e-ba60-0213533d76ac admin admin] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:36.809382 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae186e27-06c8-4a3e-ba60-0213533d76ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:36.809607 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae186e27-06c8-4a3e-ba60-0213533d76ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:36.810327 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae186e27-06c8-4a3e-ba60-0213533d76ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:36.811941 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae186e27-06c8-4a3e-ba60-0213533d76ac admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:36.821844 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1467/2892] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:54:36.826386 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ff71e-b50f-4140-bff4-3f70d7f983e7 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:36.836394 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ff71e-b50f-4140-bff4-3f70d7f983e7 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:36.841631 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99eccc-9e75-4ddc-955c-acc8ab6ac677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:36.842533 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99eccc-9e75-4ddc-955c-acc8ab6ac677 admin admin] REQUEST_METHOD: `PUT` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:36.842849 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99eccc-9e75-4ddc-955c-acc8ab6ac677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:36.843130 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a99eccc-9e75-4ddc-955c-acc8ab6ac677 admin admin] PATH_INFO: `/v3/projects/bfe7cd0d77b647fc8f8fb8cb536755fa/users/c30663544c724654babd07ed19d385dc/roles/1ac721157e9b40f18cbbc76f5a6b0d3d` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:36.857527 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a99eccc-9e75-4ddc-955c-acc8ab6ac677 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfe7cd0d77b647fc8f8fb8cb536755fa, user_id=c30663544c724654babd07ed19d385dc, role_id=1ac721157e9b40f18cbbc76f5a6b0d3d)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:36.860293 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a99eccc-9e75-4ddc-955c-acc8ab6ac677 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:36.873274 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1426/2893] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:54:36 2022] PUT /identity/v3/projects/bfe7cd0d77b647fc8f8fb8cb536755fa/users/c30663544c724654babd07ed19d385dc/roles/1ac721157e9b40f18cbbc76f5a6b0d3d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:54:36.878257 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6cf84-f40f-46f1-80bb-3c9e601c8278 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:36.878765 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6cf84-f40f-46f1-80bb-3c9e601c8278 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:36.878867 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6cf84-f40f-46f1-80bb-3c9e601c8278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:36.896477 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-78a6cf84-f40f-46f1-80bb-3c9e601c8278 None None] MFA Rules not processed for user `eec6b06f7801471e932e859de1190593`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:54:36.897661 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-78a6cf84-f40f-46f1-80bb-3c9e601c8278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:36.955923 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1468/2894] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:54:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:54:36.965433 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99eccc-9e75-4ddc-955c-acc8ab6ac677 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:36.967162 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9a99eccc-9e75-4ddc-955c-acc8ab6ac677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:37.022914 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a99eccc-9e75-4ddc-955c-acc8ab6ac677 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:37.026715 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726cf3ae-6b44-429d-b4b0-eb617825e57b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:37.027382 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726cf3ae-6b44-429d-b4b0-eb617825e57b service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:37.027666 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726cf3ae-6b44-429d-b4b0-eb617825e57b service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:37.027960 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726cf3ae-6b44-429d-b4b0-eb617825e57b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:37.037171 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726cf3ae-6b44-429d-b4b0-eb617825e57b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:37.038622 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726cf3ae-6b44-429d-b4b0-eb617825e57b service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:37.048133 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1427/2895] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:54:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:54:40.737718 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c68869-7116-4ec8-b13a-713edac44006 None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:40.738239 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c68869-7116-4ec8-b13a-713edac44006 None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:40.738239 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c68869-7116-4ec8-b13a-713edac44006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:40.769268 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-20c68869-7116-4ec8-b13a-713edac44006 None None] MFA Rules not processed for user `c30663544c724654babd07ed19d385dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:54:40.770606 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-20c68869-7116-4ec8-b13a-713edac44006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:40.850259 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1469/2896] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:54:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:54:40.854653 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726cf3ae-6b44-429d-b4b0-eb617825e57b service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:40.865253 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726cf3ae-6b44-429d-b4b0-eb617825e57b service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:40.871098 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e6290-d62f-450a-99a9-ca1ae49c3dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:40.871775 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e6290-d62f-450a-99a9-ca1ae49c3dd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:40.872061 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e6290-d62f-450a-99a9-ca1ae49c3dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:40.872340 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e6290-d62f-450a-99a9-ca1ae49c3dd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:40.873084 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8e6290-d62f-450a-99a9-ca1ae49c3dd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:40.875065 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8e6290-d62f-450a-99a9-ca1ae49c3dd6 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:40.913886 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1428/2897] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jul 21 03:54:40 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 03:54:40.915330 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c68869-7116-4ec8-b13a-713edac44006 None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:40.927501 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c68869-7116-4ec8-b13a-713edac44006 None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:40.985580 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef1a8ff-95f8-4af0-8080-81e2fa304e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:40.986260 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1a8ff-95f8-4af0-8080-81e2fa304e4a admin admin] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:40.986579 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1a8ff-95f8-4af0-8080-81e2fa304e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:40.986859 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1a8ff-95f8-4af0-8080-81e2fa304e4a admin admin] PATH_INFO: `/v3/users` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:40.987554 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef1a8ff-95f8-4af0-8080-81e2fa304e4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:40.989461 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef1a8ff-95f8-4af0-8080-81e2fa304e4a admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:41.005611 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:54:41.011374 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1470/2898] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jul 21 03:54:40 2022] POST /identity/v3/users => generated 298 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 03:54:41.015657 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e6290-d62f-450a-99a9-ca1ae49c3dd6 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:41.026881 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e6290-d62f-450a-99a9-ca1ae49c3dd6 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:41.032224 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaafc11-6d01-4c7e-af24-8dc0a72929cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:41.032906 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaafc11-6d01-4c7e-af24-8dc0a72929cd admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:41.033195 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaafc11-6d01-4c7e-af24-8dc0a72929cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:41.033480 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaafc11-6d01-4c7e-af24-8dc0a72929cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:41.034222 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaafc11-6d01-4c7e-af24-8dc0a72929cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:41.036195 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaafc11-6d01-4c7e-af24-8dc0a72929cd admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:41.048141 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1429/2899] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:54:41.052327 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef1a8ff-95f8-4af0-8080-81e2fa304e4a admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:41.062572 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef1a8ff-95f8-4af0-8080-81e2fa304e4a admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:41.067703 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2d660-38c3-4277-a0e2-41523c8848cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:41.068761 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2d660-38c3-4277-a0e2-41523c8848cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:41.069120 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2d660-38c3-4277-a0e2-41523c8848cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:41.069767 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2d660-38c3-4277-a0e2-41523c8848cc admin admin] PATH_INFO: `/v3/projects/407baf5701cb446b8e62123cbcc6cb10/users/f951f0a4c2f94299ae2dd4efb1afb901/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:41.092607 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2d660-38c3-4277-a0e2-41523c8848cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=407baf5701cb446b8e62123cbcc6cb10, user_id=f951f0a4c2f94299ae2dd4efb1afb901, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:41.095599 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2d660-38c3-4277-a0e2-41523c8848cc admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:41.114027 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1471/2900] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:54:41 2022] PUT /identity/v3/projects/407baf5701cb446b8e62123cbcc6cb10/users/f951f0a4c2f94299ae2dd4efb1afb901/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:54:41.118051 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaafc11-6d01-4c7e-af24-8dc0a72929cd admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:41.128770 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaafc11-6d01-4c7e-af24-8dc0a72929cd admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:41.133129 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:54:41.200665 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf10184-d9d0-4bb3-b04a-8c0353403d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:41.201353 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf10184-d9d0-4bb3-b04a-8c0353403d6f admin admin] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:41.201642 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf10184-d9d0-4bb3-b04a-8c0353403d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:41.201924 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf10184-d9d0-4bb3-b04a-8c0353403d6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:41.202704 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf10184-d9d0-4bb3-b04a-8c0353403d6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:41.204330 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf10184-d9d0-4bb3-b04a-8c0353403d6f admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:41.216285 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1430/2901] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jul 21 03:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 03:54:41.220539 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2d660-38c3-4277-a0e2-41523c8848cc admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:41.232027 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2d660-38c3-4277-a0e2-41523c8848cc admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:41.236826 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0af62-644e-4ada-8ff2-4a5cb8d63cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:41.237748 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0af62-644e-4ada-8ff2-4a5cb8d63cb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:41.238030 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0af62-644e-4ada-8ff2-4a5cb8d63cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:41.238306 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f0af62-644e-4ada-8ff2-4a5cb8d63cb5 admin admin] PATH_INFO: `/v3/projects/407baf5701cb446b8e62123cbcc6cb10/users/f951f0a4c2f94299ae2dd4efb1afb901/roles/27e53d6c56f24c25a8c8057bfd36bcf1` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:41.240409 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f0af62-644e-4ada-8ff2-4a5cb8d63cb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=407baf5701cb446b8e62123cbcc6cb10, user_id=f951f0a4c2f94299ae2dd4efb1afb901, role_id=27e53d6c56f24c25a8c8057bfd36bcf1)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:41.243032 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f0af62-644e-4ada-8ff2-4a5cb8d63cb5 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:41.255251 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1472/2902] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jul 21 03:54:41 2022] PUT /identity/v3/projects/407baf5701cb446b8e62123cbcc6cb10/users/f951f0a4c2f94299ae2dd4efb1afb901/roles/27e53d6c56f24c25a8c8057bfd36bcf1 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 03:54:45.880778 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa71196-8070-40ab-9480-cda64b5341c5 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:45.881373 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa71196-8070-40ab-9480-cda64b5341c5 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:45.881373 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa71196-8070-40ab-9480-cda64b5341c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:45.921207 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-0fa71196-8070-40ab-9480-cda64b5341c5 None None] MFA Rules not processed for user `f951f0a4c2f94299ae2dd4efb1afb901`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:54:45.923827 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-0fa71196-8070-40ab-9480-cda64b5341c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:45.995624 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1431/2903] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:54:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:54:46.008240 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0af62-644e-4ada-8ff2-4a5cb8d63cb5 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:46.009767 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-74f0af62-644e-4ada-8ff2-4a5cb8d63cb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:46.072177 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f0af62-644e-4ada-8ff2-4a5cb8d63cb5 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:46.076346 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eab66b-a8c9-419e-b5b7-8575e2b374e3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a567cddc98164bd39317a245626d0f5d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:46.077003 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eab66b-a8c9-419e-b5b7-8575e2b374e3 service glance] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:46.077289 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eab66b-a8c9-419e-b5b7-8575e2b374e3 service glance] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:46.077566 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eab66b-a8c9-419e-b5b7-8575e2b374e3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:46.135743 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eab66b-a8c9-419e-b5b7-8575e2b374e3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:46.137758 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eab66b-a8c9-419e-b5b7-8575e2b374e3 service glance] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:46.147436 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1473/2904] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:54:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:54:46.251947 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a722f2-3985-4413-8196-c1dddd202f78 None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:46.252243 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a722f2-3985-4413-8196-c1dddd202f78 None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:46.252524 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a722f2-3985-4413-8196-c1dddd202f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:46.271159 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-d7a722f2-3985-4413-8196-c1dddd202f78 None None] MFA Rules not processed for user `73fad109df9f449e8ac5f38749c01ace`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:54:46.272387 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-d7a722f2-3985-4413-8196-c1dddd202f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:46.328856 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1432/2905] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jul 21 03:54:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 03:54:46.341082 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eab66b-a8c9-419e-b5b7-8575e2b374e3 service glance] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:46.342602 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-d5eab66b-a8c9-419e-b5b7-8575e2b374e3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:46.414779 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eab66b-a8c9-419e-b5b7-8575e2b374e3 service glance] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:46.420239 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaefaf8-7de8-45a1-af91-78a3d1864b65 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8bc228892e45c0a7d1b529c2f9a8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:46.420884 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaefaf8-7de8-45a1-af91-78a3d1864b65 service swift] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:46.421172 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaefaf8-7de8-45a1-af91-78a3d1864b65 service swift] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:46.421452 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaefaf8-7de8-45a1-af91-78a3d1864b65 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:46.429932 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaefaf8-7de8-45a1-af91-78a3d1864b65 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:46.431534 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaefaf8-7de8-45a1-af91-78a3d1864b65 service swift] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:46.440194 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1474/2906] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jul 21 03:54:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 03:54:54.807268 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9b5bd-8799-40e8-954c-282fd188577e None None] REQUEST_METHOD: `POST` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:54.807763 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9b5bd-8799-40e8-954c-282fd188577e None None] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:54.807866 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9b5bd-8799-40e8-954c-282fd188577e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:54.825971 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.auth.core [None req-8ea9b5bd-8799-40e8-954c-282fd188577e None None] MFA Rules not processed for user `c30663544c724654babd07ed19d385dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80331) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:54:54.827205 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-8ea9b5bd-8799-40e8-954c-282fd188577e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:54.834006 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1433/2907] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jul 21 03:54:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:54:56.436958 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=95,keystone:INSERT=2 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:54:57.064988 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73e399-cdff-4c85-9c91-4dd2ef11f33d None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:57.065356 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73e399-cdff-4c85-9c91-4dd2ef11f33d None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:57.065737 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b73e399-cdff-4c85-9c91-4dd2ef11f33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:57.083735 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-0b73e399-cdff-4c85-9c91-4dd2ef11f33d None None] MFA Rules not processed for user `73fad109df9f449e8ac5f38749c01ace`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:54:57.085046 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0b73e399-cdff-4c85-9c91-4dd2ef11f33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:54:57.092933 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1475/2908] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jul 21 03:54:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:54:57.105629 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9b5bd-8799-40e8-954c-282fd188577e None None] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:54:57.117636 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9b5bd-8799-40e8-954c-282fd188577e None None] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:54:57.122845 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca8201-449f-4f8a-ac59-16b7dd3ccb42 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8bc228892e45c0a7d1b529c2f9a8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:54:57.123496 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca8201-449f-4f8a-ac59-16b7dd3ccb42 service swift] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:54:57.123783 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca8201-449f-4f8a-ac59-16b7dd3ccb42 service swift] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:54:57.124059 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feca8201-449f-4f8a-ac59-16b7dd3ccb42 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:54:57.132342 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca8201-449f-4f8a-ac59-16b7dd3ccb42 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:54:57.133923 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feca8201-449f-4f8a-ac59-16b7dd3ccb42 service swift] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:54:57.143211 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1434/2909] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jul 21 03:54:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 03:55:07.078830 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=3 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:55:07.139606 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=94 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:55:12.153194 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73e399-cdff-4c85-9c91-4dd2ef11f33d None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:55:12.154639 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-0b73e399-cdff-4c85-9c91-4dd2ef11f33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:55:12.230041 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b73e399-cdff-4c85-9c91-4dd2ef11f33d None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:55:12.235405 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160a3c6-4a0b-46d3-9bd3-d63b4a40d0f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:55:12.236054 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160a3c6-4a0b-46d3-9bd3-d63b4a40d0f4 service nova] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:55:12.236337 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160a3c6-4a0b-46d3-9bd3-d63b4a40d0f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:55:12.236616 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160a3c6-4a0b-46d3-9bd3-d63b4a40d0f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:55:12.238398 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9160a3c6-4a0b-46d3-9bd3-d63b4a40d0f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:55:12.250904 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9160a3c6-4a0b-46d3-9bd3-d63b4a40d0f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:55:12.252408 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9160a3c6-4a0b-46d3-9bd3-d63b4a40d0f4 service nova] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:55:12.262935 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1476/2910] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:55:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:55:19.190031 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca8201-449f-4f8a-ac59-16b7dd3ccb42 service swift] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:55:19.191642 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-feca8201-449f-4f8a-ac59-16b7dd3ccb42 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:55:19.247891 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feca8201-449f-4f8a-ac59-16b7dd3ccb42 service swift] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:55:19.252004 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0d5f4e-3abf-477d-ae81-6a0285c33b0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b68c257254de483ab65eb5dc5684a704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:55:19.252646 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d5f4e-3abf-477d-ae81-6a0285c33b0a service neutron] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:55:19.252928 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d5f4e-3abf-477d-ae81-6a0285c33b0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:55:19.253202 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0d5f4e-3abf-477d-ae81-6a0285c33b0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:55:19.262285 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0d5f4e-3abf-477d-ae81-6a0285c33b0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:55:19.263788 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0d5f4e-3abf-477d-ae81-6a0285c33b0a service neutron] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:55:19.273836 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1435/2911] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:55:19 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 03:55:22.258567 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=34 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:55:29.269702 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=26 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:56:57.925991 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160a3c6-4a0b-46d3-9bd3-d63b4a40d0f4 service nova] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:56:57.928796 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-9160a3c6-4a0b-46d3-9bd3-d63b4a40d0f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:56:57.993601 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9160a3c6-4a0b-46d3-9bd3-d63b4a40d0f4 service nova] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:56:57.998512 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de30fb-f123-448e-9e96-f2037ac04243 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb39129b3ed04db28ed01860b37bd714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:56:57.999152 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de30fb-f123-448e-9e96-f2037ac04243 service placement] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:56:57.999434 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de30fb-f123-448e-9e96-f2037ac04243 service placement] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:56:57.999709 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de30fb-f123-448e-9e96-f2037ac04243 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:56:58.002006 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-65de30fb-f123-448e-9e96-f2037ac04243 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:56:58.012983 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65de30fb-f123-448e-9e96-f2037ac04243 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:56:58.014562 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65de30fb-f123-448e-9e96-f2037ac04243 service placement] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:56:58.024250 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1477/2912] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:56:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:57:08.020136 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=32 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:57:39.258909 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0d5f4e-3abf-477d-ae81-6a0285c33b0a service neutron] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:57:39.261079 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-9c0d5f4e-3abf-477d-ae81-6a0285c33b0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:57:39.287061 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0d5f4e-3abf-477d-ae81-6a0285c33b0a service neutron] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:57:39.301354 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8cf02c-9ee0-4241-8a5d-7001b4ba3005 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cefbe2d0c739428ab0d4dfeaed6c37ab', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:57:39.302251 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cf02c-9ee0-4241-8a5d-7001b4ba3005 service nova] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:57:39.302745 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cf02c-9ee0-4241-8a5d-7001b4ba3005 service nova] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:57:39.303199 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cf02c-9ee0-4241-8a5d-7001b4ba3005 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:57:39.305282 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-ec8cf02c-9ee0-4241-8a5d-7001b4ba3005 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:57:39.320064 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8cf02c-9ee0-4241-8a5d-7001b4ba3005 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:57:39.321748 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8cf02c-9ee0-4241-8a5d-7001b4ba3005 service nova] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:57:39.337919 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1436/2913] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:57:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:57:46.510953 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39efc1cb-2e3d-4c0a-9e74-67b33bcc4d9c None None] REQUEST_METHOD: `POST` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:57:46.511441 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39efc1cb-2e3d-4c0a-9e74-67b33bcc4d9c None None] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:57:46.511556 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39efc1cb-2e3d-4c0a-9e74-67b33bcc4d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:57:46.529008 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.auth.core [None req-39efc1cb-2e3d-4c0a-9e74-67b33bcc4d9c None None] MFA Rules not processed for user `73fad109df9f449e8ac5f38749c01ace`. Rule list: `[]` (Enabled: `True`). {{(pid=80332) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 03:57:46.530228 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-39efc1cb-2e3d-4c0a-9e74-67b33bcc4d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:57:46.537677 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1478/2914] 10.222.0.20 () {58 vars in 967 bytes} [Thu Jul 21 03:57:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 03:57:46.577839 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8cf02c-9ee0-4241-8a5d-7001b4ba3005 service nova] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:57:46.589007 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8cf02c-9ee0-4241-8a5d-7001b4ba3005 service nova] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:57:46.593927 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf3058-cabf-4734-9857-66ed3164004b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ce8bc228892e45c0a7d1b529c2f9a8f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:57:46.594592 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf3058-cabf-4734-9857-66ed3164004b service swift] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:57:46.594878 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf3058-cabf-4734-9857-66ed3164004b service swift] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:57:46.595155 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf3058-cabf-4734-9857-66ed3164004b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:57:46.603190 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf3058-cabf-4734-9857-66ed3164004b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:57:46.604770 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf3058-cabf-4734-9857-66ed3164004b service swift] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:57:46.613232 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1437/2915] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jul 21 03:57:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 03:57:50.012810 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39efc1cb-2e3d-4c0a-9e74-67b33bcc4d9c None None] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:57:50.025311 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39efc1cb-2e3d-4c0a-9e74-67b33bcc4d9c None None] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:57:50.030442 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95cea8-c7b7-4f08-b5df-c6929fd1783d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb39129b3ed04db28ed01860b37bd714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:57:50.031123 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95cea8-c7b7-4f08-b5df-c6929fd1783d service placement] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:57:50.031411 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95cea8-c7b7-4f08-b5df-c6929fd1783d service placement] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:57:50.031688 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee95cea8-c7b7-4f08-b5df-c6929fd1783d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:57:50.033968 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ee95cea8-c7b7-4f08-b5df-c6929fd1783d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:57:50.045778 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95cea8-c7b7-4f08-b5df-c6929fd1783d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:57:50.047416 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee95cea8-c7b7-4f08-b5df-c6929fd1783d service placement] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:57:50.058176 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1479/2916] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:57:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 03:57:53.143229 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf3058-cabf-4734-9857-66ed3164004b service swift] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:57:53.154768 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf3058-cabf-4734-9857-66ed3164004b service swift] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:57:53.160483 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e2405-737c-4428-990f-f7c0ce8c4d55 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb39129b3ed04db28ed01860b37bd714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:57:53.161516 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e2405-737c-4428-990f-f7c0ce8c4d55 service placement] REQUEST_METHOD: `GET` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:57:53.161907 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e2405-737c-4428-990f-f7c0ce8c4d55 service placement] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:57:53.162192 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e2405-737c-4428-990f-f7c0ce8c4d55 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:57:53.164262 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-bc4e2405-737c-4428-990f-f7c0ce8c4d55 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:57:53.177157 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e2405-737c-4428-990f-f7c0ce8c4d55 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:57:53.178789 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e2405-737c-4428-990f-f7c0ce8c4d55 service placement] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:57:53.189841 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1438/2917] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 03:57:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 03:57:53.210194 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95cea8-c7b7-4f08-b5df-c6929fd1783d service placement] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:57:53.286999 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee95cea8-c7b7-4f08-b5df-c6929fd1783d service placement] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:57:53.291493 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0c1f8-aefb-4d5f-84b4-becfb6f249c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:57:53.292555 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0c1f8-aefb-4d5f-84b4-becfb6f249c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:57:53.292697 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0c1f8-aefb-4d5f-84b4-becfb6f249c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:57:53.292930 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0c1f8-aefb-4d5f-84b4-becfb6f249c2 admin admin] PATH_INFO: `/v3/users/c30663544c724654babd07ed19d385dc` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:57:53.294136 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb0c1f8-aefb-4d5f-84b4-becfb6f249c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c30663544c724654babd07ed19d385dc)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:57:53.296132 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb0c1f8-aefb-4d5f-84b4-becfb6f249c2 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:57:53.341872 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ccb0c1f8-aefb-4d5f-84b4-becfb6f249c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c30663544c724654babd07ed19d385dc'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:57:53.342911 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ccb0c1f8-aefb-4d5f-84b4-becfb6f249c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c30663544c724654babd07ed19d385dc'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:57:53.343848 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ccb0c1f8-aefb-4d5f-84b4-becfb6f249c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c30663544c724654babd07ed19d385dc'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:57:53.354363 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ccb0c1f8-aefb-4d5f-84b4-becfb6f249c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c30663544c724654babd07ed19d385dc'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:57:53.362130 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-ccb0c1f8-aefb-4d5f-84b4-becfb6f249c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c30663544c724654babd07ed19d385dc'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:57:53.379292 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1480/2918] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:57:53 2022] DELETE /identity/v3/users/c30663544c724654babd07ed19d385dc => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:57:53.551231 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e2405-737c-4428-990f-f7c0ce8c4d55 service placement] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:57:53.563136 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e2405-737c-4428-990f-f7c0ce8c4d55 service placement] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:57:53.622859 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174211e-4a0c-4e17-948c-949a9cebe4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:57:53.623727 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174211e-4a0c-4e17-948c-949a9cebe4a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:57:53.624011 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174211e-4a0c-4e17-948c-949a9cebe4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:57:53.624288 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174211e-4a0c-4e17-948c-949a9cebe4a4 admin admin] PATH_INFO: `/v3/projects/bfe7cd0d77b647fc8f8fb8cb536755fa` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:57:53.625465 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5174211e-4a0c-4e17-948c-949a9cebe4a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfe7cd0d77b647fc8f8fb8cb536755fa)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:57:53.627875 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5174211e-4a0c-4e17-948c-949a9cebe4a4 admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:57:53.673003 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5174211e-4a0c-4e17-948c-949a9cebe4a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfe7cd0d77b647fc8f8fb8cb536755fa', 'request_id': 'req-5174211e-4a0c-4e17-948c-949a9cebe4a4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:57:53.678974 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5174211e-4a0c-4e17-948c-949a9cebe4a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfe7cd0d77b647fc8f8fb8cb536755fa', 'request_id': 'req-5174211e-4a0c-4e17-948c-949a9cebe4a4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:57:53.686733 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5174211e-4a0c-4e17-948c-949a9cebe4a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfe7cd0d77b647fc8f8fb8cb536755fa', 'request_id': 'req-5174211e-4a0c-4e17-948c-949a9cebe4a4'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:57:53.697515 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5174211e-4a0c-4e17-948c-949a9cebe4a4 admin admin] The token cache is being invalidate because project bfe7cd0d77b647fc8f8fb8cb536755fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:57:53.697866 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5174211e-4a0c-4e17-948c-949a9cebe4a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:57:53.698597 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-5174211e-4a0c-4e17-948c-949a9cebe4a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:57:53.700207 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1439/2919] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:57:53 2022] DELETE /identity/v3/projects/bfe7cd0d77b647fc8f8fb8cb536755fa => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:57:53.704830 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0c1f8-aefb-4d5f-84b4-becfb6f249c2 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:57:53.706229 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-ccb0c1f8-aefb-4d5f-84b4-becfb6f249c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:57:53.719354 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0c1f8-aefb-4d5f-84b4-becfb6f249c2 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:57:53.774583 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13b413-471b-4a17-8bad-a3c3d0e04419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:57:53.775451 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13b413-471b-4a17-8bad-a3c3d0e04419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:57:53.775737 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13b413-471b-4a17-8bad-a3c3d0e04419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:57:53.776014 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f13b413-471b-4a17-8bad-a3c3d0e04419 admin admin] PATH_INFO: `/v3/users/f951f0a4c2f94299ae2dd4efb1afb901` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:57:53.777212 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13b413-471b-4a17-8bad-a3c3d0e04419 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f951f0a4c2f94299ae2dd4efb1afb901)` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:57:53.779201 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f13b413-471b-4a17-8bad-a3c3d0e04419 admin admin] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:57:53.780653 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:57:53.826252 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2f13b413-471b-4a17-8bad-a3c3d0e04419 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f951f0a4c2f94299ae2dd4efb1afb901'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:57:53.826840 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2f13b413-471b-4a17-8bad-a3c3d0e04419 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f951f0a4c2f94299ae2dd4efb1afb901'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:57:53.827442 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2f13b413-471b-4a17-8bad-a3c3d0e04419 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f951f0a4c2f94299ae2dd4efb1afb901'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:57:53.834912 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2f13b413-471b-4a17-8bad-a3c3d0e04419 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f951f0a4c2f94299ae2dd4efb1afb901'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:57:53.842723 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.notifications [None req-2f13b413-471b-4a17-8bad-a3c3d0e04419 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f951f0a4c2f94299ae2dd4efb1afb901'} {{(pid=80332) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:57:53.859559 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1481/2920] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jul 21 03:57:53 2022] DELETE /identity/v3/users/f951f0a4c2f94299ae2dd4efb1afb901 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:57:54.028212 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174211e-4a0c-4e17-948c-949a9cebe4a4 admin admin] Authenticating user token {{(pid=80331) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 03:57:54.029738 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.fernet_utils [None req-5174211e-4a0c-4e17-948c-949a9cebe4a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80331) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 03:57:54.042535 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174211e-4a0c-4e17-948c-949a9cebe4a4 admin admin] Validating token access rules against request {{(pid=80331) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 03:57:54.091437 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:57:54.103025 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff3e343-b47b-4c78-ac17-89420e82981c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec6b06f7801471e932e859de1190593', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c64654fdd0e44100a98ee66278a10b0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80331) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 03:57:54.103964 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3e343-b47b-4c78-ac17-89420e82981c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 03:57:54.104361 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3e343-b47b-4c78-ac17-89420e82981c admin admin] SCRIPT_NAME: `/identity` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 03:57:54.104705 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff3e343-b47b-4c78-ac17-89420e82981c admin admin] PATH_INFO: `/v3/projects/407baf5701cb446b8e62123cbcc6cb10` {{(pid=80331) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 03:57:54.105914 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff3e343-b47b-4c78-ac17-89420e82981c admin admin] RBAC: Authorizing `identity:delete_project(project_id=407baf5701cb446b8e62123cbcc6cb10)` {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 03:57:54.107840 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff3e343-b47b-4c78-ac17-89420e82981c admin admin] RBAC: Authorization granted {{(pid=80331) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 03:57:54.153533 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2ff3e343-b47b-4c78-ac17-89420e82981c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '407baf5701cb446b8e62123cbcc6cb10', 'request_id': 'req-2ff3e343-b47b-4c78-ac17-89420e82981c'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:57:54.159523 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2ff3e343-b47b-4c78-ac17-89420e82981c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '407baf5701cb446b8e62123cbcc6cb10', 'request_id': 'req-2ff3e343-b47b-4c78-ac17-89420e82981c'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:57:54.166792 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2ff3e343-b47b-4c78-ac17-89420e82981c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '407baf5701cb446b8e62123cbcc6cb10', 'request_id': 'req-2ff3e343-b47b-4c78-ac17-89420e82981c'} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:57:54.177311 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2ff3e343-b47b-4c78-ac17-89420e82981c admin admin] The token cache is being invalidate because project 407baf5701cb446b8e62123cbcc6cb10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80331) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 03:57:54.177601 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2ff3e343-b47b-4c78-ac17-89420e82981c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:57:54.178227 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG keystone.notifications [None req-2ff3e343-b47b-4c78-ac17-89420e82981c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80331) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 03:57:54.179760 dv-cinder-850318-2-smb devstack@keystone.service[80331]: [pid: 80331|app: 0|req: 1440/2921] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jul 21 03:57:54 2022] DELETE /identity/v3/projects/407baf5701cb446b8e62123cbcc6cb10 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 03:58:03.856147 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=26,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 03:58:04.174388 dv-cinder-850318-2-smb devstack@keystone.service[80331]: DEBUG dbcounter [-] [80331] Writing DB stats keystone:SELECT=28,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80331) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:01:59.916289 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13b413-471b-4a17-8bad-a3c3d0e04419 admin admin] Authenticating user token {{(pid=80332) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:01:59.917688 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-2f13b413-471b-4a17-8bad-a3c3d0e04419 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:02:00.054078 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f13b413-471b-4a17-8bad-a3c3d0e04419 admin admin] Validating token access rules against request {{(pid=80332) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:02:00.114720 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f99a2-6800-4130-9ccd-78fa5e1cff63 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cb39129b3ed04db28ed01860b37bd714', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0432303daa8b4304a8e07032d6a80781', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80332) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:02:00.116017 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f99a2-6800-4130-9ccd-78fa5e1cff63 service placement] REQUEST_METHOD: `GET` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:02:00.116307 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f99a2-6800-4130-9ccd-78fa5e1cff63 service placement] SCRIPT_NAME: `/identity` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:02:00.116584 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f99a2-6800-4130-9ccd-78fa5e1cff63 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80332) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:02:00.118378 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.fernet_utils [None req-428f99a2-6800-4130-9ccd-78fa5e1cff63 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80332) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:02:00.129389 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f99a2-6800-4130-9ccd-78fa5e1cff63 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:02:00.130978 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f99a2-6800-4130-9ccd-78fa5e1cff63 service placement] RBAC: Authorization granted {{(pid=80332) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:02:00.140732 dv-cinder-850318-2-smb devstack@keystone.service[80332]: [pid: 80332|app: 0|req: 1482/2922] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jul 21 04:01:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:02:10.136540 dv-cinder-850318-2-smb devstack@keystone.service[80332]: DEBUG dbcounter [-] [80332] Writing DB stats keystone:SELECT=89 {{(pid=80332) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}